DongfuJiang commited on
Commit
ea1b309
·
1 Parent(s): b61a90a

Auto Daily Leaderboard udpate Thu Oct 31 12:00:26 PM EDT 2024

Browse files
arena_elo/results/20241031/clean_battle_t2i_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20241031/clean_battle_video_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20241031/elo_results_t2i_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0d66bbf8fd0a7551f9fffce11cbfb9788c46ffdf1ba2878d0b628b97f725a89
3
+ size 88245
arena_elo/results/20241031/elo_results_video_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6fbb18cb0b1f89985c14f33b2a7248eac7ccc4e32ba9b0588ea5a80da498f56
3
+ size 66388
arena_elo/results/20241031/t2i_generation_leaderboard.csv ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1121.0745643669302,1123.6350235694122,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ FLUX.1-dev,FLUX.1-dev,1112.2241807320759,1119.5559500908657,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
+ FLUX.1-schnell,FLUX.1-schnell,1082.2731103922747,1073.9762885431956,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1072.1214144850478,1071.5484665742215,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1059.9539217136369,1057.1664270155375,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ StableCascade,StableCascade,1038.9487845822814,1041.9965475503805,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ HunyuanDiT,HunyuanDiT,1031.7535942550423,1024.6390979066982,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
+ SDXL-Lightning,SDXL-Lightning,1020.7989521769452,1024.238620990864,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
+ PixArtSigma,PixArtSigma,1020.7376512332856,1021.0934283829224,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
11
+ PixArtAlpha,PixArtAlpha,1020.0601099154849,1011.7390122427934,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
12
+ SD3,SD3,1009.7355145598503,1013.240057173424,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
+ AuraFlow,AuraFlow,1008.9491584066384,1002.8996921572409,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
+ SDXL,SDXL,965.036605627369,966.1050227348493,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,913.5707123104991,911.4798753683542,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),904.9788318289039,899.4530516710622,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,828.3857697613,823.7930961966599,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,789.3971236524387,803.750355693955,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/20241031/video_generation_leaderboard.csv ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ StableVideoDiffusion,StableVideoDiffusion,1148.460154348565,1151.7704400501898,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
3
+ CogVideoX-2B,CogVideoX-2B,1108.0387601702323,1100.9624050762802,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
4
+ T2V-Turbo,T2V-Turbo,1084.8445749400853,1084.4439334390704,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
5
+ VideoCrafter2,VideoCrafter2,1068.3719584391863,1069.4555209780685,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
6
+ AnimateDiff,AnimateDiff,1068.3711452057469,1067.6734797816102,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
7
+ LaVie,LaVie,995.548590974449,996.6831350319302,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
8
+ OpenSora,OpenSora,911.8148704364976,912.6221135748349,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
9
+ OpenSora v1.2,OpenSora v1.2,891.6932550065835,890.4673227621503,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
10
+ ModelScope,ModelScope,861.539714459198,863.7052928883418,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
11
+ AnimateDiff Turbo,AnimateDiff Turbo,861.3169760194565,862.2163564175211,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
arena_elo/results/latest/clean_battle_t2i_generation.json CHANGED
@@ -104490,5 +104490,775 @@
104490
  "judge": "arena_user_10.16.12.226",
104491
  "anony": true,
104492
  "tstamp": 1729714557.8266
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
104493
  }
104494
  ]
 
104490
  "judge": "arena_user_10.16.12.226",
104491
  "anony": true,
104492
  "tstamp": 1729714557.8266
104493
+ },
104494
+ {
104495
+ "model_a_conv_id": "983ed6b8306247dcb7bbe19f9ef49bd5",
104496
+ "model_b_conv_id": "e3e229f19bbd469487d6c2b36272fd76",
104497
+ "inputs": {
104498
+ "prompt": "hyperrealism fruits and vegetables market"
104499
+ },
104500
+ "model_a": "Kolors",
104501
+ "model_b": "SDXL",
104502
+ "vote_type": "tievote",
104503
+ "winner": "tie",
104504
+ "judge": "arena_user_10.16.31.254",
104505
+ "anony": true,
104506
+ "tstamp": 1730312116.2594
104507
+ },
104508
+ {
104509
+ "model_a_conv_id": "eb2268511c31405686485f001f70855c",
104510
+ "model_b_conv_id": "5d5b723c5db94decb8c358f06cf98ddc",
104511
+ "inputs": {
104512
+ "prompt": "New York Skyline with 'NeurIPS' written with fireworks on the sky."
104513
+ },
104514
+ "model_a": "HunyuanDiT",
104515
+ "model_b": "SDXL-Lightning",
104516
+ "vote_type": "rightvote",
104517
+ "winner": "model_b",
104518
+ "judge": "arena_user_10.16.19.51",
104519
+ "anony": true,
104520
+ "tstamp": 1730323935.013
104521
+ },
104522
+ {
104523
+ "model_a_conv_id": "4dfe3a1846634c5780299d8556f214f1",
104524
+ "model_b_conv_id": "56ab2e0f1f33479885336d82ba0d78e1",
104525
+ "inputs": {
104526
+ "prompt": "Bzaseball galove."
104527
+ },
104528
+ "model_a": "PixArtSigma",
104529
+ "model_b": "PixArtAlpha",
104530
+ "vote_type": "bothbad_vote",
104531
+ "winner": "tie (bothbad)",
104532
+ "judge": "arena_user_10.16.31.254",
104533
+ "anony": true,
104534
+ "tstamp": 1730323948.3329
104535
+ },
104536
+ {
104537
+ "model_a_conv_id": "c11474b318bf4f898dc1d1907aade08c",
104538
+ "model_b_conv_id": "9c2b640714ba412ba1dd43ee51f0227b",
104539
+ "inputs": {
104540
+ "prompt": "photorealistic, detailed mechanical motorcycle, detailed"
104541
+ },
104542
+ "model_a": "HunyuanDiT",
104543
+ "model_b": "StableCascade",
104544
+ "vote_type": "leftvote",
104545
+ "winner": "model_a",
104546
+ "judge": "arena_user_10.16.38.136",
104547
+ "anony": true,
104548
+ "tstamp": 1730323964.8336
104549
+ },
104550
+ {
104551
+ "model_a_conv_id": "ee90f88669f44086b8335a37375eb952",
104552
+ "model_b_conv_id": "e0f6c6a3559b40819d1a2b5fb09638af",
104553
+ "inputs": {
104554
+ "prompt": "photorealistic gemstone skull"
104555
+ },
104556
+ "model_a": "PixArtAlpha",
104557
+ "model_b": "SDXL-Lightning",
104558
+ "vote_type": "leftvote",
104559
+ "winner": "model_a",
104560
+ "judge": "arena_user_10.16.38.196",
104561
+ "anony": true,
104562
+ "tstamp": 1730323978.5086
104563
+ },
104564
+ {
104565
+ "model_a_conv_id": "bc2dec11bb184ae6ae21361f66cbf006",
104566
+ "model_b_conv_id": "8ed60bf8801d4acd8f663a92a9e5d6a3",
104567
+ "inputs": {
104568
+ "prompt": "a photograph of a futuristic street scene, brutalist style, straight edges, finely detailed oil painting, impasto brush strokes, soft light, 8 k, dramatic composition, dramatic lighting, sharp focus, octane render, masterpiece, by adrian ghenie and jenny saville and zhang jingna "
104569
+ },
104570
+ "model_a": "AuraFlow",
104571
+ "model_b": "PixArtAlpha",
104572
+ "vote_type": "leftvote",
104573
+ "winner": "model_a",
104574
+ "judge": "arena_user_10.16.38.136",
104575
+ "anony": true,
104576
+ "tstamp": 1730324025.0586
104577
+ },
104578
+ {
104579
+ "model_a_conv_id": "db2bb579336349e0a7f25eddc0d89c86",
104580
+ "model_b_conv_id": "618675c3026349729d07a54d499ad2b8",
104581
+ "inputs": {
104582
+ "prompt": "A blue and white cat next to a blanket and shelf with grey bottle ."
104583
+ },
104584
+ "model_a": "PlayGround V2.5",
104585
+ "model_b": "SDXLTurbo",
104586
+ "vote_type": "bothbad_vote",
104587
+ "winner": "tie (bothbad)",
104588
+ "judge": "arena_user_10.16.13.73",
104589
+ "anony": true,
104590
+ "tstamp": 1730324054.9288
104591
+ },
104592
+ {
104593
+ "model_a_conv_id": "93ec63b0e5c94b6cbd98810c325e3139",
104594
+ "model_b_conv_id": "5816065ce1a541e4a8a0c2dd703f496d",
104595
+ "inputs": {
104596
+ "prompt": "abstract watercolor painting of roman god monument, in stone and marble, magical and traditional, cinematic light, national romanticism by anders zorn "
104597
+ },
104598
+ "model_a": "SDXL-Lightning",
104599
+ "model_b": "Kolors",
104600
+ "vote_type": "rightvote",
104601
+ "winner": "model_b",
104602
+ "judge": "arena_user_10.16.31.254",
104603
+ "anony": true,
104604
+ "tstamp": 1730324086.275
104605
+ },
104606
+ {
104607
+ "model_a_conv_id": "7202c51f3f4e4fe0be6b157fd1b15de5",
104608
+ "model_b_conv_id": "fac342be9d914b529896881562f50af7",
104609
+ "inputs": {
104610
+ "prompt": "photorealistic futuristic black and white mech sitting in a factory at night, heavy rain, giant metal cables, cinematic"
104611
+ },
104612
+ "model_a": "FLUX.1-schnell",
104613
+ "model_b": "SDXL-Lightning",
104614
+ "vote_type": "rightvote",
104615
+ "winner": "model_b",
104616
+ "judge": "arena_user_10.16.13.73",
104617
+ "anony": true,
104618
+ "tstamp": 1730324129.9769
104619
+ },
104620
+ {
104621
+ "model_a_conv_id": "b39dac74853844dea3472fb89e08ffbd",
104622
+ "model_b_conv_id": "2ffdf10a970549d088b87c967c44a310",
104623
+ "inputs": {
104624
+ "prompt": "Rbefraigerator."
104625
+ },
104626
+ "model_a": "StableCascade",
104627
+ "model_b": "PixArtSigma",
104628
+ "vote_type": "bothbad_vote",
104629
+ "winner": "tie (bothbad)",
104630
+ "judge": "arena_user_10.16.19.51",
104631
+ "anony": true,
104632
+ "tstamp": 1730324150.1862
104633
+ },
104634
+ {
104635
+ "model_a_conv_id": "de83e58ced174eaf8c7faef85a5da9a8",
104636
+ "model_b_conv_id": "a6cec35adf484eb48b9f8e5b1a17647f",
104637
+ "inputs": {
104638
+ "prompt": "A grocery store refrigerator has pint cartons of milk on the top shelf, quart cartons on the middle shelf, and gallon plastic jugs on the bottom shelf."
104639
+ },
104640
+ "model_a": "HunyuanDiT",
104641
+ "model_b": "SD3",
104642
+ "vote_type": "leftvote",
104643
+ "winner": "model_a",
104644
+ "judge": "arena_user_10.16.31.254",
104645
+ "anony": true,
104646
+ "tstamp": 1730324175.1944
104647
+ },
104648
+ {
104649
+ "model_a_conv_id": "263b912e046a409e851f1943157c6e0c",
104650
+ "model_b_conv_id": "5b28532eead04a8681f7dff499d7462a",
104651
+ "inputs": {
104652
+ "prompt": "photorealistic render of city exterior shot"
104653
+ },
104654
+ "model_a": "SD3",
104655
+ "model_b": "HunyuanDiT",
104656
+ "vote_type": "leftvote",
104657
+ "winner": "model_a",
104658
+ "judge": "arena_user_10.16.13.73",
104659
+ "anony": true,
104660
+ "tstamp": 1730324185.4816
104661
+ },
104662
+ {
104663
+ "model_a_conv_id": "1b5d0d854c8240b5939a49dfdbb3164c",
104664
+ "model_b_conv_id": "45112819c6124d458b3ea838dec7a1f9",
104665
+ "inputs": {
104666
+ "prompt": "photorealistic render of Eiffel Tower in Paris in the summer"
104667
+ },
104668
+ "model_a": "SDXLTurbo",
104669
+ "model_b": "SDXL",
104670
+ "vote_type": "rightvote",
104671
+ "winner": "model_b",
104672
+ "judge": "arena_user_10.16.31.254",
104673
+ "anony": true,
104674
+ "tstamp": 1730324265.1978
104675
+ },
104676
+ {
104677
+ "model_a_conv_id": "32aa3e4068be411b97d304cc3809b040",
104678
+ "model_b_conv_id": "f00e087492e14713aa4bc46652f6edd7",
104679
+ "inputs": {
104680
+ "prompt": "image of woman on a bicycle climbing mountains surrounded by sunset, photorealistic, high detail, cinematic, epic, photorealistic, 8k"
104681
+ },
104682
+ "model_a": "Kolors",
104683
+ "model_b": "SDXLTurbo",
104684
+ "vote_type": "leftvote",
104685
+ "winner": "model_a",
104686
+ "judge": "arena_user_10.16.16.234",
104687
+ "anony": true,
104688
+ "tstamp": 1730324280.7732
104689
+ },
104690
+ {
104691
+ "model_a_conv_id": "18e6a0ef68904b468bc82b6bfe40877b",
104692
+ "model_b_conv_id": "f90cd2b5fa914640b4f92c0e821f8315",
104693
+ "inputs": {
104694
+ "prompt": "One cat and two dogs sitting on the grass."
104695
+ },
104696
+ "model_a": "SDXLTurbo",
104697
+ "model_b": "SD3",
104698
+ "vote_type": "leftvote",
104699
+ "winner": "model_a",
104700
+ "judge": "arena_user_10.16.19.51",
104701
+ "anony": true,
104702
+ "tstamp": 1730324289.5512
104703
+ },
104704
+ {
104705
+ "model_a_conv_id": "bff456447fe94bd89c7ebf04bce31cc2",
104706
+ "model_b_conv_id": "c27a39645b3749cf8def8ff85c64ab7a",
104707
+ "inputs": {
104708
+ "prompt": "A train on top of a surfboard."
104709
+ },
104710
+ "model_a": "SDXL",
104711
+ "model_b": "StableCascade",
104712
+ "vote_type": "rightvote",
104713
+ "winner": "model_b",
104714
+ "judge": "arena_user_10.16.19.51",
104715
+ "anony": true,
104716
+ "tstamp": 1730324300.4989
104717
+ },
104718
+ {
104719
+ "model_a_conv_id": "4522d17616a14924913d68babe45530c",
104720
+ "model_b_conv_id": "e70b653a0fe44568bac42dc063beda42",
104721
+ "inputs": {
104722
+ "prompt": "a beautiful photorealistic anime illustration of urbex industrial architecture city architecture unfinished building abandoned post office by renzo piano, laser extraterrestial sunset lake vaporwave elysian at night reclaimed by nature magic realism myst wilderness, archdaily, wallpaper, highly detailed, trending on artstation. "
104723
+ },
104724
+ "model_a": "PlayGround V2.5",
104725
+ "model_b": "SD3",
104726
+ "vote_type": "leftvote",
104727
+ "winner": "model_a",
104728
+ "judge": "arena_user_10.16.38.196",
104729
+ "anony": true,
104730
+ "tstamp": 1730324338.4644
104731
+ },
104732
+ {
104733
+ "model_a_conv_id": "1fe967115e4447cb84b54399c52dec9c",
104734
+ "model_b_conv_id": "8a380a34e67d45c399cac751a0edc9a2",
104735
+ "inputs": {
104736
+ "prompt": "A pink scooter with a black seat next to a blue car."
104737
+ },
104738
+ "model_a": "SDXL-Lightning",
104739
+ "model_b": "OpenJourney",
104740
+ "vote_type": "leftvote",
104741
+ "winner": "model_a",
104742
+ "judge": "arena_user_10.16.38.136",
104743
+ "anony": true,
104744
+ "tstamp": 1730324356.217
104745
+ },
104746
+ {
104747
+ "model_a_conv_id": "2b04b8b475414d08a9db3b1bb9e0d09c",
104748
+ "model_b_conv_id": "cec5b515599a4a6cb734a57dd8541e84",
104749
+ "inputs": {
104750
+ "prompt": "A pizza on the right of a suitcase."
104751
+ },
104752
+ "model_a": "FLUX.1-dev",
104753
+ "model_b": "Kolors",
104754
+ "vote_type": "leftvote",
104755
+ "winner": "model_a",
104756
+ "judge": "arena_user_10.16.31.254",
104757
+ "anony": true,
104758
+ "tstamp": 1730324368.2291
104759
+ },
104760
+ {
104761
+ "model_a_conv_id": "a96aa645bbeb432d8f651409596ffe8f",
104762
+ "model_b_conv_id": "88053ed6678341119afe1c2aa77cd579",
104763
+ "inputs": {
104764
+ "prompt": "An emoji of a baby panda wearing a red hat, green gloves, red shirt, and green pants."
104765
+ },
104766
+ "model_a": "PixArtAlpha",
104767
+ "model_b": "OpenJourney",
104768
+ "vote_type": "bothbad_vote",
104769
+ "winner": "tie (bothbad)",
104770
+ "judge": "arena_user_10.16.13.73",
104771
+ "anony": true,
104772
+ "tstamp": 1730324379.0827
104773
+ },
104774
+ {
104775
+ "model_a_conv_id": "b346083fbf7b42d49969830611634a37",
104776
+ "model_b_conv_id": "33ec02d5ad6f425db69e84b93ca178c3",
104777
+ "inputs": {
104778
+ "prompt": "A ldarge keybord msical instroument lwith a woden case enmclosig a qsouvnkboajrd and mfgtal strivgf, which are strucrk b hammrs when the nels are depresdsmed.f lhe strsingsj' vibration ie stopped by damperds when the keys re released and can bce regulavewdd for lengh and vnolume y two or three pedalvs."
104779
+ },
104780
+ "model_a": "SDXL-Lightning",
104781
+ "model_b": "PixArtSigma",
104782
+ "vote_type": "rightvote",
104783
+ "winner": "model_b",
104784
+ "judge": "arena_user_10.16.13.73",
104785
+ "anony": true,
104786
+ "tstamp": 1730324396.6298
104787
+ },
104788
+ {
104789
+ "model_a_conv_id": "6564345c2ae540efb3d53bb06886b431",
104790
+ "model_b_conv_id": "1e78c04438c741c9a2d97e2b184977e3",
104791
+ "inputs": {
104792
+ "prompt": "photorealistic, detailed picture of a single flower crown"
104793
+ },
104794
+ "model_a": "StableCascade",
104795
+ "model_b": "SDXL",
104796
+ "vote_type": "leftvote",
104797
+ "winner": "model_a",
104798
+ "judge": "arena_user_10.16.19.51",
104799
+ "anony": true,
104800
+ "tstamp": 1730324404.4063
104801
+ },
104802
+ {
104803
+ "model_a_conv_id": "e8c53edd567c4871877eb1abecf9a028",
104804
+ "model_b_conv_id": "08b47590f47946c7a4ae05c6901f55a6",
104805
+ "inputs": {
104806
+ "prompt": "A horse riding an astronaut."
104807
+ },
104808
+ "model_a": "FLUX.1-dev",
104809
+ "model_b": "OpenJourney",
104810
+ "vote_type": "bothbad_vote",
104811
+ "winner": "tie (bothbad)",
104812
+ "judge": "arena_user_10.16.19.51",
104813
+ "anony": true,
104814
+ "tstamp": 1730324416.0725
104815
+ },
104816
+ {
104817
+ "model_a_conv_id": "dcaaab7a903a46d3bdc301f34134208a",
104818
+ "model_b_conv_id": "8dd52c5a712f4ee5a34ee6fe2de0201a",
104819
+ "inputs": {
104820
+ "prompt": "Motorcyclis in blue white and red clothing with matching colored motorcycle ."
104821
+ },
104822
+ "model_a": "PixArtAlpha",
104823
+ "model_b": "AuraFlow",
104824
+ "vote_type": "rightvote",
104825
+ "winner": "model_b",
104826
+ "judge": "arena_user_10.16.19.51",
104827
+ "anony": true,
104828
+ "tstamp": 1730324430.2533
104829
+ },
104830
+ {
104831
+ "model_a_conv_id": "f9426e02a17b4e2aa858d068e14ab038",
104832
+ "model_b_conv_id": "e76f732c290c428cb66621c5d2f7f176",
104833
+ "inputs": {
104834
+ "prompt": "A maglev train going vertically downward in high speed, New York Times photojournalism."
104835
+ },
104836
+ "model_a": "HunyuanDiT",
104837
+ "model_b": "FLUX.1-schnell",
104838
+ "vote_type": "rightvote",
104839
+ "winner": "model_b",
104840
+ "judge": "arena_user_10.16.13.73",
104841
+ "anony": true,
104842
+ "tstamp": 1730324445.6854
104843
+ },
104844
+ {
104845
+ "model_a_conv_id": "5aacbf7bcf7a4723b9b8fe65d518c5aa",
104846
+ "model_b_conv_id": "e3e205f5a8094539a65bc4587411d322",
104847
+ "inputs": {
104848
+ "prompt": "average man mugshot photo "
104849
+ },
104850
+ "model_a": "OpenJourney",
104851
+ "model_b": "PixArtAlpha",
104852
+ "vote_type": "tievote",
104853
+ "winner": "tie",
104854
+ "judge": "arena_user_10.16.13.73",
104855
+ "anony": true,
104856
+ "tstamp": 1730324461.9264
104857
+ },
104858
+ {
104859
+ "model_a_conv_id": "6087c2a6e3ef4ff1a7ea4757c74eb6f1",
104860
+ "model_b_conv_id": "98ad3ef65ae44973b98c0c732018a221",
104861
+ "inputs": {
104862
+ "prompt": "A woman in a red t-shirt and shorts holds on to a tennis racket and on the other side of the net a man in black and white also holds up a tennis racket."
104863
+ },
104864
+ "model_a": "Kolors",
104865
+ "model_b": "HunyuanDiT",
104866
+ "vote_type": "tievote",
104867
+ "winner": "tie",
104868
+ "judge": "arena_user_10.16.38.136",
104869
+ "anony": true,
104870
+ "tstamp": 1730324485.377
104871
+ },
104872
+ {
104873
+ "model_a_conv_id": "f4a1ad2d83b549d5b09abf666efc8cac",
104874
+ "model_b_conv_id": "cce6419fd2374557bc971e747a3574ac",
104875
+ "inputs": {
104876
+ "prompt": "Four cars on the street."
104877
+ },
104878
+ "model_a": "SDXL-Lightning",
104879
+ "model_b": "PixArtAlpha",
104880
+ "vote_type": "leftvote",
104881
+ "winner": "model_a",
104882
+ "judge": "arena_user_10.16.38.136",
104883
+ "anony": true,
104884
+ "tstamp": 1730324497.1309
104885
+ },
104886
+ {
104887
+ "model_a_conv_id": "c8c469fddcb54455acbde522d9fe4a6a",
104888
+ "model_b_conv_id": "7cb9ad191c8d4de6b8e99645d38e79dd",
104889
+ "inputs": {
104890
+ "prompt": "image of man watching computer screen"
104891
+ },
104892
+ "model_a": "SDXLTurbo",
104893
+ "model_b": "HunyuanDiT",
104894
+ "vote_type": "tievote",
104895
+ "winner": "tie",
104896
+ "judge": "arena_user_10.16.38.136",
104897
+ "anony": true,
104898
+ "tstamp": 1730324522.9639
104899
+ },
104900
+ {
104901
+ "model_a_conv_id": "373c6aacda03407a8a715a31c70d4b1f",
104902
+ "model_b_conv_id": "1b92e81f5d9046229428272ca59eb7da",
104903
+ "inputs": {
104904
+ "prompt": "A grocery store refrigerator has pint cartons of milk on the top shelf, quart cartons on the middle shelf, and gallon plastic jugs on the bottom shelf."
104905
+ },
104906
+ "model_a": "SDXLTurbo",
104907
+ "model_b": "StableCascade",
104908
+ "vote_type": "rightvote",
104909
+ "winner": "model_b",
104910
+ "judge": "arena_user_10.16.38.136",
104911
+ "anony": true,
104912
+ "tstamp": 1730324540.2185
104913
+ },
104914
+ {
104915
+ "model_a_conv_id": "4057b0ad72ef4cb0b2479f484e2f0826",
104916
+ "model_b_conv_id": "0340c9c1215b42a4a5400b73b9f50f61",
104917
+ "inputs": {
104918
+ "prompt": "photo cartoon bd illustration comic manga painting of cloakroom environement : 5 fantasy environement, digital painting : 1 fat brush concept sketch artist bd enki bilal : 1 0 "
104919
+ },
104920
+ "model_a": "SDXLTurbo",
104921
+ "model_b": "StableCascade",
104922
+ "vote_type": "leftvote",
104923
+ "winner": "model_a",
104924
+ "judge": "arena_user_10.16.38.136",
104925
+ "anony": true,
104926
+ "tstamp": 1730324560.1756
104927
+ },
104928
+ {
104929
+ "model_a_conv_id": "add2594d8fa24a858bbc2aed877de3a1",
104930
+ "model_b_conv_id": "976a67a7b31c47a3ac82477c2a1f4192",
104931
+ "inputs": {
104932
+ "prompt": "hyperrealism woman wearing a black robe holding a can of beer"
104933
+ },
104934
+ "model_a": "PlayGround V2.5",
104935
+ "model_b": "HunyuanDiT",
104936
+ "vote_type": "rightvote",
104937
+ "winner": "model_b",
104938
+ "judge": "arena_user_10.16.31.254",
104939
+ "anony": true,
104940
+ "tstamp": 1730324574.191
104941
+ },
104942
+ {
104943
+ "model_a_conv_id": "c72d01e7eb3d4b77b1d94bd47d202a2c",
104944
+ "model_b_conv_id": "d94c93225ffb4aeb97069619cdfb9047",
104945
+ "inputs": {
104946
+ "prompt": "A couple of glasses are sitting on a table."
104947
+ },
104948
+ "model_a": "PlayGround V2.5",
104949
+ "model_b": "HunyuanDiT",
104950
+ "vote_type": "tievote",
104951
+ "winner": "tie",
104952
+ "judge": "arena_user_10.16.13.73",
104953
+ "anony": true,
104954
+ "tstamp": 1730324590.903
104955
+ },
104956
+ {
104957
+ "model_a_conv_id": "4d8c836d9d55459d9eca72b413e65e34",
104958
+ "model_b_conv_id": "662139c11f494773839c1da5309b59c1",
104959
+ "inputs": {
104960
+ "prompt": "A clean bathroom with pink walls and white appliances."
104961
+ },
104962
+ "model_a": "FLUX.1-dev",
104963
+ "model_b": "FLUX.1-schnell",
104964
+ "vote_type": "leftvote",
104965
+ "winner": "model_a",
104966
+ "judge": "arena_user_10.16.31.254",
104967
+ "anony": true,
104968
+ "tstamp": 1730324609.4707
104969
+ },
104970
+ {
104971
+ "model_a_conv_id": "378774fd58034916b5bbc3ca1ba2dca0",
104972
+ "model_b_conv_id": "2bfb05246c4b4275b5c4eeadd20d822d",
104973
+ "inputs": {
104974
+ "prompt": "image of a cat holding up a bird on a wall. 8k, photoreal, sharp details, soft light."
104975
+ },
104976
+ "model_a": "StableCascade",
104977
+ "model_b": "Kolors",
104978
+ "vote_type": "rightvote",
104979
+ "winner": "model_b",
104980
+ "judge": "arena_user_10.16.19.51",
104981
+ "anony": true,
104982
+ "tstamp": 1730324623.5622
104983
+ },
104984
+ {
104985
+ "model_a_conv_id": "de13be29ed1d4273a6bf4dc716e4070a",
104986
+ "model_b_conv_id": "1d6accc7d24e47e38d1e3bece95012d6",
104987
+ "inputs": {
104988
+ "prompt": "hyperrealism backstreet, in front of a massive building, cinematic, neon signs, high resolution, realistic lighting, octane render, hyper realistic, 8k"
104989
+ },
104990
+ "model_a": "Kolors",
104991
+ "model_b": "SD3",
104992
+ "vote_type": "rightvote",
104993
+ "winner": "model_b",
104994
+ "judge": "arena_user_10.16.38.136",
104995
+ "anony": true,
104996
+ "tstamp": 1730324643.2716
104997
+ },
104998
+ {
104999
+ "model_a_conv_id": "08762126ceaf4912a3db657220776b52",
105000
+ "model_b_conv_id": "76e972d73d1d451f840cb7062dcb606b",
105001
+ "inputs": {
105002
+ "prompt": "New York Skyline with 'Diffusion' written with fireworks on the sky."
105003
+ },
105004
+ "model_a": "SDXLTurbo",
105005
+ "model_b": "PixArtSigma",
105006
+ "vote_type": "bothbad_vote",
105007
+ "winner": "tie (bothbad)",
105008
+ "judge": "arena_user_10.16.13.73",
105009
+ "anony": true,
105010
+ "tstamp": 1730324669.48
105011
+ },
105012
+ {
105013
+ "model_a_conv_id": "8b1f66f97c794b1e831a05b54cd651b0",
105014
+ "model_b_conv_id": "a6395920630643c19d973c0cb9f76864",
105015
+ "inputs": {
105016
+ "prompt": "One cat and two dogs sitting on the grass."
105017
+ },
105018
+ "model_a": "OpenJourney",
105019
+ "model_b": "PixArtAlpha",
105020
+ "vote_type": "rightvote",
105021
+ "winner": "model_b",
105022
+ "judge": "arena_user_10.16.16.234",
105023
+ "anony": true,
105024
+ "tstamp": 1730324679.7722
105025
+ },
105026
+ {
105027
+ "model_a_conv_id": "486a036cea574bd5958b8a2e035dd212",
105028
+ "model_b_conv_id": "729693cc104e4bbbb9d3e2e3e88dd046",
105029
+ "inputs": {
105030
+ "prompt": "hyperrealism, man and woman, together, made of clay"
105031
+ },
105032
+ "model_a": "AuraFlow",
105033
+ "model_b": "FLUX.1-schnell",
105034
+ "vote_type": "leftvote",
105035
+ "winner": "model_a",
105036
+ "judge": "arena_user_10.16.38.136",
105037
+ "anony": true,
105038
+ "tstamp": 1730324689.7187
105039
+ },
105040
+ {
105041
+ "model_a_conv_id": "344af269375f47c8bb31a62d7e68cd3b",
105042
+ "model_b_conv_id": "27d4b3b0d57d45b2b8d704c76a5c55ec",
105043
+ "inputs": {
105044
+ "prompt": "New York Skyline with 'NeurIPS' written with fireworks on the sky."
105045
+ },
105046
+ "model_a": "Kolors",
105047
+ "model_b": "StableCascade",
105048
+ "vote_type": "rightvote",
105049
+ "winner": "model_b",
105050
+ "judge": "arena_user_10.16.38.196",
105051
+ "anony": true,
105052
+ "tstamp": 1730324713.6504
105053
+ },
105054
+ {
105055
+ "model_a_conv_id": "7e5c276a65fc4b9ebc95f5d3c495c4ad",
105056
+ "model_b_conv_id": "1290feb59f5042f38244a1ac355e987b",
105057
+ "inputs": {
105058
+ "prompt": "Three cats and one dog sitting on the grass."
105059
+ },
105060
+ "model_a": "OpenJourney",
105061
+ "model_b": "FLUX.1-schnell",
105062
+ "vote_type": "rightvote",
105063
+ "winner": "model_b",
105064
+ "judge": "arena_user_10.16.13.73",
105065
+ "anony": true,
105066
+ "tstamp": 1730324748.838
105067
+ },
105068
+ {
105069
+ "model_a_conv_id": "e2f896c61ac24efb897bcafc78ddc63e",
105070
+ "model_b_conv_id": "2bf9f701fcfc423092ecbdd6a75157b2",
105071
+ "inputs": {
105072
+ "prompt": "photorealistic gemstone skull"
105073
+ },
105074
+ "model_a": "PixArtSigma",
105075
+ "model_b": "SDXL",
105076
+ "vote_type": "leftvote",
105077
+ "winner": "model_a",
105078
+ "judge": "arena_user_10.16.19.51",
105079
+ "anony": true,
105080
+ "tstamp": 1730324762.2088
105081
+ },
105082
+ {
105083
+ "model_a_conv_id": "2f14a155ba304c66a2d5e870f65a5cc2",
105084
+ "model_b_conv_id": "e5a277b2eac143278778df8dd05dc5f2",
105085
+ "inputs": {
105086
+ "prompt": "A baseball player in a blue and white uniform is next to a player in black and white ."
105087
+ },
105088
+ "model_a": "FLUX.1-dev",
105089
+ "model_b": "Kolors",
105090
+ "vote_type": "leftvote",
105091
+ "winner": "model_a",
105092
+ "judge": "arena_user_10.16.13.73",
105093
+ "anony": true,
105094
+ "tstamp": 1730324922.4886
105095
+ },
105096
+ {
105097
+ "model_a_conv_id": "a734658056f94c8f8425e7a8a4d40e14",
105098
+ "model_b_conv_id": "96c6299f53d74a8b83589f3be08f5334",
105099
+ "inputs": {
105100
+ "prompt": "photorealistic, detailed picture of a single flower crown"
105101
+ },
105102
+ "model_a": "Kolors",
105103
+ "model_b": "SDXL-Lightning",
105104
+ "vote_type": "bothbad_vote",
105105
+ "winner": "tie (bothbad)",
105106
+ "judge": "arena_user_10.16.13.73",
105107
+ "anony": true,
105108
+ "tstamp": 1730324939.5886
105109
+ },
105110
+ {
105111
+ "model_a_conv_id": "cad4c18dac64470baeb6906f219fc5ff",
105112
+ "model_b_conv_id": "06c441f2a42246bf95f035132c3f02d0",
105113
+ "inputs": {
105114
+ "prompt": "a black and white cat sitting on a brown suitcase next to a wall"
105115
+ },
105116
+ "model_a": "PixArtAlpha",
105117
+ "model_b": "PixArtSigma",
105118
+ "vote_type": "rightvote",
105119
+ "winner": "model_b",
105120
+ "judge": "arena_user_10.16.16.234",
105121
+ "anony": true,
105122
+ "tstamp": 1730324952.0021
105123
+ },
105124
+ {
105125
+ "model_a_conv_id": "dc06eafaa3b14cb893176bdb80c21e32",
105126
+ "model_b_conv_id": "07339b1b35a74bf9b8f269f7f1e7b9f2",
105127
+ "inputs": {
105128
+ "prompt": "photograph of a person drinking red wine and smoking weed with a flat cigarette"
105129
+ },
105130
+ "model_a": "FLUX.1-dev",
105131
+ "model_b": "HunyuanDiT",
105132
+ "vote_type": "rightvote",
105133
+ "winner": "model_b",
105134
+ "judge": "arena_user_10.16.13.73",
105135
+ "anony": true,
105136
+ "tstamp": 1730324978.3667
105137
+ },
105138
+ {
105139
+ "model_a_conv_id": "766e69bfcd00450d844a8a57a5d6464b",
105140
+ "model_b_conv_id": "55c4cb7db46b4a1ca47122d54319fe34",
105141
+ "inputs": {
105142
+ "prompt": "An orange colored sandwich."
105143
+ },
105144
+ "model_a": "SDXL-Lightning",
105145
+ "model_b": "PlayGround V2.5",
105146
+ "vote_type": "bothbad_vote",
105147
+ "winner": "tie (bothbad)",
105148
+ "judge": "arena_user_10.16.38.196",
105149
+ "anony": true,
105150
+ "tstamp": 1730325010.0367
105151
+ },
105152
+ {
105153
+ "model_a_conv_id": "24a7cc0a3d7a4466a3d7d40e806e84b6",
105154
+ "model_b_conv_id": "74ab73b247474089bbe7ecfb1775ce6d",
105155
+ "inputs": {
105156
+ "prompt": "Two cars on the street."
105157
+ },
105158
+ "model_a": "SD3",
105159
+ "model_b": "PlayGround V2.5",
105160
+ "vote_type": "leftvote",
105161
+ "winner": "model_a",
105162
+ "judge": "arena_user_10.16.31.254",
105163
+ "anony": true,
105164
+ "tstamp": 1730325082.1428
105165
+ },
105166
+ {
105167
+ "model_a_conv_id": "a44aab0e029343b7b30b24651e25458e",
105168
+ "model_b_conv_id": "5d709bb4343346459cc9debdb415a724",
105169
+ "inputs": {
105170
+ "prompt": "A storefront with 'Google Brain Toronto' written on it."
105171
+ },
105172
+ "model_a": "FLUX.1-dev",
105173
+ "model_b": "FLUX.1-schnell",
105174
+ "vote_type": "bothbad_vote",
105175
+ "winner": "tie (bothbad)",
105176
+ "judge": "arena_user_10.16.31.254",
105177
+ "anony": true,
105178
+ "tstamp": 1730325099.9946
105179
+ },
105180
+ {
105181
+ "model_a_conv_id": "249d581d56bf4c60ac51aed90cfebc12",
105182
+ "model_b_conv_id": "4a5c91c165a54d0c97680adcd2623a78",
105183
+ "inputs": {
105184
+ "prompt": "image of a white wooden sphere floating in water"
105185
+ },
105186
+ "model_a": "Kolors",
105187
+ "model_b": "PixArtAlpha",
105188
+ "vote_type": "rightvote",
105189
+ "winner": "model_b",
105190
+ "judge": "arena_user_10.16.38.196",
105191
+ "anony": true,
105192
+ "tstamp": 1730325133.3175
105193
+ },
105194
+ {
105195
+ "model_a_conv_id": "71d92344f31b46ae8f31cda78ac4e0a6",
105196
+ "model_b_conv_id": "45e84573cead4f1f9cc13afc2c350c31",
105197
+ "inputs": {
105198
+ "prompt": "A yellow flower sticking out of a green pot."
105199
+ },
105200
+ "model_a": "SD3",
105201
+ "model_b": "SDXL",
105202
+ "vote_type": "leftvote",
105203
+ "winner": "model_a",
105204
+ "judge": "arena_user_10.16.38.196",
105205
+ "anony": true,
105206
+ "tstamp": 1730325141.7548
105207
+ },
105208
+ {
105209
+ "model_a_conv_id": "160b99dd2e09496bb7e0324e6703fbf4",
105210
+ "model_b_conv_id": "c836781e57ce4d1885b86eb0dea52cfe",
105211
+ "inputs": {
105212
+ "prompt": "a snow skier in red pants is laying down and people"
105213
+ },
105214
+ "model_a": "StableCascade",
105215
+ "model_b": "PixArtSigma",
105216
+ "vote_type": "rightvote",
105217
+ "winner": "model_b",
105218
+ "judge": "arena_user_10.16.38.196",
105219
+ "anony": true,
105220
+ "tstamp": 1730325153.5205
105221
+ },
105222
+ {
105223
+ "model_a_conv_id": "b78d39f15e97488b9cd303b900584f40",
105224
+ "model_b_conv_id": "72f247dc38df4fc294dd19c56d6f3f0d",
105225
+ "inputs": {
105226
+ "prompt": "photorealistic photo of an old man in front of the wall at night with a flash light on him"
105227
+ },
105228
+ "model_a": "PixArtSigma",
105229
+ "model_b": "FLUX.1-schnell",
105230
+ "vote_type": "rightvote",
105231
+ "winner": "model_b",
105232
+ "judge": "arena_user_10.16.13.73",
105233
+ "anony": true,
105234
+ "tstamp": 1730344906.8507
105235
+ },
105236
+ {
105237
+ "model_a_conv_id": "f60e9452597e4b3c912a52dd665df0e4",
105238
+ "model_b_conv_id": "5751488d93eb44bcb9a89757a69773fc",
105239
+ "inputs": {
105240
+ "prompt": "photograph of man on a bicycle holding a newspaper"
105241
+ },
105242
+ "model_a": "Kolors",
105243
+ "model_b": "SDXL",
105244
+ "vote_type": "rightvote",
105245
+ "winner": "model_b",
105246
+ "judge": "arena_user_10.16.16.234",
105247
+ "anony": true,
105248
+ "tstamp": 1730386387.568
105249
+ },
105250
+ {
105251
+ "model_a_conv_id": "d93151f644a84b9592d947c3630661a1",
105252
+ "model_b_conv_id": "2dafd1040a0c42d18b27ee3318132224",
105253
+ "inputs": {
105254
+ "prompt": "hyperrealism, man and woman, together, made of clay"
105255
+ },
105256
+ "model_a": "FLUX.1-dev",
105257
+ "model_b": "StableCascade",
105258
+ "vote_type": "rightvote",
105259
+ "winner": "model_b",
105260
+ "judge": "arena_user_10.16.16.234",
105261
+ "anony": true,
105262
+ "tstamp": 1730386425.2457
105263
  }
105264
  ]
arena_elo/results/latest/clean_battle_video_generation.json CHANGED
@@ -29426,5 +29426,47 @@
29426
  "judge": "arena_user_10.16.11.200",
29427
  "anony": true,
29428
  "tstamp": 1729479446.1849
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29429
  }
29430
  ]
 
29426
  "judge": "arena_user_10.16.11.200",
29427
  "anony": true,
29428
  "tstamp": 1729479446.1849
29429
+ },
29430
+ {
29431
+ "model_a_conv_id": "0f6c651f5fb7494c9a6ac6be505d2cdb",
29432
+ "model_b_conv_id": "d2e4dbfa292d4bbaa3f94f7bea41fc1a",
29433
+ "inputs": {
29434
+ "prompt": "a motorcycle gliding through a snowy field"
29435
+ },
29436
+ "model_a": "CogVideoX-2B",
29437
+ "model_b": "OpenSora v1.2",
29438
+ "vote_type": "leftvote",
29439
+ "winner": "model_a",
29440
+ "judge": "arena_user_10.16.13.73",
29441
+ "anony": true,
29442
+ "tstamp": 1730318539.1978
29443
+ },
29444
+ {
29445
+ "model_a_conv_id": "b5ee94817cd246dcb180eb3ceb973975",
29446
+ "model_b_conv_id": "882069179cd940019ec63e803aaab5f8",
29447
+ "inputs": {
29448
+ "prompt": "highway"
29449
+ },
29450
+ "model_a": "Pyramid Flow",
29451
+ "model_b": "T2V-Turbo",
29452
+ "vote_type": "leftvote",
29453
+ "winner": "model_a",
29454
+ "judge": "arena_user_10.16.13.73",
29455
+ "anony": true,
29456
+ "tstamp": 1730323274.4045
29457
+ },
29458
+ {
29459
+ "model_a_conv_id": "d4ca058dd6f1457e9c35ee34fa752215",
29460
+ "model_b_conv_id": "1e0e4e33014448d689bf3644f322e77a",
29461
+ "inputs": {
29462
+ "prompt": "Snow rocky mountains peaks canyon. snow blanketed rocky mountains surround and shadow deep canyons. the canyons twist and bend through the high elevated mountain peaks, tilt down"
29463
+ },
29464
+ "model_a": "CogVideoX-2B",
29465
+ "model_b": "AnimateDiff",
29466
+ "vote_type": "bothbad_vote",
29467
+ "winner": "tie (bothbad)",
29468
+ "judge": "arena_user_10.16.38.196",
29469
+ "anony": true,
29470
+ "tstamp": 1730368795.3429
29471
  }
29472
  ]
arena_elo/results/latest/elo_results_t2i_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e6dbf30dcc4e5d2128a6259d7c4dbaa85045227e8654d8d8f8e05db6f6d1050d
3
- size 88244
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0d66bbf8fd0a7551f9fffce11cbfb9788c46ffdf1ba2878d0b628b97f725a89
3
+ size 88245
arena_elo/results/latest/elo_results_video_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aa4e5d2a740bdfdde8fa7f22c4eae0d4d035c16482f74ad53e70ed1a674a9595
3
  size 66388
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6fbb18cb0b1f89985c14f33b2a7248eac7ccc4e32ba9b0588ea5a80da498f56
3
  size 66388
arena_elo/results/latest/t2i_generation_leaderboard.csv CHANGED
@@ -1,18 +1,18 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- PlayGround V2.5,PlayGround V2.5,1122.0514785698945,1124.5788044409376,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
- FLUX.1-dev,FLUX.1-dev,1113.658899615697,1121.3628010715097,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
- FLUX.1-schnell,FLUX.1-schnell,1084.5270381392688,1075.5283965968981,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
- PlayGround V2,PlayGround V2,1071.9665645143411,1071.4364498051534,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
- Kolors,Kolors,1069.465659491141,1066.0709490699753,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
- StableCascade,StableCascade,1038.6928503697377,1041.8278379120613,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
- HunyuanDiT,HunyuanDiT,1029.8147872248524,1022.4369124472969,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
- PixArtAlpha,PixArtAlpha,1020.4828588261801,1012.0590187950751,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
10
- SDXL-Lightning,SDXL-Lightning,1020.2017697561622,1023.7813118704934,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
11
- PixArtSigma,PixArtSigma,1018.977671214026,1019.4115250070787,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
- SD3,SD3,1007.4407007196502,1011.301397734926,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
- AuraFlow,AuraFlow,1002.619175333384,996.8120524291718,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
- SDXL,SDXL,965.0555069496107,966.1038807530625,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
- SDXLTurbo,SDXLTurbo,912.9971867385875,910.9739602893686,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
- LCM(v1.5/XL),LCM(v1.5/XL),904.7354999830732,899.2649744544208,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
- OpenJourney,OpenJourney,828.0578021298603,823.5179655138281,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
- LCM,LCM,789.2545504245293,803.6200315636708,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1121.0745643669302,1123.6350235694122,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ FLUX.1-dev,FLUX.1-dev,1112.2241807320759,1119.5559500908657,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
+ FLUX.1-schnell,FLUX.1-schnell,1082.2731103922747,1073.9762885431956,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1072.1214144850478,1071.5484665742215,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1059.9539217136369,1057.1664270155375,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ StableCascade,StableCascade,1038.9487845822814,1041.9965475503805,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ HunyuanDiT,HunyuanDiT,1031.7535942550423,1024.6390979066982,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
+ SDXL-Lightning,SDXL-Lightning,1020.7989521769452,1024.238620990864,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
+ PixArtSigma,PixArtSigma,1020.7376512332856,1021.0934283829224,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
11
+ PixArtAlpha,PixArtAlpha,1020.0601099154849,1011.7390122427934,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
12
+ SD3,SD3,1009.7355145598503,1013.240057173424,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
+ AuraFlow,AuraFlow,1008.9491584066384,1002.8996921572409,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
+ SDXL,SDXL,965.036605627369,966.1050227348493,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,913.5707123104991,911.4798753683542,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),904.9788318289039,899.4530516710622,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,828.3857697613,823.7930961966599,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,789.3971236524387,803.750355693955,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/latest/video_generation_leaderboard.csv CHANGED
@@ -1,11 +1,11 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- StableVideoDiffusion,StableVideoDiffusion,1148.3820794171259,1151.7427963818589,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
3
- CogVideoX-2B,CogVideoX-2B,1106.301686827736,1099.2753587233874,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
4
- T2V-Turbo,T2V-Turbo,1084.6919870016136,1084.3660971817535,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
5
- VideoCrafter2,VideoCrafter2,1068.3763693538094,1069.4432644318713,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
6
- AnimateDiff,AnimateDiff,1068.2715301806234,1067.6030950537424,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
7
- LaVie,LaVie,995.5007130406643,996.7092808281482,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
8
- OpenSora,OpenSora,911.7864333842111,912.6483929903161,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
9
- OpenSora v1.2,OpenSora v1.2,893.7808906190037,892.3014477987042,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
10
- ModelScope,ModelScope,861.5603931741831,863.6693158205098,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
11
- AnimateDiff Turbo,AnimateDiff Turbo,861.347917001029,862.2409507897083,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ StableVideoDiffusion,StableVideoDiffusion,1148.460154348565,1151.7704400501898,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
3
+ CogVideoX-2B,CogVideoX-2B,1108.0387601702323,1100.9624050762802,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
4
+ T2V-Turbo,T2V-Turbo,1084.8445749400853,1084.4439334390704,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
5
+ VideoCrafter2,VideoCrafter2,1068.3719584391863,1069.4555209780685,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
6
+ AnimateDiff,AnimateDiff,1068.3711452057469,1067.6734797816102,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
7
+ LaVie,LaVie,995.548590974449,996.6831350319302,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
8
+ OpenSora,OpenSora,911.8148704364976,912.6221135748349,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
9
+ OpenSora v1.2,OpenSora v1.2,891.6932550065835,890.4673227621503,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
10
+ ModelScope,ModelScope,861.539714459198,863.7052928883418,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
11
+ AnimateDiff Turbo,AnimateDiff Turbo,861.3169760194565,862.2163564175211,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo