Hugging Face's logo

Spaces:
TIGER-Lab
/
GenAI-Arena
Running on Zero

App Files Community
16
DongfuJiang commited on
Commit
929aabf
·
1 Parent(s): ea1b309

Auto Daily Leaderboard udpate Fri Nov 1 12:00:27 PM EDT 2024

Browse files
Files changed (12) hide show
  1. arena_elo/results/20241101/clean_battle_t2i_generation.json +0 -0
  2. arena_elo/results/20241101/clean_battle_video_generation.json +0 -0
  3. arena_elo/results/20241101/elo_results_t2i_generation.pkl +3 -0
  4. arena_elo/results/20241101/elo_results_video_generation.pkl +3 -0
  5. arena_elo/results/20241101/t2i_generation_leaderboard.csv +18 -0
  6. arena_elo/results/20241101/video_generation_leaderboard.csv +11 -0
  7. arena_elo/results/latest/clean_battle_t2i_generation.json +14 -0
  8. arena_elo/results/latest/clean_battle_video_generation.json +14 -0
  9. arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
  10. arena_elo/results/latest/elo_results_video_generation.pkl +1 -1
  11. arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
  12. arena_elo/results/latest/video_generation_leaderboard.csv +10 -10
arena_elo/results/20241101/clean_battle_t2i_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20241101/clean_battle_video_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20241101/elo_results_t2i_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8691b269e5aededbec4645917b93e4c68a06f1283f04b2cc9bb702a593af2327
3
+ size 88245
arena_elo/results/20241101/elo_results_video_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f193835dc934dcdbab1687d6f9b5bf98833cf2acf87cda5ed8bbc0dbf870ccd
3
+ size 66388
arena_elo/results/20241101/t2i_generation_leaderboard.csv ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1121.2777763754493,1123.6808512989503,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ FLUX.1-dev,FLUX.1-dev,1108.8140308092425,1117.2826665253613,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
+ FLUX.1-schnell,FLUX.1-schnell,1082.0770836960373,1073.9406246831775,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1072.4671661265488,1071.8881000578972,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1059.8771781609214,1057.1883419088608,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ StableCascade,StableCascade,1039.2003139495587,1042.2029492394959,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ HunyuanDiT,HunyuanDiT,1031.863723522995,1024.5088387943795,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
+ SDXL-Lightning,SDXL-Lightning,1021.0622898923584,1024.4229958757069,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
+ PixArtSigma,PixArtSigma,1020.9767104481184,1021.249885313015,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
11
+ PixArtAlpha,PixArtAlpha,1020.3561142601637,1011.9058839440434,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
12
+ SD3,SD3,1009.8169965011929,1013.2007040038147,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
+ AuraFlow,AuraFlow,1008.8481299398044,1002.8528908190062,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
+ SDXL,SDXL,965.6592890377191,966.5251784661953,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,913.8892177788732,911.7279642597668,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),905.316383987775,899.860269306758,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,828.713808199975,824.0969592729339,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,789.7837873132739,804.0232252464251,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/20241101/video_generation_leaderboard.csv ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ StableVideoDiffusion,StableVideoDiffusion,1148.460154348565,1151.7846586717128,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
3
+ CogVideoX-2B,CogVideoX-2B,1108.0387601702323,1101.0036827052015,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
4
+ T2V-Turbo,T2V-Turbo,1084.8445749400853,1084.437159770356,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
5
+ VideoCrafter2,VideoCrafter2,1068.3719584391863,1069.462089791449,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
6
+ AnimateDiff,AnimateDiff,1068.3711452057469,1067.9421230702862,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
7
+ LaVie,LaVie,995.548590974449,996.69540276009,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
8
+ OpenSora,OpenSora,911.8148704364976,912.6072605513557,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
9
+ OpenSora v1.2,OpenSora v1.2,891.6932550065835,890.4485721210827,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
10
+ ModelScope,ModelScope,861.539714459198,863.6676534862149,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
11
+ AnimateDiff Turbo,AnimateDiff Turbo,861.3169760194565,861.9513970722508,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
arena_elo/results/latest/clean_battle_t2i_generation.json CHANGED
@@ -105260,5 +105260,19 @@
105260
  "judge": "arena_user_10.16.16.234",
105261
  "anony": true,
105262
  "tstamp": 1730386425.2457
 
 
 
 
 
 
 
 
 
 
 
 
 
 
105263
  }
105264
  ]
 
105260
  "judge": "arena_user_10.16.16.234",
105261
  "anony": true,
105262
  "tstamp": 1730386425.2457
105263
+ },
105264
+ {
105265
+ "model_a_conv_id": "66286fcc9319436abda8f7a4df75710b",
105266
+ "model_b_conv_id": "92e907e95bc3493e9d9f5946374058fd",
105267
+ "inputs": {
105268
+ "prompt": "beautiful gorgeous elegant porcelain ivory fair skin mechanoid woman, close - up, sharp focus, studio light, iris van herpen haute couture headdress made of rhizomorphs, daisies, arches, brackets, herbs, colorful corals, fractal mushrooms, puffballs, octane render, ultra sharp, 8 k "
105269
+ },
105270
+ "model_a": "SDXL",
105271
+ "model_b": "FLUX.1-dev",
105272
+ "vote_type": "leftvote",
105273
+ "winner": "model_a",
105274
+ "judge": "arena_user_10.16.16.234",
105275
+ "anony": true,
105276
+ "tstamp": 1730463036.6285
105277
  }
105278
  ]
arena_elo/results/latest/clean_battle_video_generation.json CHANGED
@@ -29468,5 +29468,19 @@
29468
  "judge": "arena_user_10.16.38.196",
29469
  "anony": true,
29470
  "tstamp": 1730368795.3429
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29471
  }
29472
  ]
 
29468
  "judge": "arena_user_10.16.38.196",
29469
  "anony": true,
29470
  "tstamp": 1730368795.3429
29471
+ },
29472
+ {
29473
+ "model_a_conv_id": "f1258b8a57db4397b6ce4e11d0b0fb10",
29474
+ "model_b_conv_id": "dc861e355441478d81cec3bf168f42cf",
29475
+ "inputs": {
29476
+ "prompt": "a blue umbrella"
29477
+ },
29478
+ "model_a": "AnimateDiff",
29479
+ "model_b": "AnimateDiff Turbo",
29480
+ "vote_type": "leftvote",
29481
+ "winner": "model_a",
29482
+ "judge": "arena_user_10.16.38.196",
29483
+ "anony": false,
29484
+ "tstamp": 1730449144.7948
29485
  }
29486
  ]
arena_elo/results/latest/elo_results_t2i_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c0d66bbf8fd0a7551f9fffce11cbfb9788c46ffdf1ba2878d0b628b97f725a89
3
  size 88245
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8691b269e5aededbec4645917b93e4c68a06f1283f04b2cc9bb702a593af2327
3
  size 88245
arena_elo/results/latest/elo_results_video_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e6fbb18cb0b1f89985c14f33b2a7248eac7ccc4e32ba9b0588ea5a80da498f56
3
  size 66388
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f193835dc934dcdbab1687d6f9b5bf98833cf2acf87cda5ed8bbc0dbf870ccd
3
  size 66388
arena_elo/results/latest/t2i_generation_leaderboard.csv CHANGED
@@ -1,18 +1,18 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- PlayGround V2.5,PlayGround V2.5,1121.0745643669302,1123.6350235694122,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
- FLUX.1-dev,FLUX.1-dev,1112.2241807320759,1119.5559500908657,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
- FLUX.1-schnell,FLUX.1-schnell,1082.2731103922747,1073.9762885431956,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
- PlayGround V2,PlayGround V2,1072.1214144850478,1071.5484665742215,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
- Kolors,Kolors,1059.9539217136369,1057.1664270155375,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
- StableCascade,StableCascade,1038.9487845822814,1041.9965475503805,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
- HunyuanDiT,HunyuanDiT,1031.7535942550423,1024.6390979066982,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
- SDXL-Lightning,SDXL-Lightning,1020.7989521769452,1024.238620990864,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
- PixArtSigma,PixArtSigma,1020.7376512332856,1021.0934283829224,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
11
- PixArtAlpha,PixArtAlpha,1020.0601099154849,1011.7390122427934,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
12
- SD3,SD3,1009.7355145598503,1013.240057173424,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
- AuraFlow,AuraFlow,1008.9491584066384,1002.8996921572409,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
- SDXL,SDXL,965.036605627369,966.1050227348493,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
- SDXLTurbo,SDXLTurbo,913.5707123104991,911.4798753683542,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
- LCM(v1.5/XL),LCM(v1.5/XL),904.9788318289039,899.4530516710622,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
- OpenJourney,OpenJourney,828.3857697613,823.7930961966599,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
- LCM,LCM,789.3971236524387,803.750355693955,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1121.2777763754493,1123.6808512989503,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ FLUX.1-dev,FLUX.1-dev,1108.8140308092425,1117.2826665253613,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
+ FLUX.1-schnell,FLUX.1-schnell,1082.0770836960373,1073.9406246831775,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1072.4671661265488,1071.8881000578972,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1059.8771781609214,1057.1883419088608,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ StableCascade,StableCascade,1039.2003139495587,1042.2029492394959,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ HunyuanDiT,HunyuanDiT,1031.863723522995,1024.5088387943795,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
+ SDXL-Lightning,SDXL-Lightning,1021.0622898923584,1024.4229958757069,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
+ PixArtSigma,PixArtSigma,1020.9767104481184,1021.249885313015,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
11
+ PixArtAlpha,PixArtAlpha,1020.3561142601637,1011.9058839440434,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
12
+ SD3,SD3,1009.8169965011929,1013.2007040038147,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
+ AuraFlow,AuraFlow,1008.8481299398044,1002.8528908190062,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
+ SDXL,SDXL,965.6592890377191,966.5251784661953,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,913.8892177788732,911.7279642597668,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),905.316383987775,899.860269306758,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,828.713808199975,824.0969592729339,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,789.7837873132739,804.0232252464251,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/latest/video_generation_leaderboard.csv CHANGED
@@ -1,11 +1,11 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- StableVideoDiffusion,StableVideoDiffusion,1148.460154348565,1151.7704400501898,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
3
- CogVideoX-2B,CogVideoX-2B,1108.0387601702323,1100.9624050762802,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
4
- T2V-Turbo,T2V-Turbo,1084.8445749400853,1084.4439334390704,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
5
- VideoCrafter2,VideoCrafter2,1068.3719584391863,1069.4555209780685,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
6
- AnimateDiff,AnimateDiff,1068.3711452057469,1067.6734797816102,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
7
- LaVie,LaVie,995.548590974449,996.6831350319302,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
8
- OpenSora,OpenSora,911.8148704364976,912.6221135748349,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
9
- OpenSora v1.2,OpenSora v1.2,891.6932550065835,890.4673227621503,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
10
- ModelScope,ModelScope,861.539714459198,863.7052928883418,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
11
- AnimateDiff Turbo,AnimateDiff Turbo,861.3169760194565,862.2163564175211,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ StableVideoDiffusion,StableVideoDiffusion,1148.460154348565,1151.7846586717128,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
3
+ CogVideoX-2B,CogVideoX-2B,1108.0387601702323,1101.0036827052015,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
4
+ T2V-Turbo,T2V-Turbo,1084.8445749400853,1084.437159770356,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
5
+ VideoCrafter2,VideoCrafter2,1068.3719584391863,1069.462089791449,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
6
+ AnimateDiff,AnimateDiff,1068.3711452057469,1067.9421230702862,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
7
+ LaVie,LaVie,995.548590974449,996.69540276009,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
8
+ OpenSora,OpenSora,911.8148704364976,912.6072605513557,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
9
+ OpenSora v1.2,OpenSora v1.2,891.6932550065835,890.4485721210827,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
10
+ ModelScope,ModelScope,861.539714459198,863.6676534862149,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
11
+ AnimateDiff Turbo,AnimateDiff Turbo,861.3169760194565,861.9513970722508,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo