Hugging Face's logo

Spaces:
TIGER-Lab
/
GenAI-Arena
Running on Zero

App Files Community
16
DongfuJiang commited on
Commit
4deb581
•
1 Parent(s): fd02d09

Auto Daily Leaderboard udpate Sun Sep 8 12:00:34 PM EDT 2024

Browse files
Files changed (12) hide show
  1. arena_elo/results/20240906/clean_battle_image_editing.json +0 -0
  2. arena_elo/results/20240906/elo_results_image_editing.pkl +3 -0
  3. arena_elo/results/20240906/image_editing_leaderboard.csv +10 -0
  4. arena_elo/results/20240907/clean_battle_t2i_generation.json +0 -0
  5. arena_elo/results/20240907/elo_results_t2i_generation.pkl +3 -0
  6. arena_elo/results/20240907/t2i_generation_leaderboard.csv +18 -0
  7. arena_elo/results/latest/clean_battle_image_editing.json +16 -0
  8. arena_elo/results/latest/clean_battle_t2i_generation.json +42 -0
  9. arena_elo/results/latest/elo_results_image_editing.pkl +1 -1
  10. arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
  11. arena_elo/results/latest/image_editing_leaderboard.csv +9 -9
  12. arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
arena_elo/results/20240906/clean_battle_image_editing.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20240906/elo_results_image_editing.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:682e73c52b8f4c051a3c7ded7e9641685456dacf0f6dbdfcbf0d3db6f2169cea
3
+ size 63251
arena_elo/results/20240906/image_editing_leaderboard.csv ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ MagicBrush,MagicBrush,1112.451105810697,1116.304139279677,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush/
3
+ InfEdit,InfEdit,1076.6495699925572,1076.5124342508661,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://sled-group.github.io/InfEdit/
4
+ CosXLEdit,CosXLEdit,1064.6684883907062,1065.5950993615677,cosxl-nc-community,Stability AI,https://huggingface.co/stabilityai/cosxl
5
+ InstructPix2Pix,InstructPix2Pix,1035.2729879453216,1033.10920186875,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
6
+ PNP,PNP,1001.6260075617246,1006.181858858284,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
7
+ Prompt2prompt,Prompt2prompt,990.9739539988135,992.0777428736022,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io/
8
+ CycleDiffusion,CycleDiffusion,939.1219359503639,932.2270617891018,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion?tab=readme-ov-file
9
+ SDEdit,SDEdit,925.0427834748338,923.4136204313016,MIT License,Stanford University,https://sde-image-editing.github.io
10
+ Pix2PixZero,Pix2PixZero,854.1931668749824,854.5788412868493,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io/
arena_elo/results/20240907/clean_battle_t2i_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20240907/elo_results_t2i_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3abf30eaed4a14868db7d75bf665e54939f9a8260844a8b067a9971b1952fef3
3
+ size 88247
arena_elo/results/20240907/t2i_generation_leaderboard.csv ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1126.8163301214895,1127.2649468089273,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ FLUX.1-dev,FLUX.1-dev,1126.0721216782244,1145.8317939161764,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
+ FLUX.1-schnell,FLUX.1-schnell,1080.6437103153228,1080.028689167911,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1073.4393034122365,1071.0953389840586,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1055.8131607164855,1052.5367877751423,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ HunyuanDiT,HunyuanDiT,1039.6247294773034,1027.5553176591982,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
8
+ StableCascade,StableCascade,1038.503364291083,1040.4925359161466,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
9
+ SDXL-Lightning,SDXL-Lightning,1024.6674430167477,1027.618845555247,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
+ PixArtAlpha,PixArtAlpha,1022.6915349299396,1011.872997925934,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
11
+ PixArtSigma,PixArtSigma,1019.5072680991525,1018.0621667213067,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
+ AuraFlow,AuraFlow,997.7561897276669,988.5624138101551,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
13
+ SD3,SD3,989.7708398500049,984.8956034155048,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
14
+ SDXL,SDXL,965.2029214915333,964.71647140578,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,914.190563890211,910.3261232771027,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),906.0670953509358,898.7869948946318,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,828.8125289712327,822.430869650419,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,790.4208946604244,802.9929269937835,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/latest/clean_battle_image_editing.json CHANGED
@@ -18728,5 +18728,21 @@
18728
  "judge": "arena_user_10.16.34.60",
18729
  "anony": true,
18730
  "tstamp": 1725426997.1156
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18731
  }
18732
  ]
 
18728
  "judge": "arena_user_10.16.34.60",
18729
  "anony": true,
18730
  "tstamp": 1725426997.1156
18731
+ },
18732
+ {
18733
+ "model_a_conv_id": "61972de24d9e42e1bac813bea6362217",
18734
+ "model_b_conv_id": "c9d37d6a0673452f91bf3ea7c5178d57",
18735
+ "inputs": {
18736
+ "source_prompt": "Two people in an ocean playing with a yellow Frisbee.",
18737
+ "target_prompt": "Two people in an ocean playing with a yellow ball.",
18738
+ "instruct_prompt": "change the frisbee into a ball"
18739
+ },
18740
+ "model_a": "InfEdit",
18741
+ "model_b": "CycleDiffusion",
18742
+ "vote_type": "bothbad_vote",
18743
+ "winner": "tie (bothbad)",
18744
+ "judge": "arena_user_10.16.18.162",
18745
+ "anony": true,
18746
+ "tstamp": 1725658918.1797
18747
  }
18748
  ]
arena_elo/results/latest/clean_battle_t2i_generation.json CHANGED
@@ -96132,5 +96132,47 @@
96132
  "judge": "arena_user_10.16.10.147",
96133
  "anony": true,
96134
  "tstamp": 1725534758.4913
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
96135
  }
96136
  ]
 
96132
  "judge": "arena_user_10.16.10.147",
96133
  "anony": true,
96134
  "tstamp": 1725534758.4913
96135
+ },
96136
+ {
96137
+ "model_a_conv_id": "86714b55fb7f42fe975d83aad279c780",
96138
+ "model_b_conv_id": "31e2095900e9440a8aa65d583fd233c6",
96139
+ "inputs": {
96140
+ "prompt": "a ground texture of afrom the game borderlands, the texture is seamless and connects at all sites, symetrical,line art,highly detailed cel shading,hatching lines,high focus on shading and colors"
96141
+ },
96142
+ "model_a": "FLUX.1-schnell",
96143
+ "model_b": "AuraFlow",
96144
+ "vote_type": "leftvote",
96145
+ "winner": "model_a",
96146
+ "judge": "arena_user_10.16.18.162",
96147
+ "anony": false,
96148
+ "tstamp": 1725671574.5493
96149
+ },
96150
+ {
96151
+ "model_a_conv_id": "db679dc67e154af9b3ba996f8a940caa",
96152
+ "model_b_conv_id": "ec6eb6b8f21e4b1c9b48fd2aa9a76385",
96153
+ "inputs": {
96154
+ "prompt": "a ground texture of afrom the game borderlands, the texture is seamless and connects at all sites, symetrical,line art,highly detailed cel shading,hatching lines,high focus on shading and colors"
96155
+ },
96156
+ "model_a": "FLUX.1-schnell",
96157
+ "model_b": "AuraFlow",
96158
+ "vote_type": "leftvote",
96159
+ "winner": "model_a",
96160
+ "judge": "arena_user_10.16.34.60",
96161
+ "anony": false,
96162
+ "tstamp": 1725671665.8785
96163
+ },
96164
+ {
96165
+ "model_a_conv_id": "76e912e4c584422d889b7b3de96978e8",
96166
+ "model_b_conv_id": "c14de85b705c460f9ad969a4c80e76a6",
96167
+ "inputs": {
96168
+ "prompt": "Three cats and one dog sitting on the grass."
96169
+ },
96170
+ "model_a": "PixArtAlpha",
96171
+ "model_b": "OpenJourney",
96172
+ "vote_type": "rightvote",
96173
+ "winner": "model_b",
96174
+ "judge": "arena_user_10.16.34.60",
96175
+ "anony": true,
96176
+ "tstamp": 1725721387.0699
96177
  }
96178
  ]
arena_elo/results/latest/elo_results_image_editing.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b0a523a425f0d7e077d4b86af28e3fcdf1ee03b01b52a8eaa6d50a00a6c2937b
3
  size 63251
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:682e73c52b8f4c051a3c7ded7e9641685456dacf0f6dbdfcbf0d3db6f2169cea
3
  size 63251
arena_elo/results/latest/elo_results_t2i_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:99ed3294c08993a11268b533b16e4c0223859dea99453a7a30af09c668d86116
3
  size 88247
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3abf30eaed4a14868db7d75bf665e54939f9a8260844a8b067a9971b1952fef3
3
  size 88247
arena_elo/results/latest/image_editing_leaderboard.csv CHANGED
@@ -1,10 +1,10 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- MagicBrush,MagicBrush,1112.451629851484,1116.320673405148,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush/
3
- InfEdit,InfEdit,1077.2196234272722,1077.0822371040688,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://sled-group.github.io/InfEdit/
4
- CosXLEdit,CosXLEdit,1064.6854336640097,1065.6016015010896,cosxl-nc-community,Stability AI,https://huggingface.co/stabilityai/cosxl
5
- InstructPix2Pix,InstructPix2Pix,1035.2768636543208,1033.1103556659373,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
6
- PNP,PNP,1001.6190325480716,1006.1742699515779,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
7
- Prompt2prompt,Prompt2prompt,990.9748205235168,992.0791260748806,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io/
8
- CycleDiffusion,CycleDiffusion,938.5611614312506,931.6700985543164,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion?tab=readme-ov-file
9
- SDEdit,SDEdit,925.0471397536328,923.4128508663366,MIT License,Stanford University,https://sde-image-editing.github.io
10
- Pix2PixZero,Pix2PixZero,854.1642951464414,854.5487868766448,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io/
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ MagicBrush,MagicBrush,1112.451105810697,1116.304139279677,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush/
3
+ InfEdit,InfEdit,1076.6495699925572,1076.5124342508661,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://sled-group.github.io/InfEdit/
4
+ CosXLEdit,CosXLEdit,1064.6684883907062,1065.5950993615677,cosxl-nc-community,Stability AI,https://huggingface.co/stabilityai/cosxl
5
+ InstructPix2Pix,InstructPix2Pix,1035.2729879453216,1033.10920186875,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
6
+ PNP,PNP,1001.6260075617246,1006.181858858284,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
7
+ Prompt2prompt,Prompt2prompt,990.9739539988135,992.0777428736022,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io/
8
+ CycleDiffusion,CycleDiffusion,939.1219359503639,932.2270617891018,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion?tab=readme-ov-file
9
+ SDEdit,SDEdit,925.0427834748338,923.4136204313016,MIT License,Stanford University,https://sde-image-editing.github.io
10
+ Pix2PixZero,Pix2PixZero,854.1931668749824,854.5788412868493,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io/
arena_elo/results/latest/t2i_generation_leaderboard.csv CHANGED
@@ -1,18 +1,18 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- PlayGround V2.5,PlayGround V2.5,1126.7965072081079,1127.598749773581,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
- FLUX.1-dev,FLUX.1-dev,1126.295997728015,1144.195630746607,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
- FLUX.1-schnell,FLUX.1-schnell,1080.5788813801737,1076.6860860116883,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
- PlayGround V2,PlayGround V2,1073.4760591260929,1071.5107460107356,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
- Kolors,Kolors,1055.7826733421934,1053.8905112763337,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
- HunyuanDiT,HunyuanDiT,1039.6239907871948,1027.5203415318617,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
8
- StableCascade,StableCascade,1038.4581875994177,1040.846581871948,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
9
- SDXL-Lightning,SDXL-Lightning,1024.616199476238,1027.940772463753,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
- PixArtAlpha,PixArtAlpha,1023.0666793144385,1012.4069167125616,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
11
- PixArtSigma,PixArtSigma,1019.5037001983244,1018.4273947958546,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
- AuraFlow,AuraFlow,997.7604551516216,993.9762732485401,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
13
- SD3,SD3,989.8394841649496,985.4193822140902,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
14
- SDXL,SDXL,965.2343251723647,964.9390171994004,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
- SDXLTurbo,SDXLTurbo,914.1751414457401,910.5753376726902,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
- LCM(v1.5/XL),LCM(v1.5/XL),906.0623926826472,898.4200059926054,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
- OpenJourney,OpenJourney,828.4123809422745,822.2283628178983,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
- LCM,LCM,790.3169442802018,803.2741408023215,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1126.8163301214895,1127.2649468089273,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ FLUX.1-dev,FLUX.1-dev,1126.0721216782244,1145.8317939161764,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
+ FLUX.1-schnell,FLUX.1-schnell,1080.6437103153228,1080.028689167911,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1073.4393034122365,1071.0953389840586,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1055.8131607164855,1052.5367877751423,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ HunyuanDiT,HunyuanDiT,1039.6247294773034,1027.5553176591982,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
8
+ StableCascade,StableCascade,1038.503364291083,1040.4925359161466,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
9
+ SDXL-Lightning,SDXL-Lightning,1024.6674430167477,1027.618845555247,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
+ PixArtAlpha,PixArtAlpha,1022.6915349299396,1011.872997925934,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
11
+ PixArtSigma,PixArtSigma,1019.5072680991525,1018.0621667213067,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
+ AuraFlow,AuraFlow,997.7561897276669,988.5624138101551,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
13
+ SD3,SD3,989.7708398500049,984.8956034155048,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
14
+ SDXL,SDXL,965.2029214915333,964.71647140578,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,914.190563890211,910.3261232771027,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),906.0670953509358,898.7869948946318,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,828.8125289712327,822.430869650419,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,790.4208946604244,802.9929269937835,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7