What to vote when quality of generation is equal or both are bad?

#22
by MoritzLaurer - opened

I really like the space!
It could be good to add two more options for voting: "equally good/tie" and "both are bad" like in the chatbot arena: https://lmarena.ai/
I'm currently not sure what to vote in these cases

Thanks!

Then I'd advise skipping them. I might add a skip button.

The reason I do not want to add the suggested buttons is because the Arena was attacked once. The suggested options would make things easier for attackers and damage the dataset.
https://huggingface.co/datasets/Pendrokar/TTS_Arena/discussions/2

Maybe the buttons could be made available to non-cached samples. But I have no clue how many times do visitors have the patience to wait for synthesis. It is much slower than the original Arena.

Next round button is now always available for when you feel there is a tie.

Pendrokar changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment