Network/Environment Errors May Cause ELO Inaccuracies

#12
by Fristender - opened

Some models will return errors such as "NETWORK ERROR DUE TO HIGH TRAFFIC. PLEASE REGENERATE OR REFRESH THIS PAGE." If people vote that the model that generated something is better, this will make the ELO inaccurate.

chatbot-arena.png

LMArena org

those are filtered out for ELO calculation.

weichiang changed discussion status to closed

Sign up or log in to comment