It takes too long to get reuslts?

#16
by StarscreamDeceptions - opened

Hi, what happend to the eval system? In the last several months, I feel there is no new models' results updated. Do you need more GPUs?

I think update speed is also important to open LLM leaderboards

La Leaderboard org

Thank you for your interest. Please keep in mind that the Leaderboard includes over 60 tasks and this is a voluntary effort. We evaluate models as quickly as possible and publish the results once they are ready. This month, we have added results for nearly 50 models and continue to evaluate both the models added to the queue by the community and the latest state-of-the-art models. Thank you for your understanding :)

mariagrandury changed discussion status to closed

Sign up or log in to comment