OpenEvals

Hi! Welcome on the org page of the Evaluation team at HuggingFace. We want to support the community in building and sharing quality evaluations, for reproducible and fair model comparisions, to cut through the hype of releases and better understand actual model capabilities.

We're behind the:

• Open LLM Leaderboard (over 11K models evaluated since 2023)
• lighteval LLM evaluation suite, fast and filled with the SOTA benchmarks you might want
• evaluation guidebook, your reference for LLM evals
• leaderboards on the hub initiative, to encourage people to build more leaderboards in the open for more reproducible evaluation. You'll find some doc here to build your own!