Clémentine Fourrier's picture

Clémentine Fourrier

clefourrier

·

http://clefourrier.github.io

AI & ML interests

None yet

Articles

Introducing the Open FinLLM Leaderboard

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Falcon 2: An 11B parameter pretrained language model and VLM, trained on over 5000B tokens tokens and 11 languages

CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models

Let's talk about LLM evaluation

Introducing the Open Arabic LLM Leaderboard

Introducing the Open Leaderboard for Hebrew LLMs!

Bringing the Artificial Analysis LLM Performance Leaderboard to Hugging Face

Improving Prompt Consistency with Structured Generations

Introducing the Open Chain of Thought Leaderboard

The Open Medical-LLM Leaderboard: Benchmarking Large Language Models in Healthcare

Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

Introducing the Chatbot Guardrails Arena

Introducing ConTextual: How well can your Multimodal model jointly reason over text and image in text-rich scenes?

TTS Arena: Benchmarking Text-to-Speech Models in the Wild

Introducing the Red-Teaming Resistance Leaderboard

Introducing the Open Ko-LLM Leaderboard: Leading the Korean LLM Evaluation Ecosystem

NPHardEval Leaderboard: Unveiling the Reasoning Abilities of Large Language Models through Complexity Classes and Dynamic Updates

Introducing the Enterprise Scenarios Leaderboard: a Leaderboard for Real World Use Cases

The Hallucinations Leaderboard, an Open Effort to Measure Hallucinations in Large Language Models

A guide to setting up your own Hugging Face leaderboard: an end-to-end example with Vectara's hallucination leaderboard

2023, year of open LLMs

Open LLM Leaderboard: DROP deep dive

Overview of natively supported quantization schemes in 🤗 Transformers

What's going on with the Open LLM Leaderboard?

Introduction to Graph Machine Learning

Organizations

clefourrier's activity

New activity in open-llm-leaderboard/open_llm_leaderboard about 20 hours ago

Normalization for MMLU-Pro doesn't make sense

#947 opened 23 days ago by

Incorrect ifeval benchmark

#879 opened 2 months ago by

How do I view the results of my submission?

#980 opened 6 days ago by

Update README.md

#988 opened about 23 hours ago by

Results are not showing up

#987 opened about 23 hours ago by

New activity in gaia-benchmark/leaderboard 14 days ago

Subit for Gaia testing

#23 opened 14 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 16 days ago

ssmits/Qwen2.5-95B-Instruct not running

#962 opened 16 days ago by

BoltMonkey/NeuralDaredevil-SuperNova-Lite-7B-DARETIES-abliterated

#961 opened 16 days ago by

New activity in demo-leaderboard-backend/leaderboard 17 days ago

os.isfile --> os.path.isfile

#12 opened 17 days ago by

meg

New activity in open-llm-leaderboard/GenerationVisualizer 18 days ago

The output is missing?

#3 opened 19 days ago by

New activity in clefourrier/graphormer-base-pcqm4mv2 18 days ago

Grahpormer Encoder task

#7 opened 20 days ago by

New activity in demo-leaderboard-backend/leaderboard 18 days ago

Minimal edit for directory structure assumption.

#11 opened 20 days ago by

meg

New activity in demo-leaderboard-backend/backend 18 days ago

How to use this toolkit?

#11 opened 19 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 21 days ago

Are Qwen models pretrained or continuously pretrained?

#941 opened 28 days ago by

Possibility that Qwen2.5-72B-Instruct evaluation was not recorded correctly

#942 opened 25 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 23 days ago

"Unknown model size" when submitting model

#945 opened 23 days ago by

Locally reproducible Leaderboard (v2) scores

#946 opened 23 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 24 days ago

simplify_ux

#944 opened 24 days ago by

New activity in open-llm-leaderboard/Youlln__2PRYMMAL-Yi1.5-6B-SLERP-details 24 days ago

Update README.md

#1 opened 24 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 25 days ago

how can i upload my model on the leader board?

#940 opened 29 days ago by

New activity in demo-leaderboard-backend/leaderboard about 1 month ago

Change to light background theme

#9 opened about 1 month ago by

New activity in gaia-benchmark/leaderboard about 1 month ago

Error at test submission

#22 opened about 1 month ago by

It seems like at least one submission date is wrong

#21 opened about 2 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard about 1 month ago

How to add task to the leaderboard?

#921 opened about 1 month ago by

New activity in open-llm-leaderboard/open_llm_leaderboard about 2 months ago

failed open llm leaderboard benchmark

#890 opened about 2 months ago by

New activity in open-llm-leaderboard/requests about 2 months ago

Failed LLM bechmark test

#55 opened about 2 months ago by

New activity in open-llm-leaderboard-old/results about 2 months ago

Dataset Viewer issue for test results: RowsPostProcessingError

#68 opened 4 months ago by

New activity in gaia-benchmark/GAIA about 2 months ago

How can I check my test result?

#13 opened 2 months ago by

New activity in demo-leaderboard/gpt2-demo about 2 months ago

Create README.md

#1 opened 2 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 2 months ago

Failed LLM benchmark request

#882 opened 2 months ago by

New activity in open-llm-leaderboard/requests 2 months ago

EpistemeAI

#50 opened 2 months ago by

New activity in colab-potsdam/multimodal-clem-leaderboard 2 months ago

Apply for community grant: Academic project (gpu)

#1 opened 2 months ago by

sherzod-hakimov

New activity in open-llm-leaderboard/open_llm_leaderboard 2 months ago

re-evaluating failed models after fixing the NaN weights

#869 opened 3 months ago by

New activity in demo-leaderboard-backend/leaderboard 2 months ago

🚩 Report: Not working

#8 opened 2 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 2 months ago

NEED A LITTLE HELP

#880 opened 2 months ago by

maintainers-highlight-submission

#877 opened 2 months ago by

Surprisingly low score of Rhea-72b-v0.5 and TW3-JRGL-v2

#875 opened 2 months ago by

What should a finetuned model's license be if the model is MIT but the datasets are Apache 2.0 and cc-by-4.0

#866 opened 3 months ago by

New activity in gaia-benchmark/leaderboard 2 months ago

F GAIA, runtime error

#19 opened 3 months ago by

New activity in gaia-benchmark/results_public 2 months ago

Upload dataset

#4 opened 2 months ago by

Upload dataset

#3 opened 2 months ago by

Delete '2023' config

#2 opened 2 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 2 months ago

Model deleted from Pending

#850 opened 3 months ago by

Why is the Pending Evaluation Queue not updating?

#870 opened 2 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 3 months ago

Parameter count at 0 for incorrectly detected params is misleading

#867 opened 3 months ago by

Failed evaluation for model

#865 opened 3 months ago by

Gemma-2-9B-it scores

#843 opened 3 months ago by

Add fewshot_as_multiturn column

#868 opened 3 months ago by

Which accuracy rate does IFEval finally use?

#822 opened 4 months ago by

Leaderboard not updating?

#863 opened 3 months ago by

Llama-3.1-70B fine-tuned failed

#864 opened 3 months ago by

Model results not showing: dfurman/Qwen2-72B-Orpo-v0.1

#855 opened 3 months ago by

dynamic rope_scaling on internlm2_5-7b llamafied

#862 opened 3 months ago by

Feature request: Add non AutoModelForCausalLM models

#391 opened 11 months ago by

KnutJaegersberg

Some suggestions for evaluation priority voting mechanism

#801 opened 4 months ago by

Can't loging to leaderboard to submit or vote. Too many redirects.

#853 opened 3 months ago by

What are "raw" metrics?

#856 opened 3 months ago by

aginart-salesforce

Jamba model FAILED

#854 opened 3 months ago by

Tweaks / improvements: Add column with parameter count and mouseover labels for datasets

#795 opened 4 months ago by

Is there an issue with adding bos in the new evaluation?

#852 opened 3 months ago by