Any news about CUDA error fix?

#1121
by icefog72 - opened

There clearly something wrong with test when mistral 7b and Qwen 2.5 72B have eval error. Is this what you are looking in to or for people just forget about trying to use leaderboard for models that failing? (even if they loads correctly locally) Uncertainty is unnerving. Thx for your work.

Open LLM Leaderboard org

Hi @icefog72 ,

Please, do not duplicate discussions, we're trying to answer when we have a bandwidth to focus on issues. I'm going to check your problem here:
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard/discussions/1112

alozowski changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment