Spaces:

open-llm-leaderboard
/

open_llm_leaderboard

Running on CPU Upgrade

App Files Files Community

Qwen2.5-32B merge eval error

#1078

by ehristoforu - opened Jan 19

Jan 19

•

https://huggingface.co/datasets/open-llm-leaderboard/requests/commit/4af328af30116a02ddebb06ecf7e9c723217d3bd

Model_id: ehristoforu/testq-32b

No custom remote code, no edits in architechture, no edits in tokenizer, only mergekit merge

Aryanne

Jan 20

yeah my merge too I tried 2 times but it failed no idea why 🤔.

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/Aryanne/QwentileSwap_eval_request_False_bfloat16_Original.json

Jan 24

Submitted once and failed.

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_eval_request_False_bfloat16_Original.json

about 9 hours ago

Mine failed too https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/tomasmcm/sky-t1-coder-32b-flash_eval_request_False_bfloat16_Original.json
Is it because we are missing the base_model?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment