Model evaluations failed

#884
by DavidGF - opened

Hey,

it seems there was a network issue with the running queue?
Our Model failed on the evaluation:

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/VAGOsolutions/Llama-3.1-SauerkrautLM-70b-Instruct_eval_request_False_bfloat16_Original.json

Can you please add the models back into the running queue?

Thanks in advance!

Open LLM Leaderboard org

Hi @DavidGF ,

I have resubmitted your model, please, check the request file!

I will close this issue, please, ping me here if you need any help with this model again or open a new one

alozowski changed discussion status to closed

Hi @alozowski ,
unfortunately the model was kicked out of the queue again.
I would appreciate if you could reresubmit the model again :)

Many thanks in advance!

Hi @alozowski
I just want to kindly ask if there are any problems with our model on your side?
We did a subset of evaluations ourself with no issues at all.

Many thanks and regards,
David

alozowski changed discussion status to open
Open LLM Leaderboard org

Hi @DavidGF ,

According to the request file the status of your model is PENDING. Our research cluster is now full, so we ask for your patience while waiting for the results

alozowski changed discussion status to closed

Sign up or log in to comment