Llama 3.1 Nemotron 51B

#372
by okoyl3 - opened

I love your quants :)
Any chance for this one too?
https://huggingface.co/nvidia/Llama-3_1-Nemotron-51B-Instruct

No chance at the moment, it's not supported by llama.cpp. I'd like to have it, too.

mradermacher changed discussion status to closed

@mradermacher This is now finally properly supported as llama.cpp merged https://github.com/ggerganov/llama.cpp/pull/11008

Sign up or log in to comment