Safetensors
Polish
mixtral

It is probably not instruct model

#1
by Whatever76474758585 - opened

I downloaded quant of this model (Q4_K_M from https://huggingface.co/mradermacher/PLLuM-8x7B-nc-instruct-GGUF), and it is not instruct model, its base model. It doesn't know who it is, it replies with questions, crafts imaginary dialogues, tries to finish User's sentence... It is a base model.

Now the question is - where is the real instruct model and did we even get one? It is pretty unlikely that mradermacher messed up the files, he has over 30000 quants, its heavily scripted.
Can anyone verify where is real PLLuM 8x7B instruct model, commercial or not, and/or its quants?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment