(DO NOT DOWNLOAD, IT LOOKS LIKE ALL MODELS ARE BROKEN! I'll redo the models later.)

Edit: A new model v3 has been released from the author. Here is the link: https://huggingface.co/TheDrummer/Moistral-11B-v3-GGUF

There are already ready-made GGUF-imatrix models there. Let this one remain here as an archive.

Another model. What is the quality? I donโ€™t know, ask the boss, I was just passing by.

Links to the original model and script:

Downloads last month
-
GGUF
Model size
10.7B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support