metadata
license: cc-by-4.0
language:
- en
library_name: transformers
pipeline_tag: text-generation
tags:
- llama
- not-for-all-audiences
- text-generation-inference
(DO NOT DOWNLOAD, IT LOOKS LIKE ALL MODELS ARE BROKEN! I'll redo the models later.)
Edit: A new model v3 has been released from the author. Here is the link: https://huggingface.co/TheDrummer/Moistral-11B-v3-GGUF
There are already ready-made GGUF-imatrix models there. Let this one remain here as an archive.
Another model. What is the quality? I don’t know, ask the boss, I was just passing by.
Links to the original model and script:
- TheDrummer/Moistral-11B-v2.1a-WET: https://huggingface.co/TheDrummer/Moistral-11B-v2.1a-WET
- FantasiaFoundry/GGUF-Quantization-Script: https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script