Any chance of a gguf?
#7
by
lollylan
- opened
Hello, is there any Chance of you releasing a Q8 variant of this and the instruct model? The https://huggingface.co/spaces/ggml-org/gguf-my-repo website unfortunately outputs an error.
I cannot recommend using this anymore. By now there are more capable models, see for example the german llama 3 model https://huggingface.co/DiscoResearch/Llama3-DiscoLeo-Instruct-8B-v0.1 or other models from this leaderboard https://huggingface.co/spaces/occiglot/euro-llm-leaderboard