New GGUF quants
#8
by
mradermacher
- opened
DavidAU prompted us to redo quants for this model with current llama, and the problems seem to be gone. We're still in the process of generating the quants, but these are done so far: https://hf.tst.eu/model#Mixtral-8x7B-MoE-RP-Story-i1-GGUF
(original thread, with some more models that willo be redone is https://huggingface.co/mradermacher/model_requests/discussions/485)
Thank you dude!