General discussion/quantization.

#2
by Lewdiculous - opened

Congrats on model performance!

I'll be uploading GGUF quants at:
https://huggingface.co/Lewdiculous/RoleBeagle-11B-GGUF-IQ-Imatrix

I'll be uploading GGUF quants at:
https://huggingface.co/Lewdiculous/RoleBeagle-11B-GGUF-IQ-Imatrix

Awesome, thank you!

No problem, it was a request from @saishf . Keep up the good experimentation and happy cooking.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment