f16 GGUF
#1
by
weezywitasneezy
- opened
Would it be possible to get an f16 GGUF quant for this? Thanks so much!
Unfortunately, my setup does not support f16 quants, although it kinda would make sense especially for small 7B models (I am still debating whether to do something about it). I made one manually, and it should be up by now.
mradermacher
changed discussion status to
closed
Thanks so much!
Cheers :) If you have any other quantisation requests in the future, don't hold back.