I really hope you do a 6bpw
#1
by
bigfish3
- opened
I've been checking occasionally I was surprised someone finally made a exl2 after so long. I was thinking @LoneStriker would've made a full set given its pretty liked.
Full set here now:
https://huggingface.co/models?search=LoneStriker/Kaiju-11B
Haha, @LoneStriker you are unbeatable! @bigfish3 I mostly make quants that I am gona use, test, ect and have no plans to make full set of quants but anyway, you have now what you asked for.
BTW. This model have a very original writing style. I am surprised by this mix.
altomek
changed discussion status to
closed