Any chance for Q4_2 and Q4_3 quantizations?
#1
by
CeeGee
- opened
Just wondering! The reason why I ask is this appears to be the GGML version of one of the most highly rated 7B models on the Open LLM Leaderboard and I understand quantizations Q4_2 and Q4_3 to be updated versions of Q4_0 and Q4_1, respectively. If not, no biggie, just thought I'd ask.
Thanks!
edp1096
changed discussion status to
closed