Hopefully there will be an official model for the gptq method.
#6
by
warlock-edward
- opened
The official model is too big, if not to do quantitative support in general are users are difficult to experience such a stunning big model, I hope the official can give with the quantitative model gptq support, so that we can experience such an excellent model！！！！