Quantization parameters?
#1
by
clxy
- opened
Can you put the parameters on how this was quantized?
Did you use https://github.com/qwopqwop200/GPTQ-for-LLaMa?
Using the UI it seems to run into an error.
Can you put the parameters on how this was quantized?
Did you use https://github.com/qwopqwop200/GPTQ-for-LLaMa?
Using the UI it seems to run into an error.