tags: | |
- llama | |
- alpaca | |
- mix | |
- gptq | |
- quant | |
GPTQ 4 bit 128 groupsize quantization of https://huggingface.co/digitous/13B-HyperMantis |
tags: | |
- llama | |
- alpaca | |
- mix | |
- gptq | |
- quant | |
GPTQ 4 bit 128 groupsize quantization of https://huggingface.co/digitous/13B-HyperMantis |