license: unlicense | |
inference: false | |
> [!TIP] | |
> [**Use the latest version of KoboldCpp.**](https://github.com/LostRuins/koboldcpp/releases/latest) | |
[Quant request #73.](https://huggingface.co/Lewdiculous/Model-Requests/discussions/73) | |
My GGUF-IQ-Imatrix quants for [Sao10K/L3.1-8B-Niitama-v1.1](https://huggingface.co/Sao10K/L3.1-8B-Niitama-v1.1). | |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/2Q5ky8TvP0vLS1ulMXnrn.png) | |