--- license: mit language: - en - zh base_model: yulan-team/YuLan-Mini --- GGUF Quants for: [yulan-team/YuLan-Mini](https://huggingface.co/yulan-team/YuLan-Mini) Model by: [RUC-GSAI-YuLan](https://huggingface.co/yulan-team) (thank you!) Quants by: [quantflex](https://huggingface.co/quantflex) Run with [llama.cpp](https://github.com/ggerganov/llama.cpp) No K-Quants included because the tensor cols are not divisible by 256.