YuLan-Mini-GGUF / README.md
quantflex's picture
Update README.md
5a6ab06 verified
---
license: mit
language:
- en
- zh
base_model: yulan-team/YuLan-Mini
---
GGUF Quants for: [yulan-team/YuLan-Mini](https://huggingface.co/yulan-team/YuLan-Mini)
Model by: [RUC-GSAI-YuLan](https://huggingface.co/yulan-team) (thank you!)
Quants by: [quantflex](https://huggingface.co/quantflex)
Run with [llama.cpp](https://github.com/ggerganov/llama.cpp)
No K-Quants included because the tensor cols are not divisible by 256.