File size: 435 Bytes
cdd92ff
 
 
 
 
 
 
 
 
 
 
 
 
 
aec2dda
cdd92ff
 
fa82058
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
---
license: mit
language:
- en
- zh
base_model: yulan-team/YuLan-Mini
---

GGUF Quants for: [yulan-team/YuLan-Mini](https://huggingface.co/yulan-team/YuLan-Mini) 


Model by: [RUC-GSAI-YuLan](https://huggingface.co/yulan-team) (thank you!)


Quants by: [quantflex](https://huggingface.co/quantflex)


Run with [llama.cpp](https://github.com/ggerganov/llama.cpp)


No K-Quants included because the tensor cols are not divisible by 256.