quantflex
/

YuLan-Mini-GGUF

Inference Endpoints

Model card Files Files and versions Community

YuLan-Mini-GGUF

1 contributor

History: 16 commits

quantflex's picture

Upload YuLan-Mini-F16.gguf with huggingface_hub

6839231 verified 3 days ago

.gitattributes

2.16 kB

Upload YuLan-Mini-F16.gguf with huggingface_hub 3 days ago
README.md

435 Bytes

Update README.md 3 days ago
YuLan-Mini-F16.gguf

4.85 GB
LFS

Upload YuLan-Mini-F16.gguf with huggingface_hub 3 days ago
YuLan-Mini-F32.gguf

9.7 GB
LFS

Upload YuLan-Mini-F32.gguf with huggingface_hub 3 days ago
YuLan-Mini-Q4_0.gguf

1.46 GB
LFS

Rename YuLan-Mini-F32-Q4_0.gguf to YuLan-Mini-Q4_0.gguf 3 days ago
YuLan-Mini-Q4_1.gguf

1.6 GB
LFS

Rename YuLan-Mini-F32-Q4_1.gguf to YuLan-Mini-Q4_1.gguf 3 days ago
YuLan-Mini-Q5_0.gguf

1.74 GB
LFS

Rename YuLan-Mini-F32-Q5_0.gguf to YuLan-Mini-Q5_0.gguf 3 days ago
YuLan-Mini-Q5_1.gguf

1.88 GB
LFS

Upload YuLan-Mini-Q5_1.gguf with huggingface_hub 3 days ago
YuLan-Mini-Q8_0.gguf

2.58 GB
LFS

Rename YuLan-Mini-F32-Q8_0.gguf to YuLan-Mini-Q8_0.gguf 3 days ago