quantflex
/

YuLan-Mini-GGUF

Inference Endpoints

Model card Files Files and versions Community

GGUF Quants for: yulan-team/YuLan-Mini

Model by: RUC-GSAI-YuLan (thank you!)

Quants by: quantflex

Run with llama.cpp

No K-Quants included because the tensor cols are not divisible by 256.

Downloads last month: 0

GGUF

Model size

2.42B params

Architecture

llama

4-bit

5-bit

8-bit

16-bit

32-bit

Inference API

Unable to determine this model's library. Check the docs .

Model tree for quantflex/YuLan-Mini-GGUF

Base model

yulan-team/YuLan-Mini

Quantized

(4)

this model