Qwen2.5-72B-0.6x-Instruct-GGUF

GGUF quantization(s) of ddh0/Qwen2.5-72B-0.6x-Instruct. See the original model card for details.

Downloads last month
7
GGUF
Model size
72.7B params
Architecture
qwen2

4-bit

Inference API
Unable to determine this model's library. Check the docs .

Model tree for ddh0/Qwen2.5-72B-0.6x-Instruct-GGUF

Quantized
(4)
this model