DeepSeek-R1-Distill-Llama-8B GGUF Q4_K_M model file

python llama.cpp/convert_hf_to_gguf.py DeepSeek-R1-Distill-Llama-8B --outfile deepseek-r1-distill-llama-8b.gguf
./llama-quantize deepseek-r1-distill-llama-8b.gguf deepseek-r1-distill-llama-8b-q4_k_m.gguf Q4_K_M

Downloads last month: 134

GGUF

Model size

8.03B params

Architecture

llama

4-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.