Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

4-bit precision

Misc with no match

8-bit precision

Models

13,168

Full-text search

Active filters: gguf-my-repo

Cran-May/openbuddy-openllama-7b-v5-fp16-Q5_K_M-GGUF

Text Generation • Updated 21 days ago • 83 • 1

ClaudioItaly/Vangelus-Secundus-Q4_K_M-GGUF

Updated 21 days ago • 24 • 1

NikolayKozloff/DeepSeek-R1-Distill-Llama-8B-Q8_0-GGUF

Updated 21 days ago • 1.19k • 1

manarj789/DeepSeek-R1-Distill-Qwen-32B-Q8_0-GGUF

Updated 21 days ago • 792 • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-7B-Q8_0-GGUF

Updated 21 days ago • 1.3k • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-14B-Q5_K_M-GGUF

Updated 21 days ago • 487 • 2

NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Q8_0-GGUF

Updated 21 days ago • 550 • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-14B-Q5_K_S-GGUF

Updated 21 days ago • 93 • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-14B-Q4_K_M-GGUF

Updated 21 days ago • 732 • 1

ggml-org/DeepSeek-R1-Distill-Qwen-1.5B-Q4_0-GGUF

Updated 20 days ago • 3.86k • 2

ggml-org/DeepSeek-R1-Distill-Qwen-32B-Q8_0-GGUF

Updated 20 days ago • 7.98k • 5

ibrahimkettaneh/DeepSeek-R1-Distill-Llama-8B-Abliterated-Q4_K_M-GGUF

Updated 20 days ago • 24k • 2

netease-youdao/Confucius-o1-14B-GGUF

Updated 19 days ago • 424 • 1

NikolayKozloff/Llasa-1B-Q8_0-GGUF

Text-to-Speech • Updated 20 days ago • 907 • 3

srinivasbilla/llasa-3b-Q4_K_M-GGUF

Updated 20 days ago • 298 • 3

srinivasbilla/llasa-3b-Q8_0-GGUF

Updated 20 days ago • 999 • 2

Triangle104/Dria-Agent-a-3B-Q5_K_M-GGUF

Text Generation • Updated 20 days ago • 10 • 1

NikolayKozloff/q1-3B-PRIME-Q8_0-GGUF

Text Generation • Updated 20 days ago • 34 • 2

ClaudioItaly/Magdala-9B-Q4_K_M-GGUF

Updated 19 days ago • 25 • 1

matrixportal/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-GGUF

Updated 19 days ago • 234 • 1

Cran-May/Lamarck-14B-v0.7-Q4_K_M-GGUF

Text Generation • Updated 19 days ago • 116 • 1

ClaudioItaly/Vangelus-Poetic-9B-Q4_K_M-GGUF

Updated 19 days ago • 24 • 1

matrixportal/LLama3.1-Hawkish-Theia-Fireball-8B-GGUF

Text Generation • Updated 18 days ago • 86 • 1

ozone-ai/llama-3.1-0x-mini-Q4_K_M-GGUF

Text2Text Generation • Updated 19 days ago • 104 • 1

ozone-ai/llama-3.1-0x-mini-Q3_K_S-GGUF

Text2Text Generation • Updated 18 days ago • 28 • 1

jlopez-dl/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q5_K_M-GGUF

Updated 18 days ago • 1.09k • 1

DataSoul/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview-Q4_K_M-GGUF

Updated 18 days ago • 116 • 1

RedSQID/sororicide-12B-Farer-Mell-Unslop-Q4_K_M-GGUF

Updated 18 days ago • 65 • 1

kagevazquez/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q4_K_M-GGUF

Updated 18 days ago • 1.05k • 1

CronoBJS/FuseO1-DeepSeekR1-Qwen2.5-Coder-14B-Preview-Q4_K_M-GGUF

Updated 18 days ago • 7.52k • 1