Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

4-bit precision

Misc with no match

8-bit precision

Models

13,342

Full-text search

Active filters: gguf-my-repo

NikolayKozloff/Confucius-o1-14B-Q4_K_M-GGUF

Updated 18 days ago • 37 • 1

Triangle104/Qwen2.5-14B-Instruct-1M-Q4_K_M-GGUF

Text Generation • Updated 18 days ago • 30 • 1

Triangle104/Qwen2.5-14B-Instruct-1M-Q5_K_S-GGUF

Text Generation • Updated 18 days ago • 92 • 2

Triangle104/Qwen2.5-14B-Instruct-1M-Q8_0-GGUF

Text Generation • Updated 18 days ago • 63 • 1

cssacaa/qwenben-Q4_K_M-GGUF

Updated 18 days ago • 27 • 1

Triangle104/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2-Q4_K_M-GGUF

Updated 18 days ago • 849 • 1

BlackBeenie/DeepSeek-R1-Distill-Qwen-32B-Q4_K_M-GGUF

Updated 18 days ago • 185 • 2

Kondara/DeepSeek-R1-Distill-Qwen-7B-Q4_K_M-GGUF

Updated 10 days ago • 112 • 1

lilyanatia/DeepSeek-R1-Distill-Llama-8B-abliterated-Q4_0-GGUF

Updated 17 days ago • 3.49k • 4

ClaudioItaly/Vangelus-Poetic-9B-Q5_K_M-GGUF

Updated 17 days ago • 24 • 1

tinybiggames/Dolphin3.0-Llama3.1-8B-Q4_K_M-GGUF

Updated 17 days ago • 547 • 1

NikolayKozloff/0x-lite-Q5_K_S-GGUF

Text Generation • Updated 17 days ago • 24 • 1

NikolayKozloff/0x-lite-Q4_K_S-GGUF

Text Generation • Updated 17 days ago • 28 • 1

NikolayKozloff/llama-3.1-0x-mini-Q8_0-GGUF

Text2Text Generation • Updated 17 days ago • 29 • 1

Aryanne/YuE-s1-7B-anneal-en-cot-Q6_K-GGUF

Text Generation • Updated 17 days ago • 193 • 5

attashe/q-2.5-deepseek-r1-veltha-v0.3-Q5_K_M-GGUF

Updated 17 days ago • 51 • 1

multimodalart/YuE-s1-7B-anneal-en-cot-Q8_0-GGUF

Text Generation • Updated 17 days ago • 199 • 2

KenLi315/Conan-embedding-v1-Q4_K_M-GGUF

Updated 17 days ago • 693 • 1

AtlaAI/Selene-1-Mini-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 423 • 8

KatyTheCutie/Repose-12B-Q6_K-GGUF

Updated 16 days ago • 139 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q4_K_S-GGUF

Text Generation • Updated 16 days ago • 322 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q4_K_M-GGUF

Text Generation • Updated 16 days ago • 449 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q5_K_S-GGUF

Text Generation • Updated 16 days ago • 28 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q5_K_M-GGUF

Text Generation • Updated 16 days ago • 35 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q6_K-GGUF

Text Generation • Updated 16 days ago • 316 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q8_0-GGUF

Text Generation • Updated 16 days ago • 501 • 1

Triangle104/DeepSeek-R1-Distill-Qwen-14B-uncensored-Q4_K_S-GGUF

Updated 16 days ago • 6.96k • 4

Triangle104/DeepSeek-R1-Distill-Qwen-14B-uncensored-Q4_K_M-GGUF

Updated 16 days ago • 2.95k • 1

DoppelReflEx/MN-12B-Kakigori-Q6_K-GGUF

Updated 15 days ago • 59 • 1

Theros/Qwen2.5-ColdBrew-R1-Q4_K_M-GGUF

Updated 15 days ago • 21 • 1