Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

4-bit precision

Misc with no match

8-bit precision

Models

13,343

Full-text search

Active filters: gguf-my-repo

ClaudioItaly/Vangelus-Poetic-9B-Q4_K_M-GGUF

Updated 23 days ago • 24 • 1

matrixportal/LLama3.1-Hawkish-Theia-Fireball-8B-GGUF

Text Generation • Updated 22 days ago • 93 • 1

ozone-ai/llama-3.1-0x-mini-Q4_K_M-GGUF

Text2Text Generation • Updated 22 days ago • 113 • 1

ozone-ai/llama-3.1-0x-mini-Q3_K_S-GGUF

Text2Text Generation • Updated 22 days ago • 38 • 1

jlopez-dl/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q5_K_M-GGUF

Updated 22 days ago • 1.2k • 1

DataSoul/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview-Q4_K_M-GGUF

Updated 22 days ago • 128 • 1

RedSQID/sororicide-12B-Farer-Mell-Unslop-Q4_K_M-GGUF

Updated 22 days ago • 70 • 1

kagevazquez/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q4_K_M-GGUF

Updated 22 days ago • 1.13k • 1

CronoBJS/FuseO1-DeepSeekR1-Qwen2.5-Coder-14B-Preview-Q4_K_M-GGUF

Updated 22 days ago • 7.58k • 1

jimi0209/lb-reranker-0.5B-v1.0-Q5_K_M-GGUF

Text Generation • Updated 22 days ago • 111 • 2

ClaudioItaly/Vangelus-Secundus-Q5_K_M-GGUF

Updated 22 days ago • 25 • 1

maicog/DeepSeek-R1-Distill-Llama-8B-abliterated-Q4_K_S-GGUF

Updated 22 days ago • 2.11k • 3

NikolayKozloff/salt-asr_wav-uni_1_tts_wav-uni_1-12k-Q8_0-GGUF

Updated 21 days ago • 95 • 1

matrixportal/Bio-Medical-Llama-3-2-1B-CoT-012025-GGUF

Updated 21 days ago • 98 • 1

havenwood/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q5_K_M-GGUF

Updated 21 days ago • 3.5k • 1

Ashcomposer/jina-embeddings-v2-base-zh-Q8_0-GGUF

Feature Extraction • Updated 21 days ago • 86 • 1

harkov000/R1-DarkIdol-8B-v0.4-Q6_K-GGUF

Updated 21 days ago • 121 • 2

sm54/FuseO1-DeepSeekR1-QwQ-SkyT1-Flash-32B-Preview-Q4_K_M-GGUF

Updated 20 days ago • 756 • 6

mitkox/DeepSeek-R1-ReDistill-Qwen-1.5B-v1.0-Q4_K_M-GGUF

Text Generation • Updated 20 days ago • 84 • 1

BernTheCreator/DeepSeek-R1-Distill-Qwen-7B-Q4_0-GGUF

Updated 20 days ago • 1.3k • 1

shawn1251/granite-guardian-3.1-2b-Q4_K_M-GGUF

Text Generation • Updated 20 days ago • 24 • 1

Triangle104/DeepSeek-R1-Distill-Qwen-1.5B-uncensored-Q6_K-GGUF

Updated 20 days ago • 183 • 1

fernandoruiz/salamandra-7b-instruct-Q4_0-GGUF

Text Generation • Updated 19 days ago • 41 • 1

G17c21ds/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q8_0-GGUF

Updated 19 days ago • 3.96k • 2

djuna/MN-Chinofun-12B-4-Q6_K-GGUF

Updated 19 days ago • 85 • 1

djuna/MN-Chinofun-12B-4.1-Q6_K-GGUF

Updated 18 days ago • 51 • 1

OddTheGreat/Unity-12B-Q4_K_M-GGUF

Updated 18 days ago • 49 • 1

NikolayKozloff/Confucius-o1-14B-Q6_K-GGUF

Updated 18 days ago • 27 • 1

NikolayKozloff/Confucius-o1-14B-Q5_K_M-GGUF

Updated 18 days ago • 25 • 1

NikolayKozloff/Confucius-o1-14B-Q5_K_S-GGUF

Updated 18 days ago • 25 • 1