Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

17,288

Full-text search

Active filters: llama-cpp

openfree/Gemma-3-R1984-12B-Q8_0-GGUF

Image-Text-to-Text • Updated 1 day ago • 1.1k • 32

openfree/Gemma-3-R1984-12B-Q6_K-GGUF

Image-Text-to-Text • Updated 1 day ago • 1.02k • 32

openfree/QwQ-R1984-32B-Q4_K_M-GGUF

Updated about 12 hours ago • 32

openfree/Qwen2.5-VL-32B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • Updated 1 day ago • 1.33k • 31

openfree/Gemma-3-R1984-27B-Q8_0-GGUF

Image-Text-to-Text • Updated 1 day ago • 1.37k • 30

openfree/Gemma-3-R1984-27B-Q6_K-GGUF

Image-Text-to-Text • Updated 1 day ago • 1.37k • 30

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q8_0-GGUF

Image-Text-to-Text • Updated 1 day ago • 1.92k • 30

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q6_K-GGUF

Image-Text-to-Text • Updated 1 day ago • 5.06k • 30

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M-GGUF

Image-Text-to-Text • Updated 1 day ago • 1.24k • 30

openfree/Llama-3_3-Nemotron-Super-49B-v1-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 1.87k • 30

openfree/QwQ-32B-Q8_0-GGUF

Text Generation • Updated 1 day ago • 1.45k • 30

openfree/Qwen2.5-VL-32B-Instruct-Q8_0-GGUF

Image-Text-to-Text • Updated 1 day ago • 1.28k • 30

openfree/QwQ-32B-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 1.76k • 30

openfree/QwQ-R1984-32B-Q8_0-GGUF

Updated about 13 hours ago • 30

openfree/Gemma-3-R1984-27B-Q4_K_M-GGUF

Image-Text-to-Text • Updated 1 day ago • 1.19k • 29

openfree/Llama-3_3-Nemotron-Super-49B-v1-Q6_K-GGUF

Text Generation • Updated 1 day ago • 1.58k • 29

isaiahbjork/orpheus-3b-0.1-ft-Q4_K_M-GGUF

Text-to-Speech • Updated 12 days ago • 6.16k • 37

NikolayKozloff/Llama-PLLuM-8B-instruct-Q8_0-GGUF

Updated Feb 24 • 163 • 4

openerotica/writing-roleplay-20k-context-nemo-12b-v1.0-gguf

Updated Oct 16, 2024 • 5.3k • 25

lukasfast/Teuken-7B-instruct-research-v0.4-Q6_K-GGUF

Text Generation • Updated Jan 22 • 112 • 2

NikolayKozloff/Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

Text Generation • Updated Jan 29 • 56 • 3

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated Jan 30 • 37 • 2

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-Q8_0-GGUF

Text Generation • Updated Jan 30 • 88 • 2

NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-Q8_0-GGUF

Updated Jan 31 • 383 • 2

smirki/UIGEN-T1.1-Qwen-7B-Q4_K_M-GGUF

Updated Feb 18 • 43 • 2

NikolayKozloff/PLLuM-12B-instruct-Q5_K_M-GGUF

Updated Feb 24 • 53 • 2

paultimothymooney/gemma-3-27b-it-Q4_K_M-GGUF

Image-Text-to-Text • Updated 19 days ago • 203 • 2

NovNovikov/gemma-3-27b-it-abliterated-Q4_K_M-GGUF

Image-Text-to-Text • Updated 14 days ago • 497 • 2

ysn-rfd/WizardLM-7B-Uncensored-GGUF

Updated 4 days ago • 96 • 2

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5, 2024 • 17.6k • 4