Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

19,735

Full-text search

Active filters: llama-cpp

NikolayKozloff/AceReason-Nemotron-14B-Q5_K_S-GGUF

Text Generation • Updated about 5 hours ago • 1

NikolayKozloff/AceReason-Nemotron-14B-Q4_K_M-GGUF

Text Generation • Updated about 5 hours ago • 1

NikolayKozloff/AceReason-Nemotron-14B-Q4_K_S-GGUF

Text Generation • Updated about 5 hours ago • 1

openfree/QwQ-32B-Q8_0-GGUF

Text Generation • Updated Mar 30 • 212 • 17

openfree/QwQ-32B-Q4_K_M-GGUF

Text Generation • Updated Mar 30 • 352 • 11

TheDrunkenSnail/Dirty-Muse-Writer-v01-Uncensored-Erotica-NSFW-Q6_K-GGUF

Updated Mar 15 • 3.53k • 12

Novaciano/Qwen2.5_Uncensored_V2_Sexting-GGUF

Updated Dec 29, 2024 • 222 • 6

arkii/chatglm2-6b-ggml

Updated Jul 26, 2023 • 6

BUT-FIT/csmpt7b

Text Generation • Updated 2 days ago • 1.64k • 14

pcuenq/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Mar 29, 2024 • 27

reach-vb/phi-2-Q2_K-GGUF

Text Generation • Updated Mar 27, 2024 • 120

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q2_K-GGUF

Updated Jun 19, 2024 • 41

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q8_0-GGUF

Updated Mar 27, 2024 • 5

osanseviero/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Mar 27, 2024 • 2

LeroyDyer/Language_VisionModel_GGUF

Image-Text-to-Text • Updated Aug 26, 2024 • 42 • 2

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q6_K-GGUF

Updated Mar 28, 2024 • 8

jdelpino-ai/mamba-2.8b-hf-Q8_0-GGUF

Updated Mar 30, 2024

jdelpino-ai/multi_verse_model-Q8_0-GGUF

Updated Mar 30, 2024 • 1 • 1

gate369/mm4.star-Q5_K_S-GGUF

Updated Mar 30, 2024 • 1

LeroyDyer/Mixtral_AI_Cyber_Dolphin-Q4_K_M-GGUF

Updated Aug 26, 2024 • 13 • 1

LeroyDyer/Mixtral_AI_Cyber_Orca-Q4_K_M-GGUF

Updated Aug 26, 2024 • 5 • 1

ovieyra21/BigMistral-11b-GLUED-Q8_0-GGUF

Text Generation • Updated Mar 31, 2024 • 1

danielus/MermaidMixtral-3x7b-Q6_K-GGUF

Updated Apr 2, 2024 • 6

danielus/MermaidMixtral-3x7b-Q8_0-GGUF

Updated Apr 2, 2024 • 1

victor/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Apr 2, 2024 • 3

reach-vb/gemma-2b-it-Q4_K_M-GGUF

Updated Apr 3, 2024 • 14

danielus/MermaidSolar-Q8_0-GGUF

Updated Apr 3, 2024 • 3

danielus/MermaidSolar-Q5_K_M-GGUF

Updated Apr 3, 2024 • 7

danielus/MermaidSolar-Q6_K-GGUF

Updated Apr 3, 2024 • 2

danielus/MermaidSolar-Q4_K_S-GGUF

Updated Apr 3, 2024 • 4