Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

9,530

Full-text search

Active filters: imatrix

fuzzy-mittenz/Hammer2.1-3b-Q5_K_S-GGUF

Updated Dec 26, 2024 • 13 • 1

mradermacher/Magnum-v4-Cydonia-v1.3-22B-2-i1-GGUF

Updated Dec 26, 2024 • 858 • 1

fuzzy-mittenz/Thoth-Llama3.2-3B-IQ4_NL-GGUF

Updated about 1 month ago • 31 • 1

IntelligentEstate/Thoth_Warding-Llama-3B-IQ5_K_S-GGUF

Updated 15 days ago • 53 • 3

mradermacher/e.star.7.b-i1-GGUF

Updated about 13 hours ago • 401 • 1

mradermacher/flammen14-mistral-7B-i1-GGUF

Updated about 13 hours ago • 488 • 1

mradermacher/LLama-3-8b-Uncensored-i1-GGUF

Updated 28 days ago • 997 • 2

mradermacher/granite-3b-code-instruct-128k-i1-GGUF

Updated 29 days ago • 545 • 1

mradermacher/Ninja-V3-i1-GGUF

Updated about 13 hours ago • 459 • 1

Lewdiculous/Captain-Eris-Diogenes_Twilight-V0.420-12B-GGUF-ARM-Imatrix

Updated 22 days ago • 2.54k • 10

bartowski/SmallThinker-3B-Preview-GGUF

Text Generation • Updated 28 days ago • 83.2k • 26

bartowski/Qwen2.5-32b-RP-Ink-GGUF

Text Generation • Updated 27 days ago • 2.65k • 1

mradermacher/Saul-Nous-Hermes-2-Mistral-7B-DPO-Ties-i1-GGUF

Updated about 13 hours ago • 597 • 1

mradermacher/32B-Qwen2.5-Kunou-v1-i1-GGUF

Updated 27 days ago • 1.45k • 1

mradermacher/Qwen2.5-Coder-Scholar-7B-Abliterated-MFANN-i1-GGUF

Updated 25 days ago • 167 • 1

mradermacher/merging_LLM-i1-GGUF

Updated 3 days ago • 551 • 1

mradermacher/visionparser-vl-expert-i1-GGUF

Updated 24 days ago • 1.3k • 1

mradermacher/Qwen2.5-7B-nerd-uncensored-v0.9-MFANN-i1-GGUF

Updated 24 days ago • 2.32k • 2

mradermacher/Hercules-Mini-1.8B-i1-GGUF

Updated 23 days ago • 538 • 1

bartowski/32B-Qwen2.5-Kunou-v1-GGUF

Text Generation • Updated 23 days ago • 3.43k • 2

bartowski/Qwentile2.5-32B-Instruct-GGUF

Text Generation • Updated 23 days ago • 1.68k • 5

mradermacher/Rude-Assistant-Qwen2-7b-SFT-i1-GGUF

Updated 5 days ago • 620 • 1

mmnga/DeepSeek-V3-slice-jp64-gguf

Updated 22 days ago • 1.32k • 6

bartowski/Dolphin3.0-Llama3.1-8B-GGUF

Text Generation • Updated 22 days ago • 4.55k • 5

bartowski/Dolphin3.0-Qwen2.5-3b-GGUF

Text Generation • Updated 22 days ago • 5.38k • 7

nisten/zelensky-78b-gguf

Updated 20 days ago • 246 • 1

bartowski/70B-L3.3-Cirrus-x1-GGUF

Text Generation • Updated 19 days ago • 4.99k • 2

mradermacher/deepthought-8b-llama-v0.01-alpha-i1-GGUF

Updated 17 days ago • 681 • 1

bartowski/QwQ-32B-Preview-IdeaWhiz-v1-GGUF

Text Generation • Updated 18 days ago • 1.34k • 2

bartowski/MiniThinky-v2-1B-Llama-3.2-GGUF

Text Generation • Updated 18 days ago • 2.02k • 1