Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

12,620

Full-text search

Active filters: imatrix

bartowski/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 11.7k • 35

NeoChen1024/dolphin-2.7-mixtral-8x7b-GGUF-IQ3_M

Updated Sep 17, 2024 • 21 • 1

bartowski/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 12k • 56

mradermacher/MN-12B-Mag-Mell-R1-i1-GGUF

Updated Sep 18, 2024 • 1.36k • 9

mradermacher/MN-Halide-12b-v1.0-i1-GGUF

Updated Sep 18, 2024 • 4.51k • 4

bartowski/Qwen2.5-Math-72B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 2.73k • 2

mradermacher/L3-Dark-Planet-8B-V2-Eight-Orbs-Of-Power-i1-GGUF

Updated Sep 19, 2024 • 835 • 2

v000000/L3.1-Niitorm-8B-DPO-t0.0001-GGUFs-IMATRIX

Updated Oct 6, 2024 • 129 • 4

mradermacher/L3.1-Niitorm-8B-DPO-t0.0001-i1-GGUF

Updated Sep 20, 2024 • 534 • 3

bartowski/Qwen2.5-32B-AGI-GGUF

Text Generation • Updated Sep 22, 2024 • 15.2k • 41

mradermacher/Acolyte-22B-i1-GGUF

Updated Sep 23, 2024 • 458 • 2

bartowski/Llama-3_1-Nemotron-51B-Instruct-GGUF

Text Generation • Updated Jan 1 • 5.28k • 6

mradermacher/Spartan_v2.0-i1-GGUF

Updated Sep 25, 2024 • 90 • 1

mradermacher/2B-ad-i1-GGUF

Updated Jan 26 • 119 • 1

mradermacher/Qwen2.5-1.5B-Instruct-i1-GGUF

Updated Oct 10, 2024 • 304 • 1

mradermacher/Qwen2.5-32B-AGI-i1-GGUF

Updated Sep 26, 2024 • 716 • 1

mradermacher/Qwen2.5-14B-i1-GGUF

Updated Oct 10, 2024 • 292 • 2

mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF

Updated Sep 26, 2024 • 1.52k • 7

DavidAU/Llama-3.2-3B-Instruct-NEO-SI-FI-GGUF

Text Generation • Updated Nov 14, 2024 • 958 • 6

mradermacher/PowerMoE-3b-i1-GGUF

Updated Feb 6 • 81 • 1

mradermacher/Gemma-The-Writer-9B-i1-GGUF

Updated Sep 27, 2024 • 1.22k • 4

alfredplpl/llm-jp-3-3.7b-instruct-gguf

Updated Oct 3, 2024 • 184 • 8

alfredplpl/llm-jp-3-13b-instruct-gguf

Updated Oct 3, 2024 • 204 • 7

mradermacher/Llama-3.2-3B-Instruct-uncensored-i1-GGUF

Updated Sep 28, 2024 • 3.38k • 7

Lewdiculous/Violet_Twilight-v0.2-GGUF-IQ-Imatrix

Updated Nov 13, 2024 • 2.46k • 16

bartowski/CalmeRys-78B-Orpo-v0.1-GGUF

Text Generation • Updated Sep 30, 2024 • 799 • 7

mradermacher/Lyra4-Gutenberg2-12B-i1-GGUF

Updated Oct 11, 2024 • 632 • 4

alfredplpl/gemma-2-2b-jpn-it-gguf

Updated Dec 18, 2024 • 923 • 19

alfredplpl/gemma-2-baku-2b-it-gguf

Updated Dec 18, 2024 • 307 • 9

bartowski/Llama-3.1-WhiteRabbitNeo-2-70B-GGUF

Text Generation • Updated Oct 5, 2024 • 526 • 4