Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

7,749

Full-text search

Active filters: imatrix

bartowski/FuseChat-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated 11 days ago • 1.75k • 4

IntelligentEstate/Kaiju-Warding_AGI_Qwn7B-iMatrxQ4_nl-GGUF

Updated 1 day ago • 35 • 2

mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-i1-GGUF

Updated 8 days ago • 854 • 3

mradermacher/Elusive1.2-8B-Model_Stock-i1-GGUF

Updated 6 days ago • 361 • 2

mradermacher/MISCHIEVOUS-12B-Mix_Neo-i1-GGUF

Updated 5 days ago • 351 • 2

flyingfishinwater/good_and_small_models

Updated Nov 11 • 994 • 2

telosnex/fllama

Updated Sep 25 • 599 • 6

Nexesenex/MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF

Updated Oct 12 • 863 • 69

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated May 4 • 493 • 25

Lewdiculous/InfinityNexus_9B-GGUF-IQ-Imatrix

Updated Mar 14 • 35 • 5

InferenceIllusionist/miqu-evil-dpo-iMat-GGUF

Updated Apr 28 • 149 • 2

bartowski/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated Jun 30 • 2.12k • 47

bartowski/codegemma-1.1-7b-it-GGUF

Text Generation • Updated May 10 • 2.55k • 5

mradermacher/Poppy_Porpoise-0.72-L3-8B-i1-GGUF

Updated 9 days ago • 126 • 5

dddump/Japanese-TextGen-Kage-v0.1-2x7B-gguf

Text Generation • Updated May 19 • 41 • 6

bartowski/Code-Llama-3-8B-GGUF

Text Generation • Updated May 7 • 535 • 8

backyardai/Fimbulvetr-11B-v2-GGUF

Updated May 22 • 1.9k • 7

bartowski/Nxcode-CQ-7B-orpo-GGUF

Text Generation • Updated May 11 • 334 • 7

bartowski/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated May 12 • 564 • 21

lmstudio-community/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated May 13 • 167 • 9

bartowski/dolphin-2.9.1-qwen-110b-GGUF

Text Generation • Updated May 15 • 594 • 2

mradermacher/Ninja-v1-NSFW-RP-i1-GGUF

Updated 9 days ago • 625 • 2

Lewdiculous/L3-8B-Stheno-v3.1-GGUF-IQ-Imatrix

Updated Sep 3 • 1.01k • 90

bartowski/aya-23-8B-GGUF

Text Generation • Updated May 23 • 29.3k • 44

lmstudio-community/aya-23-8B-GGUF

Text Generation • Updated May 23 • 1.72k • 6

legraphista/DeepSeek-V2-Lite-Chat-IMat-GGUF

Text Generation • Updated May 26 • 513 • 8

mradermacher/Mahou-1.2a-llama3-8B-i1-GGUF

Updated 9 days ago • 141 • 2

cognitivecomputations/dolphin-2.9.2-qwen2-72b-gguf

Updated May 29 • 1.39k • 18

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imatrix

Text Generation • Updated Nov 14 • 136 • 7

Lewdiculous/llama-3-Stheno-Mahou-8B-GGUF-IQ-Imatrix

Updated 12 days ago • 648 • 20