Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

13,261

Full-text search

Active filters: imatrix

Lewdiculous/L3-8B-Stheno-v3.1-GGUF-IQ-Imatrix

Updated Sep 3, 2024 • 557 • 94

bartowski/aya-23-35B-GGUF

Text Generation • Updated May 23, 2024 • 2.32k • 27

knifeayumu/LLM_Collection

Updated 26 days ago • 12k • 9

mradermacher/Daredevil-8B-abliterated-dpomix-i1-GGUF

Updated Dec 16, 2024 • 2k • 6

mmnga/umiyuki-Umievo-itr012-Gleipnir-7B-gguf

Updated May 29, 2024 • 3.1k • 7

bartowski/Codestral-22B-v0.1-GGUF

Text Generation • Updated Jun 5, 2024 • 5.4k • 186

Lewdiculous/llama-3-Stheno-Mahou-8B-GGUF-IQ-Imatrix

Updated Dec 12, 2024 • 825 • 23

qwp4w3hyb/Codestral-22B-v0.1-iMat-GGUF

Text Generation • Updated Jun 1, 2024 • 206 • 3

Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix

Updated Oct 2, 2024 • 1.55k • 24

Lewdiculous/L3-8B-Stheno-v3.2-GGUF-IQ-Imatrix

Updated Feb 2 • 17.1k • 153

Qwen/Qwen2-72B-Instruct-GGUF

Text Generation • Updated Jun 17, 2024 • 731 • 31

Lewdiculous/Hathor-L3-8B-v.01-GGUF-IQ-Imatrix

Updated Jun 7, 2024 • 104 • 8

mradermacher/Llama-3-Luminurse-v0.2-OAS-8B-i1-GGUF

Updated Feb 7 • 924 • 1

bartowski/Codestral-RAG-19B-Pruned-GGUF

Text Generation • Updated Jun 10, 2024 • 254 • 1

mradermacher/Writing_Partner_Mistral_7B-i1-GGUF

Updated Aug 2, 2024 • 77 • 1

Lewdiculous/llama3-8B-aifeifei-1.3-GGUF-IQ-Imatrix

Updated Jun 12, 2024 • 1.41k • 4

bartowski/L3-70B-Euryale-v2.1-GGUF

Text Generation • Updated Jun 13, 2024 • 263 • 15

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imat-plus2

Text Generation • Updated Nov 14, 2024 • 3.3k • 7

mradermacher/Hathor_RP-v.01-L3-8B-i1-GGUF

Updated Dec 16, 2024 • 303 • 3

mradermacher/Eurstoria-106B-i1-GGUF

Updated 21 days ago • 360 • 1

bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

Text Generation • Updated Jun 20, 2024 • 14.9k • 100

CISCai/DeepSeek-Coder-V2-Lite-Instruct-SOTA-GGUF

Updated Jun 17, 2024 • 525 • 2

mradermacher/DeepSeek-Coder-V2-Lite-Base-i1-GGUF

Updated Aug 2, 2024 • 244 • 2

mradermacher/SuperQwen2-7B-Chat-i1-GGUF

Updated Aug 2, 2024 • 140 • 1

mradermacher/Tess-v2.5-Phi-3-medium-128k-14B-i1-GGUF

Updated Feb 21 • 214 • 3

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 2.03M • 17

bartowski/magnum-72b-v1-GGUF

Text Generation • Updated Jun 23, 2024 • 281 • 11

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated Jun 20, 2024 • 1.46k • 5

bartowski/DeepSeek-Coder-V2-Instruct-GGUF

Text Generation • Updated Jun 23, 2024 • 979 • 31

legraphista/RoLlama3-8b-Instruct-IMat-GGUF

Text Generation • Updated Jun 23, 2024 • 708 • 3