Edit Models filters

Inference status

Misc

AutoTrain Compatible

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,692

Full-text search

Active filters: 2-bit

MaziyarPanahi/Qwen2.5-14B-Merge-GGUF

Text Generation • Updated 20 days ago • 227

MaziyarPanahi/Qwen-2.5-14B-MINUS-GGUF

Text Generation • Updated 20 days ago • 147

MaziyarPanahi/UwU-7B-Instruct-GGUF

Text Generation • Updated 20 days ago • 194

MaziyarPanahi/light-3B-GGUF

Text Generation • Updated 19 days ago • 124

gxunda/Qwen2.5-3B-Instruct-2bit-no-act

Updated 19 days ago • 10

MaziyarPanahi/Matsu-7B-GGUF

Text Generation • Updated 19 days ago • 173

MaziyarPanahi/phi-4-GGUF

Text Generation • Updated 18 days ago • 360k • 2

mlx-community/qwen2.5-0.5b-instruct-q2

Text Generation • Updated 18 days ago • 30

MaziyarPanahi/phi3.5_mini_exp_825_uncensored-GGUF

Text Generation • Updated 17 days ago • 398

MaziyarPanahi/phi-2-instruct-v0.1-GGUF

Text Generation • Updated 17 days ago • 115

MaziyarPanahi/phi-2-pytdml-GGUF

Text Generation • Updated 17 days ago • 117

MaziyarPanahi/Phi-3-medium-4k-instruct-GGUF

Text Generation • Updated 17 days ago • 101

MaziyarPanahi/JSL-MedPhi2-2.7B-GGUF

Text Generation • Updated 17 days ago • 123

MaziyarPanahi/Phi-3-mini-4k-instruct-GGUF

Text Generation • Updated 17 days ago • 102

MaziyarPanahi/phi-3-portuguese-tom-cat-4k-instruct-GGUF

Text Generation • Updated 17 days ago • 112

MaziyarPanahi/fietje-2-instruct-GGUF

Text Generation • Updated 17 days ago • 144

mlx-community/phi-4-abliterated-2bit

Text Generation • Updated 17 days ago • 26

CuckmeisterFuller/phi-4-Q2-mlx

Text Generation • Updated 13 days ago • 10

CuckmeisterFuller/Cydonia-v1.2-Magnum-v4-22B-Q2-mlx

Text Generation • Updated 13 days ago • 10

CuckmeisterFuller/Cydonia-22B-v1.2-Q2-mlx

Updated 13 days ago • 5

CuckmeisterFuller/Cydonia-22B-v1.3-Q2-mlx

Updated 12 days ago • 5

lilmeaty/SmolLM2-135M-Instruct-GPTQ

Text Generation • Updated 11 days ago • 16

XelotX/WizardLM-2-8x22B-GGUF

Text Generation • Updated 10 days ago • 16

lilmeaty/SmolLM2-135M-Instruct-GPTQ-2bit

Text Generation • Updated 10 days ago • 14

roleplaiapp/ReaderLM-v2-Q2_K-GGUF

Text Generation • Updated 7 days ago • 20

roleplaiapp/Dria-Agent-a-3B-Q2_K-GGUF

Text Generation • Updated 7 days ago • 28

roleplaiapp/Dria-Agent-a-7B-Q2_K-GGUF

Text Generation • Updated 7 days ago • 29

roleplaiapp/AceInstruct-72B-Q2_K-GGUF

Text Generation • Updated 7 days ago • 24

roleplaiapp/Wayfarer-12B-Q2_K-GGUF

Text Generation • Updated 7 days ago • 2

roleplaiapp/Codestral-22B-v0.1-Q2_K-GGUF

Text Generation • Updated 7 days ago • 21