Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

21,127

Full-text search

Active filters: 4-bit

ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2.5

Text Generation • Updated Nov 11, 2024 • 680 • 5

waldie/EVA-Qwen2.5-32B-v0.2-4bpw-h6-exl2

Text Generation • Updated Nov 8, 2024 • 55 • 2

Qwen/Qwen2.5-Coder-14B-Instruct-GPTQ-Int4

Text Generation • Updated Nov 18, 2024 • 2.26k • 2

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 29.6k • 18

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated about 22 hours ago • 2.88k • 5

Qwen/Qwen2.5-Coder-3B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 531 • 3

mlx-community/Qwen2.5-Coder-14B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 158k • 3

mlx-community/Qwen2.5-Coder-0.5B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 192 • 2

mlx-community/Qwen2.5-Coder-3B-4bit

Text Generation • Updated Nov 12, 2024 • 58 • 1

xingyaoww/Qwen2.5-Coder-32B-Instruct-AWQ-128k

Text Generation • Updated Nov 11, 2024 • 313 • 6

lmstudio-community/Qwen2.5-32B-Instruct-MLX-4bit

Text Generation • Updated Nov 13, 2024 • 149 • 1

lmstudio-community/Qwen2.5-Coder-32B-Instruct-MLX-4bit

Text Generation • Updated Nov 13, 2024 • 281 • 2

lmstudio-community/Qwen2.5-Coder-14B-Instruct-MLX-4bit

Text Generation • Updated Nov 13, 2024 • 422 • 1

unsloth/Qwen2.5-Coder-3B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 1.08k • 1

unsloth/Qwen2.5-Coder-3B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 1.49k • 1

RichardErkhov/chatdb_-_natural-sql-7b-4bits

Updated Nov 12, 2024 • 4 • 1

kaitchup/Qwen2.5-Coder-32B-Instruct-AutoRound-GPTQ-4bit

Text Generation • Updated Nov 15, 2024 • 90 • 2

async0x42/Rombos-Coder-V2.5-Qwen-32b-exl2_4.0bpw

Text Generation • Updated Nov 16, 2024 • 23 • 1

memaxo/kevn-coder-32b-0.2-quantized-4bit

Text Generation • Updated Nov 17, 2024 • 28 • 1

unsloth/Qwen2-VL-7B-Instruct-bnb-4bit

Image-Text-to-Text • Updated Nov 22, 2024 • 677 • 4

unsloth/Qwen2-VL-72B-Instruct-bnb-4bit

Image-Text-to-Text • Updated Nov 22, 2024 • 710 • 2

ivanfioravanti/QwQ-32B-Preview-4bit

Text Generation • Updated Nov 27, 2024 • 37 • 2

unsloth/QwQ-32B-Preview-bnb-4bit

Text Generation • Updated Nov 28, 2024 • 3.22k • 2

mlx-community/Qwen_QwQ-32B-Preview_MLX-4bit

Text Generation • Updated Nov 28, 2024 • 87 • 1

kosbu/Athene-V2-Chat-AWQ

Text Generation • Updated Nov 29, 2024 • 1.18k • 5

unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated Dec 4, 2024 • 41.9k • 15

unsloth/Qwen2-VL-2B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated Dec 4, 2024 • 10.4k • 4

unsloth/Qwen2-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated Dec 4, 2024 • 15.9k • 7

unsloth/QwQ-32B-Preview-unsloth-bnb-4bit

Text Generation • Updated Dec 6, 2024 • 890 • 15

salmancadae2121/QwQ-32B-Preview-Q4-mlx

Text Generation • Updated Nov 30, 2024 • 33 • 1