Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,389

Full-text search

Active filters: 4-bit

unsloth/Qwen2.5-72B-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 815 • 1

unsloth/Qwen2.5-3B-Instruct-bnb-4bit

Text Generation • Updated Feb 6 • 11.5k • 7

mlx-community/Qwen2.5-Math-72B-Instruct-4bit

Text Generation • Updated Sep 18, 2024 • 179 • 1

unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit

Text Generation • Updated Feb 6 • 6.16k • 1

unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • Updated Feb 6 • 10.3k • 3

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 14.5k • 11

unsloth/Qwen2.5-1.5B-bnb-4bit

Text Generation • Updated Feb 6 • 4.92k • 1

IntelLabs/sqft-phi-3-mini-4k-instruct-base-gptq

Text Generation • Updated 29 days ago • 185 • 2

Qwen/Qwen2.5-Coder-1.5B-Instruct-GPTQ-Int4

Text Generation • Updated Nov 18, 2024 • 363 • 2

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

Text Generation • Updated Nov 18, 2024 • 27.8k • 6

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 4.48k • 12

Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 23.1k • 3

solidrust/Gemma-2-Ataraxy-9B-AWQ

Text Generation • Updated Sep 20, 2024 • 240 • 2

unsloth/Qwen2.5-0.5B-bnb-4bit

Text Generation • Updated Feb 6 • 5.37k • 1

nroggendorff/mistral-pro-quantized

Text Generation • Updated Sep 22, 2024 • 32 • 1

unsloth/Qwen2.5-14B-bnb-4bit

Text Generation • Updated Feb 6 • 1.58k • 5

IntelLabs/sqft-mistral-7b-v0.3-base-gptq

Text Generation • Updated 29 days ago • 339 • 2

unsloth/Qwen2.5-14B-Instruct-bnb-4bit

Text Generation • Updated Feb 6 • 18.2k • 7

unsloth/Qwen2.5-Math-1.5B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 801 • 1

unsloth/Qwen2.5-Math-7B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 970 • 2

unsloth/Qwen2.5-Math-1.5B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 2.54k • 1

unsloth/Qwen2.5-Math-7B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 5.68k • 3

unsloth/Qwen2.5-Coder-1.5B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 2.33k • 2

unsloth/Qwen2.5-Coder-7B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 5.35k • 7

unsloth/Qwen2.5-Coder-1.5B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 6.28k • 1

unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 11.8k • 6

SeanScripts/pixtral-12b-nf4

Image-Text-to-Text • Updated Sep 26, 2024 • 939 • 20

dalau627/text-to-sql-finetuned

Text Generation • Updated Sep 26, 2024 • 78 • 1

unsloth/Llama-3.2-1B-bnb-4bit

Text Generation • Updated Jan 22 • 28.9k • 12

unsloth/Llama-3.2-1B-Instruct-bnb-4bit

Text Generation • Updated Jan 23 • 93.2k • 14