Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

35,756

Full-text search

Active filters: bitsandbytes

unsloth/Mistral-Small-Instruct-2409-bnb-4bit

Updated Nov 22, 2024 • 2.55k • 3

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated Feb 6 • 765k • 11

unsloth/Qwen2.5-7B-bnb-4bit

Text Generation • Updated Feb 6 • 5.53k • 4

unsloth/Qwen2.5-72B-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 889 • 1

unsloth/Qwen2.5-3B-Instruct-bnb-4bit

Text Generation • Updated Feb 6 • 8.6k • 7

unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit

Text Generation • Updated Feb 6 • 18.9k • 2

unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • Updated Feb 6 • 24k • 4

unsloth/Qwen2.5-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 28.1k • 7

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 13.4k • 12

unsloth/Qwen2.5-1.5B-bnb-4bit

Text Generation • Updated Feb 6 • 4.87k • 1

unsloth/Qwen2.5-0.5B-bnb-4bit

Text Generation • Updated Feb 6 • 4.73k • 1

nroggendorff/mistral-pro-quantized

Text Generation • Updated Sep 22, 2024 • 29 • 1

unsloth/Qwen2.5-14B-bnb-4bit

Text Generation • Updated Feb 6 • 1.48k • 5

unsloth/Qwen2.5-14B-Instruct-bnb-4bit

Text Generation • Updated Feb 6 • 36.9k • 7

unsloth/Qwen2.5-Math-1.5B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 517 • 1

unsloth/Qwen2.5-Math-7B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 858 • 3

unsloth/Qwen2.5-Math-1.5B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 1.68k • 1

unsloth/Qwen2.5-Math-7B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 3.17k • 3

unsloth/Qwen2.5-Coder-1.5B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 1.87k • 2

unsloth/Qwen2.5-Coder-7B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 5.24k • 7

unsloth/Qwen2.5-Coder-1.5B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 3.74k • 1

unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 15.4k • 6

SeanScripts/pixtral-12b-nf4

Image-Text-to-Text • Updated Sep 26, 2024 • 299 • 20

dalau627/text-to-sql-finetuned

Text Generation • Updated Sep 26, 2024 • 52 • 1

unsloth/Llama-3.2-1B-bnb-4bit

Text Generation • Updated Jan 22 • 31.9k • 13

unsloth/Llama-3.2-1B-Instruct-bnb-4bit

Text Generation • Updated Jan 23 • 140k • 14

unsloth/Llama-3.2-3B-bnb-4bit

Text Generation • Updated Jan 23 • 24.1k • 10

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated Jan 23 • 50.7k • 18

unsloth/Llama-3.2-11B-Vision-bnb-4bit

Image-Text-to-Text • Updated Nov 22, 2024 • 1.02k • 16

unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated Dec 10, 2024 • 19.8k • 73