Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

14,818

Full-text search

Active filters: bitsandbytes

ascktgcc/Mistral-Nemo-Japanese-Instruct-2408-bnb-4bit

Text Generation • Updated Oct 22 • 67 • 1

sayakpaul/sd35-large-nf4

Text-to-Image • Updated Oct 27 • 5

rwitz/cat0.1

Text Generation • Updated Oct 23 • 26 • 1

YouSSeung/Llama-YSH-ko-3-8B

Updated Oct 24 • 7 • 1

ronmasas/omniparser-8bit

Updated Oct 26 • 13 • 2

ronmasas/omniparser-4bit

Updated Oct 26 • 8 • 1

yuchenxie/ArlowGPT-VL-OCR

Image-Text-to-Text • Updated Nov 17 • 8 • 1

amornpan/openthaigpt1.5-14b-MedChatModelV1

Text Generation • Updated Nov 4 • 19 • 1

unsloth/SmolLM2-1.7B-bnb-4bit

Text Generation • Updated Oct 31 • 331 • 1

automatedstockminingorg/14b-stockanalyst-14b-stockanalyst

Text Generation • Updated Nov 2 • 20 • 1

imnotednamode/mochi-1-preview-mix-nf4

Updated Nov 11 • 30 • 5

imnotednamode/mochi-1-preview-mix-nf4-small

Updated Nov 11 • 57 • 7

juhoon01/ko_llama3_model_shinhan_2

Text Generation • Updated Nov 4 • 22 • 1

indexxlim/gemma-2-it-test

Text Generation • Updated Nov 6 • 15 • 1

MahmoudIbrahim/Mistral_Nemo_Arabic

Text Generation • Updated Nov 20 • 30 • 1

theprint/ReWiz-Qwen-2.5-14B

Text Generation • Updated Nov 14 • 378 • 5

cmarkea/Qwen2.5-Coder-7B-Instruct-4bit

Text Generation • Updated Nov 14 • 36 • 2

unsloth/Qwen2.5-Coder-0.5B-Instruct-bnb-4bit

Text Generation • Updated Nov 12 • 7.87k • 1

unsloth/Qwen2.5-Coder-3B-Instruct-bnb-4bit

Text Generation • Updated Nov 12 • 2.59k • 1

RichardErkhov/chatdb_-_natural-sql-7b-4bits

Updated Nov 12 • 5 • 1

cmarkea/Qwen2.5-32B-Instruct-4bit

Text Generation • Updated Nov 14 • 40 • 2

crce9598/Llama3.2-Code-Instruct-Finetune-IPAM

Text Generation • Updated Nov 15 • 1

KnutJaegersberg/Athene-V2-Chat-72B-4bit

Text Generation • Updated Nov 15 • 201 • 3

memaxo/kevn-coder-32b-0.2-quantized-4bit

Text Generation • Updated Nov 17 • 44 • 1

SandeepKumarRudhravaram/gemma2b_lungcancerqa

Text Generation • Updated Nov 18 • 57 • 2

unsloth/Qwen2-VL-7B-Instruct-bnb-4bit

Image-Text-to-Text • Updated Nov 22 • 8.3k • 3

unsloth/Pixtral-12B-2409-bnb-4bit

Image-Text-to-Text • Updated Nov 21 • 1.59k • 2

vakodiya/Llama-3-8B-instruct-4bit-salesbot

Text Generation • Updated Nov 21 • 40 • 1

unsloth/Qwen2-VL-72B-Instruct-bnb-4bit

Image-Text-to-Text • Updated Nov 22 • 946 • 2

unsloth/llava-v1.6-mistral-7b-hf-bnb-4bit

Image-Text-to-Text • Updated Nov 21 • 20.2k • 1