Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,837

Full-text search

Active filters: gptq

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 18 • 10.3k • 9

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 33.2k • 12

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 5.52k • 12

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 16.9k • 21

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 6k • 8

Qwen/Qwen2.5-Coder-1.5B-Instruct-GPTQ-Int4

Text Generation • Updated Nov 18 • 441 • 1

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

Text Generation • Updated Nov 18 • 29.9k • 1

billatsectorflow/Qwen2.5-72B-Instruct-GPTQ-Int4-128K

Text Generation • Updated 18 days ago • 518 • 1

qilowoq/Vikhr-Nemo-12B-Instruct-R-21-09-24-4Bit-GPTQ

Text Generation • Updated Sep 29 • 1.68k • 3

xmadai/Llama-3.1-405B-Instruct-xMADai-INT4

Text Generation • Updated Oct 30 • 270 • 6

AIDC-AI/Ovis1.6-Gemma2-9B-GPTQ-Int4

Image-Text-to-Text • Updated about 1 month ago • 791 • 8

xmadai/Llama-3.2-3B-Instruct-xMADai-INT4

Text Generation • Updated Oct 24 • 101 • 6

xmadai/Llama-3.2-1B-Instruct-xMADai-4bit

Text Generation • Updated Oct 17 • 177 • 5

nejumi/Llama-3.1-Nemotron-70B-Instruct-HF-GPTQ-Int8-calib-ja-1k

Text Generation • Updated Oct 30 • 38 • 1

xmadai/Mistral-Small-Instruct-2409-xMADai-INT4

Text Generation • Updated Oct 24 • 70 • 5

xmadai/Llama-3.1-8B-Instruct-xMADai-INT4

Text Generation • Updated Oct 24 • 3.98k • 5

shuyuej/Llama-3.1-Nemotron-70B-Instruct-HF-GPTQ

Updated Oct 22 • 324 • 1

tb423/internlm2_5-7b-chat-gptq-c4-8bit

Feature Extraction • Updated Oct 24 • 47 • 1

xmadai/Mistral-Large-Instruct-2407-xMADai-INT4

Text Generation • Updated Oct 30 • 112 • 6

xmadai/gemma-2-9b-it-xMADai-INT4

Text Generation • Updated Oct 30 • 14 • 4

AIDC-AI/Ovis1.6-Llama3.2-3B-GPTQ-Int4

Image-Text-to-Text • Updated Nov 11 • 144 • 4

xmadai/Llama-3.1-Nemotron-70B-Instruct-xMADai-INT4

Text Generation • Updated Oct 30 • 444 • 4

ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2

Text Generation • Updated Nov 11 • 33 • 3

ModelCloud/Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3

Text Generation • Updated Nov 11 • 1.62k • 4

divyachand/google-gemma-2-9b-q

Text Generation • Updated Nov 2 • 17 • 1

Qwen/Qwen2.5-Coder-14B-Instruct-GPTQ-Int8

Text Generation • Updated Nov 18 • 1.91k • 1

Qwen/Qwen2.5-Coder-14B-Instruct-GPTQ-Int4

Text Generation • Updated Nov 18 • 3.47k • 2

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int8

Text Generation • Updated Nov 18 • 17.2k • 15

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation • Updated Nov 18 • 9.27k • 8

2z299/aya-expanse-32b-GPTQ-4bit

Text Generation • Updated Nov 12 • 223 • 1