Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,450

Full-text search

Active filters: gptq

Xu-Ouyang/pythia-410m-deduped-int3-step107000-GPTQ-wikitext2

Text Generation • Updated Jun 28, 2024 • 6

Xu-Ouyang/pythia-2.8b-deduped-int3-step107000-GPTQ-wikitext2

Text Generation • Updated Jun 28, 2024 • 6

Xu-Ouyang/pythia-2.8b-deduped-int4-step36000-GPTQ-wikitext2

Text Generation • Updated Jun 28, 2024 • 6

Xu-Ouyang/pythia-6.9b-deduped-int4-step36000-GPTQ-wikitext2

Text Generation • Updated Jun 28, 2024 • 6

Xu-Ouyang/pythia-2.8b-deduped-int3-step36000-GPTQ-wikitext2

Text Generation • Updated Jun 28, 2024 • 6

elysiantech/llama-3-8b-gptq-4bit

Text Generation • Updated Jun 28, 2024 • 10

Xu-Ouyang/pythia-6.9b-deduped-int4-step107000-GPTQ-wikitext2

Text Generation • Updated Jun 28, 2024 • 6

Xu-Ouyang/pythia-6.9b-deduped-int3-step36000-GPTQ-wikitext2

Text Generation • Updated Jun 28, 2024 • 7

Granther/Phi3-128k-Instruct-4Bit-GPTQ

Text Generation • Updated Jul 1, 2024 • 104

Xu-Ouyang/pythia-6.9b-deduped-int3-step107000-GPTQ-wikitext2

Text Generation • Updated Jun 28, 2024 • 8

agahebr/magnum-gptq

Text Generation • Updated Jun 29, 2024 • 18

Lkynnn/Quantized_opt-125m

Text Generation • Updated Jun 28, 2024 • 6

elysiantech/gemma-2b-gptq-4bit

Text Generation • Updated Jul 6, 2024 • 15

Xu-Ouyang/pythia-1.4b-deduped-int4-step36000-GPTQ-wikitext2

Text Generation • Updated Jun 28, 2024 • 9

kaitchup/Llama-3-8B-4bit-AutoRound-GPTQ

Text Generation • Updated Jun 28, 2024

kaitchup/Llama-3-8B-4bit-Symm-AutoRound-GPTQ

Text Generation • Updated Jun 28, 2024

Xu-Ouyang/pythia-1.4b-deduped-int4-step107000-GPTQ-wikitext2

Text Generation • Updated Jun 28, 2024 • 6

ramitpahwa13/OpenHermes-2.5-Mistral-7B-Pruned50-GPTQ-Marlin

Text Generation • Updated Jun 28, 2024 • 6

Xu-Ouyang/pythia-12b-deduped-int4-step36000-GPTQ-wikitext2

Text Generation • Updated Jun 28, 2024 • 6

Xu-Ouyang/pythia-12b-deduped-int4-step71000-GPTQ-wikitext2

Text Generation • Updated Jun 28, 2024 • 6

Xu-Ouyang/pythia-12b-deduped-int4-step107000-GPTQ-wikitext2

Text Generation • Updated Jun 29, 2024 • 6

elysiantech/phi-3-mini-4k-instruct-gptq-4bit

Text Generation • Updated Jul 6, 2024 • 284

Xu-Ouyang/pythia-12b-deduped-int4-step110000-GPTQ-wikitext2

Text Generation • Updated Jun 29, 2024 • 6

Xu-Ouyang/pythia-12b-deduped-int4-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 1, 2024 • 63

Xu-Ouyang/pythia-12b-deduped-int3-step36000-GPTQ-wikitext2

Text Generation • Updated Jun 29, 2024 • 6

Xu-Ouyang/pythia-12b-deduped-int3-step71000-GPTQ-wikitext2

Text Generation • Updated Jun 29, 2024 • 6

Xu-Ouyang/pythia-12b-deduped-int3-step107000-GPTQ-wikitext2

Text Generation • Updated Jun 29, 2024 • 64

Xu-Ouyang/pythia-12b-deduped-int3-step110000-GPTQ-wikitext2

Text Generation • Updated Jun 29, 2024 • 63

Xu-Ouyang/pythia-12b-deduped-int3-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 1, 2024 • 63

acl-srw-2024/llama-3-typhoon-v1.5-8b-instruct-unsloth-sft-epoch-3-gptq-2bit

Text Generation • Updated Jun 29, 2024 • 6