Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,957

Full-text search

Active filters: gptq

neuralmagic/Meta-Llama-3-8B-Instruct-quantized.w4a16

Text Generation • Updated Jul 18, 2024 • 261 • 2

Xu-Ouyang/pythia-410m-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 19

neuralmagic/Mistral-7B-Instruct-v0.3-quantized.w4a16

Text Generation • Updated Jul 18, 2024 • 275 • 1

Xu-Ouyang/pythia-6.9b-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 20

Xu-Ouyang/pythia-410m-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 22

Xu-Ouyang/pythia-410m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 22

Xu-Ouyang/pythia-410m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 21

Xu-Ouyang/pythia-410m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 20

Xu-Ouyang/pythia-410m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 21

Xu-Ouyang/pythia-6.9b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 23

Xu-Ouyang/pythia-410m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 22

Xu-Ouyang/pythia-6.9b-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 22

Xu-Ouyang/pythia-6.9b-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 20

Xu-Ouyang/pythia-6.9b-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 19

Xu-Ouyang/pythia-6.9b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 20

Xu-Ouyang/pythia-6.9b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 23

Xu-Ouyang/pythia-6.9b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 21

Xu-Ouyang/pythia-6.9b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 20

Xu-Ouyang/pythia-6.9b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 20

HRuiii/Meta-Llama-3-8B-GPTQ-4bit

Text Generation • Updated Jul 12, 2024 • 17

Xu-Ouyang/pythia-160m-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 22

Xu-Ouyang/pythia-160m-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 20

Xu-Ouyang/pythia-1b-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 22

Xu-Ouyang/pythia-160m-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 21

Xu-Ouyang/pythia-160m-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 19

Xu-Ouyang/pythia-160m-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 21

Xu-Ouyang/pythia-1b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 13, 2024 • 19

Xu-Ouyang/pythia-160m-deduped-int3-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 13, 2024 • 23

Xu-Ouyang/pythia-1.4b-deduped-int3-step86000-GPTQ-wikitext2

Text Generation • Updated Jul 22, 2024 • 20

Xu-Ouyang/pythia-160m-deduped-int3-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 13, 2024 • 22