Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,057

Full-text search

Active filters: gptq

Xu-Ouyang/pythia-1.4b-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 12

Xu-Ouyang/pythia-1.4b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 12

Xu-Ouyang/pythia-1.4b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 12

Xu-Ouyang/pythia-1.4b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 12

Xu-Ouyang/pythia-1.4b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 12

Xu-Ouyang/pythia-1.4b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 11

Xu-Ouyang/pythia-12b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 11

Intern95/opt-1.3b-gptq

Text Generation • Updated Jul 10, 2024 • 11

Xu-Ouyang/pythia-12b-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 12

Xu-Ouyang/pythia-12b-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 11

jcorenday/Daredevil-8B-GPTQ

Text Generation • Updated Jul 10, 2024 • 13

HRuiii/Meta-Llama-3-8B-GPTQ-8bit

Text Generation • Updated Jul 10, 2024 • 6

HRuiii/Meta-Llama-3-8B-Instruct-GPTQ-8bit

Text Generation • Updated Jul 10, 2024 • 4

neuralmagic/Mistral-7B-Instruct-v0.3-quantized.w8a16

Text Generation • Updated Jul 18, 2024 • 508

Xu-Ouyang/pythia-2.8b-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 12

Xu-Ouyang/pythia-2.8b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 12

Xu-Ouyang/pythia-12b-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 12

Xu-Ouyang/pythia-2.8b-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 16

Xu-Ouyang/pythia-2.8b-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 12

Xu-Ouyang/pythia-12b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 18, 2024 • 12

Xu-Ouyang/pythia-2.8b-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 12

Xu-Ouyang/pythia-2.8b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 15

Xu-Ouyang/pythia-2.8b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 12

ShawnFlower/Meta-Llama-3-8B-Instruct-4bit

Text Generation • Updated Jul 11, 2024 • 19

Xu-Ouyang/pythia-2.8b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 18, 2024 • 15

Xu-Ouyang/pythia-12b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 18, 2024 • 12

Xu-Ouyang/pythia-2.8b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 18, 2024 • 12

Xu-Ouyang/pythia-2.8b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 18, 2024 • 16

Xu-Ouyang/pythia-12b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 14

HRuiii/Meta-Llama-3-8B-Instruct-GPTQ-4bit

Text Generation • Updated Jul 11, 2024 • 4