Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

227

Full-text search

Active filters: autogptq

fbaldassarri/EleutherAI_pythia-12b-deduped-autogptq-int4-gs128-sym

Text Generation • Updated Dec 19, 2024 • 7

fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_gptq-int4-gs128-asym

Text Generation • Updated Jan 4 • 10

fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_gptq-int4-gs128-sym

Text Generation • Updated Jan 4 • 13

fbaldassarri/allenai_OLMo-2-1124-7B-Instruct-autogptq-int4-gs128-asym

Text Generation • Updated Dec 22, 2024 • 7

fbaldassarri/allenai_OLMo-2-1124-7B-Instruct-autogptq-int4-gs128-sym

Text Generation • Updated Dec 22, 2024 • 9

fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autogptq-int4-gs128-asym

Text Generation • Updated Dec 28, 2024 • 8

fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autogptq-int4-gs128-sym

Text Generation • Updated Dec 28, 2024 • 6

fbaldassarri/sapienzanlp_Minerva-7B-base-v1.0-autogptq-int4-gs128-asym

Text Generation • Updated Dec 28, 2024 • 6

fbaldassarri/sapienzanlp_Minerva-7B-base-v1.0-autogptq-int4-gs128-sym

Text Generation • Updated Dec 28, 2024 • 9

fbaldassarri/sapienzanlp_Minerva-7B-instruct-v1.0-autogptq-int4-gs128-asym

Text Generation • Updated Dec 28, 2024 • 8

fbaldassarri/sapienzanlp_Minerva-7B-instruct-v1.0-autogptq-int4-gs128-sym

Text Generation • Updated Dec 29, 2024 • 6

fbaldassarri/sapienzanlp_Minerva-1B-base-v1.0-autogptq-int4-gs128-asym

Text Generation • Updated Dec 29, 2024 • 9

fbaldassarri/sapienzanlp_Minerva-3B-base-v1.0-autogptq-int4-gs128-asym

Text Generation • Updated Dec 30, 2024 • 10

fbaldassarri/sapienzanlp_Minerva-1B-base-v1.0-autogptq-int4-gs128-sym

Text Generation • Updated Dec 30, 2024 • 7

fbaldassarri/sapienzanlp_Minerva-3B-base-v1.0-autogptq-int4-gs128-sym

Text Generation • Updated Dec 30, 2024 • 8

fbaldassarri/iGeniusAI_Italia-9B-Instruct-v0.1-autogptq-int4-gs128-asym

Text Generation • Updated Jan 7 • 10

fbaldassarri/iGeniusAI_Italia-9B-Instruct-v0.1-autogptq-int4-gs128-sym

Text Generation • Updated Jan 7 • 12

fbaldassarri/meta-llama_Llama-3.2-1B-auto_gptq-int8-gs128-sym

Text Generation • Updated Jan 9 • 11

fbaldassarri/meta-llama_Llama-3.2-1B-auto_gptq-int8-gs128-asym

Text Generation • Updated Jan 10 • 16

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int8-gs128-asym

Text Generation • Updated Jan 9 • 14

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int8-gs128-sym

Text Generation • Updated Jan 9 • 11

fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs128-asym

Text Generation • Updated Jan 10 • 12

fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs128-sym

Text Generation • Updated Jan 10 • 8

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs128-asym

Text Generation • Updated Jan 10 • 24

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs128-sym

Text Generation • Updated Jan 10 • 7

fbaldassarri/allenai_OLMo-2-1124-13B-autogptq-int4-gs128-asym

Text Generation • Updated Jan 12 • 8

fbaldassarri/allenai_OLMo-2-1124-13B-autogptq-int4-gs128-sym

Text Generation • Updated Jan 12 • 8

fbaldassarri/allenai_OLMo-2-1124-13B-Instruct-autogptq-int4-gs128-asym

Text Generation • Updated Jan 14 • 9

fbaldassarri/allenai_OLMo-2-1124-13B-Instruct-autogptq-int4-gs128-sym

Text Generation • Updated Jan 14 • 7

fbaldassarri/mistralai_Mistral-7B-v0.3-autogptq-int4-gs128-asym

Text Generation • Updated Jan 17 • 8