Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,957

Full-text search

Active filters: gptq

TheBloke/CAMEL-13B-Role-Playing-Data-GPTQ

Text Generation • Updated Sep 27, 2023 • 19 • 13

TheBloke/selfee-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 18 • 2

TheBloke/Vicuna-13B-CoT-GPTQ

Text Generation • Updated Sep 27, 2023 • 14 • 4

TheBloke/Vicuna-7B-CoT-GPTQ

Text Generation • Updated Sep 27, 2023 • 16 • 4

TheBloke/starcoder-GPTQ

Text Generation • Updated Aug 21, 2023 • 59 • 13

TheBloke/starcoderplus-GPTQ

Text Generation • Updated Aug 21, 2023 • 15 • 25

TheBloke/minotaur-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 21 • 6

TheBloke/starchat-beta-GPTQ

Text Generation • Updated Aug 21, 2023 • 14 • 27

TheBloke/open-llama-7b-open-instruct-GPTQ

Text Generation • Updated Aug 21, 2023 • 21 • 6

TheBloke/samantha-1.1-llama-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 16 • 2

TheBloke/airoboros-13B-1.1-GPTQ

Text Generation • Updated Aug 21, 2023 • 16 • 2

TheBloke/tulu-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 18 • 10

TheBloke/samantha-1.1-llama-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 17 • 5

TheBloke/tulu-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 17 • 7

TheBloke/tulu-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 22 • 9

TheBloke/samantha-1.1-llama-33B-GPTQ

Text Generation • Updated Aug 21, 2023 • 18 • 10

TheBloke/airoboros-33b-gpt4-GPTQ

Text Generation • Updated Aug 21, 2023 • 15 • 5

TheBloke/fin-llama-33B-GPTQ

Text Generation • Updated Sep 27, 2023 • 28 • 7

Technotech/RedPajama-Base-3B-4bit-128g

Text Generation • Updated Jul 6, 2023 • 10

TheBloke/chronos-hermes-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 23 • 32

TheBloke/minotaur-13B-fixed-GPTQ

Text Generation • Updated Sep 27, 2023 • 32 • 5

TheBloke/airoboros-33B-gpt4-1.2-GPTQ

Text Generation • Updated Aug 21, 2023 • 14 • 9

TheBloke/airoboros-65B-gpt4-1.2-GPTQ

Text Generation • Updated Aug 21, 2023 • 19 • 11

TheBloke/WizardCoder-15B-1.0-GPTQ

Text Generation • Updated Aug 21, 2023 • 47 • 178

TheBloke/airoboros-7B-gpt4-1.2-GPTQ

Text Generation • Updated Aug 21, 2023 • 17 • 4

TheBloke/airoboros-13B-gpt4-1.2-GPTQ

Text Generation • Updated Aug 21, 2023 • 18 • 7

TheBloke/robin-33B-v2-GPTQ

Text Generation • Updated Aug 21, 2023 • 574 • 13

TheBloke/robin-7B-v2-GPTQ

Text Generation • Updated Aug 21, 2023 • 17 • 2

TheBloke/robin-13B-v2-GPTQ

Text Generation • Updated Aug 21, 2023 • 16 • 10

TheBloke/robin-65B-v2-GPTQ

Text Generation • Updated Aug 21, 2023 • 25 • 9