Edit Models filters

Inference status

Misc

arxiv: 2309.00071

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

448

Full-text search

Active filters: 2309.00071

unsloth/Qwen2.5-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 7.01k • 4

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 6.62k • 10

QuantFactory/Qwen2.5-Coder-7B-GGUF

Text Generation • Updated Sep 19, 2024 • 466 • 2

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

Text Generation • Updated Nov 18, 2024 • 17.4k • 2

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int8

Text Generation • Updated Nov 18, 2024 • 563 • 3

Goekdeniz-Guelmez/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2

Text Generation • Updated Dec 11, 2024 • 3.46k • 6

unsloth/Qwen2.5-14B-Instruct-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 15.6k • 2

unsloth/Qwen2.5-32B-Instruct

Text Generation • Updated Sep 23, 2024 • 2.09k • 1

unsloth/Qwen2.5-Coder-7B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 2.88k • 5

billatsectorflow/Qwen2.5-72B-Instruct-GPTQ-Int4-128K

Text Generation • Updated Dec 7, 2024 • 49 • 1

openthaigpt/openthaigpt1.5-72b-instruct

Text Generation • Updated Nov 15, 2024 • 336 • 8

openthaigpt/openthaigpt1.5-14b-instruct

Text Generation • Updated Nov 15, 2024 • 939 • 5

Qwen/Qwen2.5-Coder-14B

Text Generation • Updated Nov 18, 2024 • 5.13k • 23

Qwen/Qwen2.5-Coder-32B

Text Generation • Updated Nov 18, 2024 • 7.14k • 93

Qwen/Qwen2.5-Coder-14B-Instruct-GPTQ-Int4

Text Generation • Updated Nov 18, 2024 • 2.26k • 2

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int8

Text Generation • Updated Nov 18, 2024 • 13.5k • 15

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 29.6k • 18

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated about 13 hours ago • 2.88k • 5

xingyaoww/Qwen2.5-Coder-32B-Instruct-AWQ-128k

Text Generation • Updated Nov 11, 2024 • 313 • 6

lucyknada/Qwen_Qwen2.5-Coder-14B-Instruct-exl2

Text Generation • Updated Nov 12, 2024 • 6 • 2

QuantFactory/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • Updated Nov 12, 2024 • 117 • 3

lucyknada/Qwen_Qwen2.5-Coder-7B-Instruct-exl2

Text Generation • Updated Nov 13, 2024 • 3 • 2

QuantPanda/Qwen2.5.1-Coder-1.5B-Instruct

Text Generation • Updated Nov 16, 2024 • 30 • 4

imkebe/Qwen2.5-Coder-14B-Instruct-rk3588-1.1.4

Text Generation • Updated 29 days ago • 19 • 1

NousResearch/Yarn-Llama-2-7b-64k

Text Generation • Updated Oct 7, 2023 • 3.8k • 23

NousResearch/Yarn-Llama-2-13b-64k

Text Generation • Updated Sep 4, 2023 • 2.08k • 18

NousResearch/Yarn-Llama-2-13b-128k

Text Generation • Updated Sep 4, 2023 • 4.04k • 114

NousResearch/Yarn-Llama-2-7b-128k

Text Generation • Updated Sep 4, 2023 • 3.8k • 40

TheBloke/Yarn-Llama-2-7B-64K-GGUF

Updated Sep 27, 2023 • 276 • 9

TheBloke/Yarn-Llama-2-7B-64K-GGML

Updated Sep 27, 2023 • 2 • 3