Edit Models filters

Inference status

Misc

arxiv: 2309.00071

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

448

Full-text search

Active filters: 2309.00071

Qwen/Qwen2.5-Coder-32B-Instruct

Text Generation • Updated about 11 hours ago • 264k • 1.44k

Qwen/Qwen2.5-7B-Instruct

Text Generation • Updated about 11 hours ago • 1.56M • 416

Qwen/Qwen2.5-72B-Instruct

Text Generation • Updated about 11 hours ago • 102k • 667

Qwen/Qwen2.5-14B-Instruct

Text Generation • Updated Sep 25, 2024 • 266k • 158

Qwen/Qwen2.5-32B-Instruct

Text Generation • Updated Sep 25, 2024 • 243k • 172

Qwen/Qwen2.5-Coder-7B-Instruct

Text Generation • Updated about 11 hours ago • 106k • 383

Qwen/Qwen2.5-Coder-14B-Instruct

Text Generation • Updated about 11 hours ago • 17k • 70

gradientai/Llama-3-8B-Instruct-Gradient-1048k

Text Generation • Updated Oct 29, 2024 • 4.53k • 680

Qwen/Qwen2-7B-Instruct

Text Generation • Updated Aug 21, 2024 • 784k • 607

gradientai/Llama-3-8B-Instruct-262k

Text Generation • Updated Oct 28, 2024 • 9.79k • 258

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 18, 2024 • 21.6k • 12

openthaigpt/openthaigpt1.5-7b-instruct

Text Generation • Updated Nov 15, 2024 • 1.16k • 11

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation • Updated Nov 18, 2024 • 3.3k • 11

lightonai/alfred-40b-1023

Text Generation • Updated Feb 13, 2024 • 1.15k • 46

gradientai/Llama-3-8B-Instruct-Gradient-4194k

Text Generation • Updated Oct 28, 2024 • 273 • 70

Qwen/Qwen2-72B-Instruct

Text Generation • Updated Oct 8, 2024 • 36.8k • 694

Qwen/Qwen2-57B-A14B-Instruct

Text Generation • Updated Aug 21, 2024 • 6.19k • 78

Qwen/Qwen2.5-Coder-7B

Text Generation • Updated Nov 18, 2024 • 20.4k • 84

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 18, 2024 • 16.9k • 11

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 13.8k • 13

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 19.2k • 12

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 14.2k • 23

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 24.2k • 30

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 5.17k • 15

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 11.7k • 16

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 23.4k • 13

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 21.4k • 49

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 661k • 53

unsloth/Qwen2.5-7B-Instruct

Text Generation • Updated Nov 12, 2024 • 9.76k • 4

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 180k • 8