Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

arxiv: 2309.00071

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

555

Full-text search

Active filters: 2309.00071

billatsectorflow/Qwen2-72B-Instruct-GPTQ-Int4-128K

Text Generation • Updated Sep 25, 2024 • 12

emplitude/rubywork

Text Generation • Updated Jul 17, 2024 • 4

bigstorm/Qwen2-72B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 6

bigstorm/Qwen2-72B-Instruct-8.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 6

RichardErkhov/RESMPDEV_-_Qwen2-Wukong-5B-Instruct-Sliced-gguf

Updated Jul 22, 2024 • 186

pashaprokaz/Qwen2-7B-Instruct

Text Generation • Updated Jul 24, 2024 • 4

pashaprokaz/Qwen2-72B-Instruct

Text Generation • Updated Jul 24, 2024 • 4

RichardErkhov/MaziyarPanahi_-_Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1-gguf

Updated Jul 25, 2024 • 33

SharryOG/llama3-8b-1048k

Text Generation • Updated Jul 29, 2024 • 5

GPT4All-Community/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Aug 20, 2024 • 379

psyche/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 22, 2024 • 15

Efficient-Large-Model/Qwen2-VL-7B-Instruct

Text Generation • Updated Aug 31, 2024 • 960

Enfint/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated Sep 5, 2024 • 9

TitanML/Qwen2-7B-Instruct

Text Generation • Updated Sep 11, 2024 • 9

TitanML/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Sep 11, 2024 • 9 • 1

CalamitousFelicitousness/Qwen2.5-7B-Instruct-fp8-dynamic

Text Generation • Updated Sep 18, 2024 • 229

CalamitousFelicitousness/Qwen2.5-14B-Instruct-fp8-dynamic

Text Generation • Updated Sep 18, 2024 • 358 • 1

Orion-zhen/Qwen2.5-32B-Instruct-6.5bpw-exl2

Text Generation • Updated Sep 19, 2024 • 7

QuantFactory/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 1.56k • 3

LoneStriker/Qwen2.5-7B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated Sep 19, 2024 • 10

LoneStriker/Qwen2.5-7B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Sep 19, 2024 • 8

LoneStriker/Qwen2.5-7B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19, 2024 • 12

LoneStriker/Qwen2.5-7B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Sep 19, 2024 • 5

LoneStriker/Qwen2.5-7B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Sep 19, 2024 • 6

QuantFactory/Qwen2.5-Coder-1.5B-GGUF

Text Generation • Updated Sep 19, 2024 • 265 • 2

QuantFactory/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated Nov 6, 2024 • 1.72k • 2

LoneStriker/Qwen2.5-14B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated Sep 19, 2024 • 6

LoneStriker/Qwen2.5-14B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Sep 19, 2024 • 8

LoneStriker/Qwen2.5-14B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19, 2024 • 5

LoneStriker/Qwen2.5-14B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Sep 19, 2024 • 6