Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,130

Full-text search

Active filters: chat

bartowski/Qwen2-72B-Instruct-GGUF

Text Generation • Updated Jun 7 • 188 • 13

Qwen/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 18 • 9.1k • 18

LoneStriker/Qwen2-72B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated Jun 7 • 10 • 2

THUDM/cogvlm2-llama3-chat-19B-tgi

Text Generation • Updated Jun 8 • 26 • 3

MaziyarPanahi/calme-2.1-qwen2-72b

Text Generation • Updated Jul 25 • 5.11k • 28

Qwen/Qwen2-57B-A14B-Instruct-GGUF

Text Generation • Updated Jun 17 • 786 • 11

REILX/Qwen2-7B-Code-Instruct

Text Generation • Updated Jun 21 • 1

anthracite-org/magnum-v1-72b

Text Generation • Updated Sep 29 • 5.38k • 162

mradermacher/magnum-72b-v1-i1-GGUF

Updated 9 days ago • 472 • 10

lmstudio-community/Qwen2-500M-Instruct-GGUF

Text Generation • Updated Jun 24 • 146 • 6

yukiarimo/yuna-ai-v3-atomic-full

Text2Text Generation • Updated Sep 19 • 17 • 5

yukiarimo/yuna-ai-v3-atomic

Text2Text Generation • Updated Sep 19 • 123 • 7

abacusai/Smaug-Qwen2-72B-Instruct

Text Generation • Updated Aug 6 • 2.65k • 9

MaziyarPanahi/calme-2.7-qwen2-7b

Text Generation • Updated Sep 19 • 13.8k • 2

MaziyarPanahi/calme-2.8-qwen2-7b

Text Generation • Updated Jul 25 • 11.3k • 6

internlm/internlm2_5-7b-chat-gguf

Text Generation • Updated Jul 16 • 3.92k • 76

THUDM/cogvlm2-video-llama3-chat

Text Generation • Updated Jul 24 • 1.4k • 41

lordjia/Qwen2-Cantonese-7B-Instruct

Text Generation • Updated Aug 13 • 240 • 3

RESMPDEV/Qwen2-Wukong-7B

Text Generation • Updated Jul 14 • 28 • 3

lordjia/Llama-3-Cantonese-8B-Instruct

Text Generation • Updated Aug 13 • 686 • 5

catbash/Mistral-7B-v0.1-flashback-v2-instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 17 • 7 • 2

bartowski/turbcat-instruct-72b-GGUF

Text Generation • Updated Jul 22 • 149 • 2

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 26 • 350 • 6

internlm/internlm2_5-20b-chat-gguf

Text Generation • Updated Jul 29 • 5.5k • 37

internlm/internlm2_5-1_8b-chat-gguf

Text Generation • Updated Jul 29 • 249 • 9

NousResearch/Hermes-3-Llama-3.1-70B

Text Generation • Updated Sep 8 • 14k • 99

lordjia/Llama-3.1-Cantonese-8B-Instruct

Text Generation • Updated Aug 3 • 521 • 5

anthracite-org/magnum-v2-12b

Text Generation • Updated Sep 14 • 881 • 81

NousResearch/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 23 • 351k • 109

NousResearch/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 23 • 1.21k • 36