Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

2,859

Full-text search

Active filters: qwen

matiwojt/Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Dec 9, 2024 • 1

InferenceIllusionist/MilkDropLM-32b-v0.3

Text Generation • 33B • Updated Dec 20, 2024 • 4 • 11

xwk123/MobileVLM_stage3_AUTO-UI

10B • Updated Dec 14, 2024 • 2 • 2

eligapris/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

Text Generation • 33B • Updated Dec 11, 2024 • 3

ggml-org/Qwen2.5-Coder-1.5B-32B-speculative-GGUF

Text Generation • 2B • Updated Dec 11, 2024 • 12 • 3

cphan-intersystems/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

Text Generation • 33B • Updated Dec 12, 2024 • 3

mradermacher/Cabra-72b-GGUF

72B • Updated 17 days ago • 58

Sg-at-srijan-us-kg/Qwen2.5-Coder-32B-Instruct-128k-yarn-Q4_K_M-GGUF

Text Generation • 33B • Updated Dec 13, 2024 • 8

imkebe/Qwen2.5-Coder-14B-Instruct-rk3588-1.1.4

Text Generation • Updated Dec 14, 2024 • 3 • 2

mlx-community/Qwen2.5-Coder-7B-Instruct-3bit

Text Generation • 1.0B • Updated Dec 14, 2024 • 12

mradermacher/Cabra-72b-i1-GGUF

72B • Updated Jul 17 • 152

xwk123/MobileVLM_stage2_Grounding

Updated Dec 14, 2024 • 3

Triangle104/Qwen2.5-7B-Instruct-Uncensored-Q4_K_S-GGUF

Text Generation • 8B • Updated Dec 14, 2024 • 2

Triangle104/Qwen2.5-7B-Instruct-Uncensored-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 14, 2024 • 2

Triangle104/Qwen2.5-7B-Instruct-Uncensored-Q5_K_S-GGUF

Text Generation • 8B • Updated Dec 14, 2024 • 3

Triangle104/Qwen2.5-7B-Instruct-Uncensored-Q5_K_M-GGUF

Text Generation • 8B • Updated Dec 14, 2024 • 4

Triangle104/Qwen2.5-7B-Instruct-Uncensored-Q6_K-GGUF

Text Generation • 8B • Updated Dec 14, 2024 • 2

Triangle104/Qwen2.5-7B-Instruct-Uncensored-Q8_0-GGUF

Text Generation • 8B • Updated Dec 14, 2024 • 5

mlx-community/calme-3.2-instruct-78b-4bit

Text Generation • 12B • Updated Dec 15, 2024 • 13 • 1

mradermacher/Dermatech-Qwen2-VL-2B-GGUF

Text Generation • 2B • Updated 17 days ago • 90

mradermacher/Dermatech-Qwen2-VL-2B-i1-GGUF

Text Generation • 2B • Updated Jul 11 • 179

mradermacher/Qwen2-VL-7B-Sydney-GGUF

8B • Updated 17 days ago • 61

mradermacher/Qwen2-VL-7B-Sydney-i1-GGUF

8B • Updated Jul 11 • 75

hugsom/qwen1.8B-gptq-4bit

Text Generation • 0.8B • Updated Dec 15, 2024 • 5

yy12138/yuanqianwe

Text Generation • Updated Dec 16, 2024 • 3

Quant-Cartel/MilkDropLM-32b-v0.3-GGUF

Text Generation • 33B • Updated Dec 20, 2024 • 31 • 1

TheBlueObserver/Qwen2.5-Coder-7B-Instruct-MLX

Text Generation • 8B • Updated Dec 17, 2024 • 4

TheBlueObserver/Qwen2.5-Coder-3B-Instruct-MLX

Text Generation • 3B • Updated Dec 17, 2024 • 9

TheBlueObserver/Qwen2.5-Coder-1.5B-Instruct-MLX

Text Generation • 2B • Updated Dec 17, 2024 • 5

TheBlueObserver/Qwen2.5-Coder-0.5B-Instruct-MLX

Text Generation • 0.5B • Updated Dec 17, 2024 • 5