Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,133

Full-text search

Active filters: chat

ericliu2007/Qwen2.5-14B-Instruct-Q2_K-GGUF

Text Generation • Updated 13 days ago • 24

Sg-at-srijan-us-kg/Qwen2.5-Coder-32B-Instruct-128k-yarn-Q4_K_M-GGUF

Text Generation • Updated 12 days ago • 34

tensorblock/Llama-2-7b-ultrachat200k-GGUF

Text Generation • Updated 13 days ago • 177

mradermacher/Hermes-3-Llama-3.2-3B-GGUF

Updated 13 days ago • 457

mradermacher/Hermes-3-Llama-3.2-3B-i1-GGUF

Updated 13 days ago • 650

ericliu2007/Qwen2.5-32B-Instruct-Q2_K-GGUF

Text Generation • Updated 13 days ago • 20

cnfusion/QwQ-32B-Coder-Fusion-8020-Q4-mlx

Text Generation • Updated 13 days ago • 10

cnfusion/QwQ-32B-Coder-Fusion-7030-Q4-mlx

Text Generation • Updated 13 days ago • 7

cnfusion/QwQ-32B-Coder-Fusion-8020-Q8-mlx

Text Generation • Updated 12 days ago • 12

cnfusion/QwQ-32B-Coder-Fusion-7030-Q8-mlx

Text Generation • Updated 12 days ago • 17

yuh0512/QwQ-32B-Preview-Q4_K_M-GGUF

Updated 12 days ago • 5

tensorblock/Sailor-7B-Chat-GGUF

Updated 12 days ago • 217

TheBlueObserver/Qwen2.5-1.5B-Instruct

Text Generation • Updated 12 days ago • 17

mlx-community/Hermes-3-Llama-3.1-8B-3bit

Updated 12 days ago • 116

mlx-community/Qwen2.5-7B-Instruct-3bit

Text Generation • Updated 12 days ago • 81

mlx-community/Qwen2.5-Coder-7B-Instruct-3bit

Text Generation • Updated 12 days ago • 87

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX

Text Generation • Updated 11 days ago • 22

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-7dd7f

Text Generation • Updated 11 days ago • 26

mlx-community/magnum-v4-72b-4bit

Text Generation • Updated 11 days ago • 15

mradermacher/Experiment27-7B-GGUF

Updated 11 days ago • 177

mradermacher/Experiment27-7B-i1-GGUF

Updated 10 days ago • 366

mlx-community/calme-3.2-instruct-78b-4bit

Text Generation • Updated 11 days ago • 25

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-0cb1b

Text Generation • Updated 11 days ago • 18

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-d5688

Text Generation • Updated 11 days ago • 15

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-c6059

Text Generation • Updated 11 days ago • 12

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-9a5c2

Text Generation • Updated 11 days ago • 14

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-104ce

Text Generation • Updated 11 days ago • 14

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-4c7d1

Text Generation • Updated 11 days ago • 12

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-884ea

Text Generation • Updated 11 days ago • 16

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-b4ecb

Text Generation • Updated 11 days ago • 14