Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,471

Full-text search

Active filters: 3-bit

TheBlueObserver/gemma-2-27b-it-MLX-104ce

Text Generation • Updated Dec 22, 2024 • 19

ReadyArt/Anubis-70B-v1_EXL2_3.0bpw_H8

Updated Dec 22, 2024 • 9

TheBlueObserver/Llama-3.2-3B-Instruct-MLX-104ce

Text Generation • Updated Dec 23, 2024 • 27

mlx-community/EXAONE-3.5-7.8B-Instruct-3bit

Text Generation • Updated Dec 23, 2024 • 31

MaziyarPanahi/Lumimaid-Magnum-v4-12B-GGUF

Text Generation • Updated Dec 23, 2024 • 298

MaziyarPanahi/Dans-PersonalityEngine-V1.1.0-12b-GGUF

Text Generation • Updated Dec 23, 2024 • 621

MaziyarPanahi/MISCHIEVOUS-12B-Mix_0.4v-GGUF

Text Generation • Updated Dec 23, 2024 • 80

MaziyarPanahi/MN-Chinofun-12B-3-GGUF

Text Generation • Updated Dec 23, 2024 • 95 • 1

MaziyarPanahi/relay-v0.1-Mistral-Nemo-2407-GGUF

Text Generation • Updated Dec 23, 2024 • 371

Jellon/Anubis-70B-v1-exl2-3bpw

Updated Dec 24, 2024 • 12

reach-vb/Qwen2.5-0.5B-Instruct-Q3-mlx

Text Generation • Updated Dec 24, 2024 • 28

Dracones/Anubis-70B-v1_exl2_3.0bpw

Text Generation • Updated Dec 25, 2024 • 9

yz1129/mlx-breeze-2bit

Updated Dec 26, 2024 • 4

ubaitur5/Qwen2.5-0.5B-Instruct-Q3-mlx

Text Generation • Updated Dec 26, 2024 • 25

Dracones/QVQ-72B-Preview_exl2_3.0bpw

Image-Text-to-Text • Updated Dec 26, 2024 • 8

mlx-community/Qwen2.5-14B-Instruct-3bit

Text Generation • Updated Dec 26, 2024 • 19 • 1

mlx-community/twllama

Updated Dec 26, 2024 • 6

bullerwins/QVQ-72B-Preview-exl2_3.0bpw

Image-Text-to-Text • Updated Dec 26, 2024 • 5

MaziyarPanahi/DarkCamelot_2-GGUF

Text Generation • Updated Dec 26, 2024 • 66

MaziyarPanahi/Mistral-Nemo-VICIOUS_MESH-12B-2407-GGUF

Text Generation • Updated Dec 26, 2024 • 84

MaziyarPanahi/VICIOUS_MESH-12B-OMEGA-GGUF

Text Generation • Updated Dec 26, 2024 • 382

MaziyarPanahi/VICIOUS_MESH-12B-BETA-GGUF

Text Generation • Updated Dec 26, 2024 • 51

MaziyarPanahi/Captain_BMO-0.420-Magnum-12B-GGUF

Text Generation • Updated Dec 26, 2024 • 387

MaziyarPanahi/Captain-Eris_Twighlight-V0.420-12B-GGUF

Text Generation • Updated Dec 28, 2024 • 554

MaziyarPanahi/Kosmos-EVAA-Fusion-light-8B-GGUF

Text Generation • Updated Dec 28, 2024 • 67

MaziyarPanahi/Kosmos-EVAA-v9-8B-GGUF

Text Generation • Updated Dec 28, 2024 • 63

MaziyarPanahi/Kosmos-Elusive-VENN-Aurora_faustus-8B-GGUF

Text Generation • Updated Dec 28, 2024 • 272

MaziyarPanahi/Kosmos-VENN-8B-GGUF

Text Generation • Updated Dec 28, 2024 • 88

MaziyarPanahi/stackexchange_movies-GGUF

Text Generation • Updated Dec 28, 2024 • 76

MaziyarPanahi/ZEUS-8B-V10-GGUF

Text Generation • Updated Dec 28, 2024 • 52