mlx-community/quantized-gemma-2b-it
Text Generation
•
Updated
•
3.58k
•
9
Quantized MLX LLMs
-
-
mlx-community/Meta-Llama-3.1-8B-Instruct-4bit
Text Generation • Updated • 7k • 12 -
mlx-community/Mistral-Large-Instruct-2407-4bit
Updated • 295 • 1 -
mlx-community/Phi-3-mini-4k-instruct-4bit-no-q-embed
Text Generation • Updated • 603 • 3 -
mlx-community/Dolphin-2.9.3-Mistral-Nemo-12b-4bit
Updated • 20 -
mlx-community/dolphin-2.9.4-gemma2-2b-4bit
Updated • 24 • 2 -
mlx-community/zephyr-7b-beta-4bit
Text Generation • Updated • 18 • 1