Official EXL2 quants for MN-12B-Mag-Mell-R1.

(We forgot 8.0. Sorry. If you need 8.0, let us know.)

Each bit weight is a branch. Click on the "main" button to see the branch names, and download them with

git lfs install && git clone -b <branch-name> https://huggingface.co/Alfitaria/MN-12B-Mag-Mell-R1-exl2/.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for Alfitaria/MN-12B-Mag-Mell-R1-exl2

Quantized
(16)
this model