luigi86
/

UnslopNemo-12B-v4.1_mlx-8bit

8-bit precision

Model card Files Files and versions Community

UnslopNemo-12B-v4.1_mlx-8bit / README.md

luigi86's picture

Upload folder using huggingface_hub

7fd585c verified 5 months ago

|

history blame contribute delete

244 Bytes

MLX Format and Quantizations for Unslop Nemo 12b v4.1

Quantized to 8-bit precision and tested using the mlx_lm utility on a 64GiB URAM M1 Max.

See original model for further details.