Hugging Face's logo

riveRiPH
/
Lyra4-Gutenberg2-12B-5bpw-h6-exl2

Text Generation
Transformers
Safetensors
mistral
conversational
text-generation-inference
Inference Endpoints
5-bit
exl2
Model card Files

image/png

Lyra4-Gutenberg2-12B-5bpw-h6-exl2

This is a 5bpw h6 exl2 quant of Lyra4-Gutenberg2-12B

Built-in(default) calibration dataset is used.

Downloads last month
7
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for riveRiPH/Lyra4-Gutenberg2-12B-5bpw-h6-exl2

Base model

Sao10K/MN-12B-Lyra-v4
Finetuned
nbeerbower/Lyra4-Gutenberg2-12B
Quantized
(9)
this model

Collection including riveRiPH/Lyra4-Gutenberg2-12B-5bpw-h6-exl2