Finetune of miqu-70b-sf dequant of miqudev's leak of Mistral-70B (allegedly an early mistral medium). My diffs are available under CC-0, this is a merge with the leaked model, you can use the other repository to save bandwidth.

EQ-Bench: 84.89

Will run more benches later.

Downloads last month: 36

GGUF

Model size

69B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.