Lewdiculous/MN-12B-Lyra-v4-GGUF-IQ-Imatrix

Model name:
MN-12B-Lyra-v4

Brief description:
A finetune of Mistral Nemo by Sao10K.
Uses the ChatML prompt format.

Presets:
You can use the built in ChatML presets within SillyTavern and adjust from there.
Alternatively, check out Virt-io's ChatML v1.9 presets here, make sure you read the repository page for how to use them properly.

Request page:
https://huggingface.co/Lewdiculous/Model-Requests/discussions/75

Model link:
https://huggingface.co/Sao10K/MN-12B-Lyra-v4

Quantized with llama.cpp:
b3707