GGUF-Imatrix quants for jeiku/Orthocopter_8B as per demand for testing.

This is experimental.

My upload speeds have been cooked and unstable lately.
If you want and you are able to...
You can support my various endeavors here (Ko-fi).

Compatible SillyTavern presets here (simple) or here (Virt's Roleplay Presets - recommended).
Use the latest version of KoboldCpp. Use the provided presets for testing.

Original model information from author card:

Orthocopter

image/png

This model is thanks to the hard work of lucyknada with the Edgerunners. Her work produced the following model, which I used as the base:

https://huggingface.co/Edgerunners/meta-llama-3-8b-instruct-hf-ortho-baukit-10fail-1000total

I then applied two handwritten datasets over top of this and the results are pretty nice, with no refusals and plenty of personality.

Downloads last month
176
GGUF
Model size
8.03B params
Architecture
llama

4-bit

5-bit

6-bit

8-bit

16-bit

Inference API
Unable to determine this model's library. Check the docs .

Collection including Lewdiculous/Orthocopter_8B-GGUF-Imatrix