LWDCLS/llama3-8B-DarkIdol-1.2-GGUF-IQ-Imatrix-Request

[Request #53] - Click the link for more context.
aifeifei798/llama3-8B-DarkIdol-1.2

Use with the latest version of KoboldCpp, or this more up-to-date fork if you have issues.

⇲ Click here to expand/hide information – General chart with relative quant performance.

Recommended read:

"Which GGUF is right for me? (Opinionated)" by Artefact2

Click the image to view full size.