att --quantkv mention

README.md

@@ -1,8 +1,11 @@
 ---
+base_model: NeverSleep/Lumimaid-v0.2-8B
+quantized_by: Lewdiculous
+library_name: transformers
 license: cc-by-nc-4.0
+inference: false
 language:
 - en
-inference: false
 tags:
 - roleplay
 - llama3
@@ -23,13 +26,16 @@ I recommend checking their page for feedback and support.
 > If you noticed any issues let me know in the discussions.
 
 > [!NOTE]
-> **General usage:** <br>
-> For **8GB VRAM** GPUs, I recommend the **Q4_K_M-imat** (4.89 BPW) quant for up to 12288 context sizes. <br>
->
 > **Presets:** <br>
 > Some compatible SillyTavern presets can be found [**here (Virt's Roleplay Presets - v1.9)**](https://huggingface.co/Virt-io/SillyTavern-Presets). <br>
+> Check [**discussions such as this one**](https://huggingface.co/Virt-io/SillyTavern-Presets/discussions/5#664d6fb87c563d4d95151baa) and [**this one**](https://www.reddit.com/r/SillyTavernAI/comments/1dff2tl/my_personal_llama3_stheno_presets/) for other presets and samplers recommendations. <br>
 > Lower temperatures are recommended by the authors, so make sure to experiment. <br>
-> Check [**discussions such as this one**](https://huggingface.co/Virt-io/SillyTavern-Presets/discussions/5#664d6fb87c563d4d95151baa) and [**this one**](https://www.reddit.com/r/SillyTavernAI/comments/1dff2tl/my_personal_llama3_stheno_presets/) for other presets and samplers recommendations.
+>
+> **General usage with KoboldCpp:** <br>
+> For **8GB VRAM** GPUs, I recommend the **Q4_K_M-imat** (4.89 BPW) quant for up to 12288 context sizes without the use of `--quantkv`. <br>
+> Using `--quantkv 1` (≈Q8) or even `--quantkv 2` (≈Q4) can get you to 32K context sizes with the caveat of not being compatible with Context Shifting, only relevant if you can manage to fill up that much context. <br>
+> [**Read more about it in the release here**](https://github.com/LostRuins/koboldcpp/releases/tag/v1.67).
+
 
 <details>
 <summary>⇲ Click here to expand/hide information – General chart with relative quant parformances.</summary>