Update README.md

README.md

@@ -29,6 +29,10 @@ Can I ask a question?<|im_end|>
 
 ## Support
 
+Upstream support has been merged, so gguf-quants work out of the box now!
+
+<details><summary>old instructions before PR</summary>
+  
 To run inference on this model, you'll need to use Aphrodite, vLLM or EXL2/tabbyAPI, as llama.cpp hasn't yet merged the required pull request to fix the llama3.1 rope_freqs issue with custom head dimensions. 
 
 However, you can work around this by quantizing the model yourself to create a functional GGUF file. Note that until [this PR](https://github.com/ggerganov/llama.cpp/pull/9141) is merged, the context will be limited to 8k tokens.
@@ -38,7 +42,9 @@ To create a working GGUF file, make the following adjustments:
 1. Remove the `"rope_scaling": {}` entry from `config.json`
 2. Change `"max_position_embeddings"` to `8192` in `config.json`
 
-These modifications should allow you to use the model with llama.cpp, albeit with the mentioned context limitation.
+These modifications should allow you to use the model with llama.cpp, albeit with the mentioned context limitation.</strike>
+
+</details><br>
 
 ## axolotl config