ZeroXClem commited on
Commit
46069b0
1 Parent(s): 6fb4deb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -85,6 +85,19 @@ out_dtype: float16
85
  3. **Ethical Research and Dialogue:** Ideal for controlled environments where researchers can test response ethics, alignment, and safety controls.
86
  4. **General Instruction-Following:** Useful in assistant-like roles for answering questions, following system prompts, or generating informative content with flexible degrees of guidance.
87
 
 
 
 
 
 
 
 
 
 
 
 
 
 
88
  ### Example Usage
89
 
90
  This model has unique Stop Strings, for optimal inference in LM Studio, enter the following setting under Prompt Format > Stop Strings:
 
85
  3. **Ethical Research and Dialogue:** Ideal for controlled environments where researchers can test response ethics, alignment, and safety controls.
86
  4. **General Instruction-Following:** Useful in assistant-like roles for answering questions, following system prompts, or generating informative content with flexible degrees of guidance.
87
 
88
+ ---
89
+
90
+ ### Quantized Versions
91
+
92
+ For users looking to leverage optimized quantized versions of this model, we are grateful to **MrRaderMacher** for providing GGUF quantizations. These versions are accessible through the links below:
93
+
94
+ - **Static quants**: Available at [huggingface.co/mradermacher/Llama-3-Aetheric-Hermes-Lexi-Smaug-8B-GGUF](https://huggingface.co/mradermacher/Llama-3-Aetheric-Hermes-Lexi-Smaug-8B-GGUF)
95
+ - **Weighted/imatrix quants**: Available at [huggingface.co/mradermacher/Llama-3-Aetheric-Hermes-Lexi-Smaug-8B-i1-GGUF](https://huggingface.co/mradermacher/Llama-3-Aetheric-Hermes-Lexi-Smaug-8B-i1-GGUF)
96
+
97
+ We recommend users select the **imatrix version** for the best inference performance, as it provides an optimal balance of efficiency and accuracy. Once again, a heartfelt thanks to **MrRaderMacher** for his contributions to the community with these quantized versions.
98
+
99
+ ---
100
+
101
  ### Example Usage
102
 
103
  This model has unique Stop Strings, for optimal inference in LM Studio, enter the following setting under Prompt Format > Stop Strings: