Update README.md
Browse files
README.md
CHANGED
@@ -139,7 +139,7 @@ system prompt<|im_end|>
|
|
139 |
Hi there!<|im_end|>
|
140 |
<|im_start|>assistant
|
141 |
Nice to meet you!<|im_end|></pre>
|
142 |
-
A word of caution: As of Feb 19 2025 backends can't seem to agree on automatically addind a "bos" token to the start, which they should! I'm investigating if there is a way I can change the config to mitigate this but for now if you have incoherent outputs not typical of a 24b model (verbatim repeating what you said back to you for instance) then try adding "
|
143 |
<h3>SillyTavern Templates</h3>
|
144 |
<details>
|
145 |
<summary>Context Template</summary>
|
|
|
139 |
Hi there!<|im_end|>
|
140 |
<|im_start|>assistant
|
141 |
Nice to meet you!<|im_end|></pre>
|
142 |
+
A word of caution: As of Feb 19 2025 backends can't seem to agree on automatically addind a "bos" token to the start, which they should! I'm investigating if there is a way I can change the config to mitigate this but for now if you have incoherent outputs not typical of a 24b model (verbatim repeating what you said back to you for instance) then try adding "<s>" to the very beginning of your context.
|
143 |
<h3>SillyTavern Templates</h3>
|
144 |
<details>
|
145 |
<summary>Context Template</summary>
|