PocketDoc commited on
Commit
cbd3e9b
·
verified ·
1 Parent(s): 1265ec8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -139,7 +139,7 @@ system prompt<|im_end|>
139
  Hi there!<|im_end|>
140
  <|im_start|>assistant
141
  Nice to meet you!<|im_end|></pre>
142
- A word of caution: As of Feb 19 2025 backends can't seem to agree on automatically addind a "bos" token to the start, which they should! I'm investigating if there is a way I can change the config to mitigate this but for now if you have incoherent outputs not typical of a 24b model (verbatim repeating what you said back to you for instance) then try adding "<s>" to the very beginning of your context.
143
  <h3>SillyTavern Templates</h3>
144
  <details>
145
  <summary>Context Template</summary>
 
139
  Hi there!<|im_end|>
140
  <|im_start|>assistant
141
  Nice to meet you!<|im_end|></pre>
142
+ A word of caution: As of Feb 19 2025 backends can't seem to agree on automatically addind a "bos" token to the start, which they should! I'm investigating if there is a way I can change the config to mitigate this but for now if you have incoherent outputs not typical of a 24b model (verbatim repeating what you said back to you for instance) then try adding "&lt;s&gt;" to the very beginning of your context.
143
  <h3>SillyTavern Templates</h3>
144
  <details>
145
  <summary>Context Template</summary>