sphiratrioth666 commited on
Commit
b35aa74
·
verified ·
1 Parent(s): a470207

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -9
README.md CHANGED
@@ -43,10 +43,11 @@ base_model:
43
  <li>INSTRUCT TEMPLATES</li>
44
  <li>SYSTEM PROMPTS</li>
45
  <li>SETTINGS (SAMPLERS)</li>
 
46
  <br>
47
  <h1><ins>SAMPLERS (USED):</ins></h1>
48
- <li>Temperature</li>
49
  <li>Min-P</li>
 
50
  <li>DRY (prevents repetition)</li>
51
  <br>
52
  > All the other samplers neutralized. That's all you need in modern times (2024/2025). Samplers order is also correct - so min-p before temperature. <br>> I am not a fan of XTC, it feels too "loose".
@@ -65,7 +66,7 @@ base_model:
65
  <li><b>DIALOGUES</b> - quotation marks if you do not use my REGEX/plain text, no quotation marks, if you add my REGEX</li>
66
  <li><b>NARRATION</b> - italics</li>
67
  <li><b>INNER THOUGHTS</b> - code block aka ```Thoughts```</li>
68
- <li><b>Trim Incomplete Sentences</b>: ON (it prevents messeges from being cut in half with short maximum tokens setting in "conversation" mode preset, you need to turn it on manually in the newest presets version or...); OFF - you can use my REGEX files, which are better in trimming the unfinished sentences than a basic SillyTavern tool. Additionally, doing it through REGEX allows trimming even extremely short messages. You can set the output toxens even to 20-50 and it will trim everything perfectly, which is not doable otherwise - only through proper regex and good news - I wrote it for you... It is a separate folder to download now - you import regex files under SillyTavern Extensions Tab -> REGEX, in order provided in the files readme. You can also turn quotations ON/OFF this way - since LLM will generate with quotations now.</li>
69
  </div><br>
70
  <h5><b>PRESETS:</b></h5>
71
  <div style="background-color: #ffefb8; padding: 16px 32px; outline: 2px solid; border-radius: 10px;">
@@ -86,7 +87,7 @@ base_model:
86
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/66a2a6820c4cd36ffbc95623/NA7o-KgqTYv7fDXLnSy07.png)
87
 
88
  **D) Sphiratrioth (GM)** - you are a Game Master (GM), AI becomes your player - tabletop RPG-like experience from a GM-POV!
89
- ***<<< 1-3 paragraphs, ~ 350 tokens responses, around 50/50 narration and inner thoughts, capable of dialogues when situation calls, follows your story >>>***
90
 
91
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/66a2a6820c4cd36ffbc95623/HUTmiFEeMcdfd9RN-wjvz.png)
92
  (Yeah, I was sleepy - {{char}} wanted lush greenery but it accepts it's Autumn, I actually did not read properly what LLM came up with in the first place, fault on my side :-D But you get the idea of a preset at least, haha.)
@@ -116,7 +117,7 @@ base_model:
116
  14. Click on the "Sliders" tab in Silly Tavern UI (AI Response Configuration).
117
  15. Load up my Settings Preset from the Text Completion Presets list.
118
  16. Switch between the 1st Person/3rd Person narration by switching the System Prompt Presets. Theoretically, it should re-evaluate the prompt but it may not work unless you start a new chat!
119
- 17. Switch between Conversation/Roleplay/Story Modes & Creativity (Temperature) by switching the Settings (Text Completion Presets/Samplers).
120
  18. Enjoy.
121
  <br>
122
  <br>
@@ -130,19 +131,21 @@ base_model:
130
  2. Open up SillyTavern Extensions tab.
131
  3. Find REGEX.
132
  4. Import downloaded files as GLOBAL.
133
- 5. Adjust order: trim incomplete, followed by: find last special character, followed by: remove **, followed by remove ``````, followed by: delete quotes (optional)
 
 
134
  <br>
135
- Turn Smooth Streaming in SillyTavern Settings. REGEX will make your streaming "laggy" since it corrects the messages as they're generated live but - it's still so much better than unfinished sentences with lack of closing * or " or ``` signs. It is also the only way to trim very short messages around 20-50 tokens properly - if that's what you want.
136
  <br>
137
  <br>
138
 
139
  <h1><ins>PLANS FOR THE FUTURE:</ins></h1>
140
- Updating to keep up with the new, amazing models coming out in the future.
141
  <br>
142
  <br>
143
  <h1><ins>ANNOTATIONS:</ins></h1>
144
 
145
- I am using the full names of what's what but people simplify - thus - you'll come across the words context & instruct meaning different things in the community. No one bothers themselves with writing context template vs context length or instruct template vs instruct mode/instruct model. Everyone simply says context & instruct, throws in story string (since it's clear it is a part of the context template, isn't it? Isn't?!). It all causes confusion for beginners. Here - a small guide for you - to understand how others operate. Here, all is clearly names so it won't be needed.
146
  <br>
147
  <li>Context = Context Template = Story String (IN TERMS OF PRESETS)</li>
148
  I'm simplifying here but people often get confused with names. Story String is a part of the Context Template - to be precise - but creators of models and presets use those terms as equivalents...
@@ -150,7 +153,7 @@ I'm simplifying here but people often get confused with names. Story String is a
150
  <li>Instruct = Instruct Template (IN TERMS OF PROPER USE OF A WORD). Again, people simplify...</li>
151
  <li>Model Name - Instruct Model = a model trained to follow instructions in a given instruct template (IN TERMS OF PROPER USE OF A WORD). You catch the drill by now, don't you? :-P</li>
152
  <br>
153
- There are other great presets from Virt-io or Marinara available on the site but they come with messy preset names, less clear file structures or forced instructions such as including the character example messages through instruct/context template, which becomes the unnecessary bother. Importing those presets into Silly Tavern requires a bit of work and deeper understanding - you need to manually change the presets names in JSON files to something recognizable/useful, do the same with file names to understand what's what on the long Silly Tavern lists when loading the presets up etc.<br><br>Both Marinara and Virt-AI are great creators so when you learn and understand how presets actually work - be sure to give their presets collections a try! :-)
154
 
155
  <a id="1">[1]</a> : Virt-io, [Silly Tavern Presets](https://huggingface.co/Virt-io/SillyTavern-Presets), 2024
156
 
 
43
  <li>INSTRUCT TEMPLATES</li>
44
  <li>SYSTEM PROMPTS</li>
45
  <li>SETTINGS (SAMPLERS)</li>
46
+ <li>BONUS/OPTIONAL: REGEX</li>
47
  <br>
48
  <h1><ins>SAMPLERS (USED):</ins></h1>
 
49
  <li>Min-P</li>
50
+ <li>Temperature</li>
51
  <li>DRY (prevents repetition)</li>
52
  <br>
53
  > All the other samplers neutralized. That's all you need in modern times (2024/2025). Samplers order is also correct - so min-p before temperature. <br>> I am not a fan of XTC, it feels too "loose".
 
66
  <li><b>DIALOGUES</b> - quotation marks if you do not use my REGEX/plain text, no quotation marks, if you add my REGEX</li>
67
  <li><b>NARRATION</b> - italics</li>
68
  <li><b>INNER THOUGHTS</b> - code block aka ```Thoughts```</li>
69
+ <li><b>Trim Incomplete Sentences</b>: ON (it prevents messeges from being cut in half with short maximum tokens setting under "conversation" mode preset, you need to turn it on manually in the newest version or...); OFF - you can use my REGEX files instead, which are better than a basic SillyTavern tool in trimming the unfinished sentences. Additionally, doing it through REGEX allows trimming even the extremely short messages. You can set the output toxens to crazy values such as 20-50 and it will trim everything perfectly, which is not doable otherwise - only through proper regex. The endless issue with too long messages finally solved! Look for Regex files is a separate folder to download now - you import them under SillyTavern Extensions Tab -> REGEX, in order provided in the files readme. You can also turn quotations ON/OFF this way - since LLM will generate with quotations now.</li>
70
  </div><br>
71
  <h5><b>PRESETS:</b></h5>
72
  <div style="background-color: #ffefb8; padding: 16px 32px; outline: 2px solid; border-radius: 10px;">
 
87
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/66a2a6820c4cd36ffbc95623/NA7o-KgqTYv7fDXLnSy07.png)
88
 
89
  **D) Sphiratrioth (GM)** - you are a Game Master (GM), AI becomes your player - tabletop RPG-like experience from a GM-POV!
90
+ ***<<< 1-3 paragraphs, ~ between 150-350 tokens responses, around 50/50 narration and inner thoughts, capable of dialogues when situation calls, follows your story >>>***
91
 
92
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/66a2a6820c4cd36ffbc95623/HUTmiFEeMcdfd9RN-wjvz.png)
93
  (Yeah, I was sleepy - {{char}} wanted lush greenery but it accepts it's Autumn, I actually did not read properly what LLM came up with in the first place, fault on my side :-D But you get the idea of a preset at least, haha.)
 
117
  14. Click on the "Sliders" tab in Silly Tavern UI (AI Response Configuration).
118
  15. Load up my Settings Preset from the Text Completion Presets list.
119
  16. Switch between the 1st Person/3rd Person narration by switching the System Prompt Presets. Theoretically, it should re-evaluate the prompt but it may not work unless you start a new chat!
120
+ 17. Switch between Conversation/Roleplay/Story Modes & Creativity (Temperature) by switching the Settings (Text Completion Presets/Samplers). Add optional Regex if you want.
121
  18. Enjoy.
122
  <br>
123
  <br>
 
131
  2. Open up SillyTavern Extensions tab.
132
  3. Find REGEX.
133
  4. Import downloaded files as GLOBAL.
134
+ 5. Adjust order: starts with "trim incomplete", followed by: "find last special character", followed by: "remove **"", followed by "remove ``````"", followed by: "delete quotes" (optional)
135
+ <br>
136
+ Turn Smooth Streaming in SillyTavern Settings OFF. REGEX will make your streaming "laggy" since it corrects the messages as they're generated live but - it's still so much better than unfinished sentences with lack of closing * or " or ``` signs. You can leave the normal streaming on, it's ok - just turn the Smooth Streaming OFF. It is the only way to trim very short messages around 20-50 tokens properly - if that's what you want - and it generally does its job much better than SillyTavern on itself with all normal message lengths. It's worth it.
137
  <br>
138
+ Troubleshooting: if it does not allow you entering any special sign at the end of your message - open up the regex definitions (in SillyTavern, just edit them) - and uncheck the box for user messages. It will only affect the AI output then.
139
  <br>
140
  <br>
141
 
142
  <h1><ins>PLANS FOR THE FUTURE:</ins></h1>
143
+ Updating the presets pack to keep up with the new, better models coming out in the future.
144
  <br>
145
  <br>
146
  <h1><ins>ANNOTATIONS:</ins></h1>
147
 
148
+ I am using the full names of what's what but people simplify and people are great but messy - thus - you'll come across the words such as context or instruct meaning completely different things as you're continuing your journey in the LLMs community. No one writes context template vs context length or instruct template vs instruct mode/instruct model. Everyone simply uses context & instruct, also a story string (since it's clear it is a part of the context template, isn't it? Isn't?! Of course it is! Everyone knows at birth!). It all causes confusion for beginners. Here - a small guide for you - to understand how others operate.
149
  <br>
150
  <li>Context = Context Template = Story String (IN TERMS OF PRESETS)</li>
151
  I'm simplifying here but people often get confused with names. Story String is a part of the Context Template - to be precise - but creators of models and presets use those terms as equivalents...
 
153
  <li>Instruct = Instruct Template (IN TERMS OF PROPER USE OF A WORD). Again, people simplify...</li>
154
  <li>Model Name - Instruct Model = a model trained to follow instructions in a given instruct template (IN TERMS OF PROPER USE OF A WORD). You catch the drill by now, don't you? :-P</li>
155
  <br>
156
+ There are other great presets from Virt-io or Marinara available on the site but they come with messy preset names, less clear file structures or forced instructions such as including the character example messages through instruct/context template, which becomes the unnecessary bother. Also, they do a bit less than mine.<br><br>However, both Marinara and Virt-AI are great creators and great people - so when you learn and understand how presets actually work - be sure to give their collections a try! You may like the more, you may prefer this, who knows :-)
157
 
158
  <a id="1">[1]</a> : Virt-io, [Silly Tavern Presets](https://huggingface.co/Virt-io/SillyTavern-Presets), 2024
159