Update README.md
Browse files
README.md
CHANGED
@@ -43,10 +43,11 @@ base_model:
|
|
43 |
<li>INSTRUCT TEMPLATES</li>
|
44 |
<li>SYSTEM PROMPTS</li>
|
45 |
<li>SETTINGS (SAMPLERS)</li>
|
|
|
46 |
<br>
|
47 |
<h1><ins>SAMPLERS (USED):</ins></h1>
|
48 |
-
<li>Temperature</li>
|
49 |
<li>Min-P</li>
|
|
|
50 |
<li>DRY (prevents repetition)</li>
|
51 |
<br>
|
52 |
> All the other samplers neutralized. That's all you need in modern times (2024/2025). Samplers order is also correct - so min-p before temperature. <br>> I am not a fan of XTC, it feels too "loose".
|
@@ -65,7 +66,7 @@ base_model:
|
|
65 |
<li><b>DIALOGUES</b> - quotation marks if you do not use my REGEX/plain text, no quotation marks, if you add my REGEX</li>
|
66 |
<li><b>NARRATION</b> - italics</li>
|
67 |
<li><b>INNER THOUGHTS</b> - code block aka ```Thoughts```</li>
|
68 |
-
<li><b>Trim Incomplete Sentences</b>: ON (it prevents messeges from being cut in half with short maximum tokens setting
|
69 |
</div><br>
|
70 |
<h5><b>PRESETS:</b></h5>
|
71 |
<div style="background-color: #ffefb8; padding: 16px 32px; outline: 2px solid; border-radius: 10px;">
|
@@ -86,7 +87,7 @@ base_model:
|
|
86 |

|
87 |
|
88 |
**D) Sphiratrioth (GM)** - you are a Game Master (GM), AI becomes your player - tabletop RPG-like experience from a GM-POV!
|
89 |
-
***<<< 1-3 paragraphs, ~ 350 tokens responses, around 50/50 narration and inner thoughts, capable of dialogues when situation calls, follows your story >>>***
|
90 |
|
91 |

|
92 |
(Yeah, I was sleepy - {{char}} wanted lush greenery but it accepts it's Autumn, I actually did not read properly what LLM came up with in the first place, fault on my side :-D But you get the idea of a preset at least, haha.)
|
@@ -116,7 +117,7 @@ base_model:
|
|
116 |
14. Click on the "Sliders" tab in Silly Tavern UI (AI Response Configuration).
|
117 |
15. Load up my Settings Preset from the Text Completion Presets list.
|
118 |
16. Switch between the 1st Person/3rd Person narration by switching the System Prompt Presets. Theoretically, it should re-evaluate the prompt but it may not work unless you start a new chat!
|
119 |
-
17. Switch between Conversation/Roleplay/Story Modes & Creativity (Temperature) by switching the Settings (Text Completion Presets/Samplers).
|
120 |
18. Enjoy.
|
121 |
<br>
|
122 |
<br>
|
@@ -130,19 +131,21 @@ base_model:
|
|
130 |
2. Open up SillyTavern Extensions tab.
|
131 |
3. Find REGEX.
|
132 |
4. Import downloaded files as GLOBAL.
|
133 |
-
5. Adjust order: trim incomplete, followed by: find last special character, followed by: remove
|
|
|
|
|
134 |
<br>
|
135 |
-
|
136 |
<br>
|
137 |
<br>
|
138 |
|
139 |
<h1><ins>PLANS FOR THE FUTURE:</ins></h1>
|
140 |
-
Updating to keep up with the new,
|
141 |
<br>
|
142 |
<br>
|
143 |
<h1><ins>ANNOTATIONS:</ins></h1>
|
144 |
|
145 |
-
I am using the full names of what's what but people simplify - thus - you'll come across the words context
|
146 |
<br>
|
147 |
<li>Context = Context Template = Story String (IN TERMS OF PRESETS)</li>
|
148 |
I'm simplifying here but people often get confused with names. Story String is a part of the Context Template - to be precise - but creators of models and presets use those terms as equivalents...
|
@@ -150,7 +153,7 @@ I'm simplifying here but people often get confused with names. Story String is a
|
|
150 |
<li>Instruct = Instruct Template (IN TERMS OF PROPER USE OF A WORD). Again, people simplify...</li>
|
151 |
<li>Model Name - Instruct Model = a model trained to follow instructions in a given instruct template (IN TERMS OF PROPER USE OF A WORD). You catch the drill by now, don't you? :-P</li>
|
152 |
<br>
|
153 |
-
There are other great presets from Virt-io or Marinara available on the site but they come with messy preset names, less clear file structures or forced instructions such as including the character example messages through instruct/context template, which becomes the unnecessary bother.
|
154 |
|
155 |
<a id="1">[1]</a> : Virt-io, [Silly Tavern Presets](https://huggingface.co/Virt-io/SillyTavern-Presets), 2024
|
156 |
|
|
|
43 |
<li>INSTRUCT TEMPLATES</li>
|
44 |
<li>SYSTEM PROMPTS</li>
|
45 |
<li>SETTINGS (SAMPLERS)</li>
|
46 |
+
<li>BONUS/OPTIONAL: REGEX</li>
|
47 |
<br>
|
48 |
<h1><ins>SAMPLERS (USED):</ins></h1>
|
|
|
49 |
<li>Min-P</li>
|
50 |
+
<li>Temperature</li>
|
51 |
<li>DRY (prevents repetition)</li>
|
52 |
<br>
|
53 |
> All the other samplers neutralized. That's all you need in modern times (2024/2025). Samplers order is also correct - so min-p before temperature. <br>> I am not a fan of XTC, it feels too "loose".
|
|
|
66 |
<li><b>DIALOGUES</b> - quotation marks if you do not use my REGEX/plain text, no quotation marks, if you add my REGEX</li>
|
67 |
<li><b>NARRATION</b> - italics</li>
|
68 |
<li><b>INNER THOUGHTS</b> - code block aka ```Thoughts```</li>
|
69 |
+
<li><b>Trim Incomplete Sentences</b>: ON (it prevents messeges from being cut in half with short maximum tokens setting under "conversation" mode preset, you need to turn it on manually in the newest version or...); OFF - you can use my REGEX files instead, which are better than a basic SillyTavern tool in trimming the unfinished sentences. Additionally, doing it through REGEX allows trimming even the extremely short messages. You can set the output toxens to crazy values such as 20-50 and it will trim everything perfectly, which is not doable otherwise - only through proper regex. The endless issue with too long messages finally solved! Look for Regex files is a separate folder to download now - you import them under SillyTavern Extensions Tab -> REGEX, in order provided in the files readme. You can also turn quotations ON/OFF this way - since LLM will generate with quotations now.</li>
|
70 |
</div><br>
|
71 |
<h5><b>PRESETS:</b></h5>
|
72 |
<div style="background-color: #ffefb8; padding: 16px 32px; outline: 2px solid; border-radius: 10px;">
|
|
|
87 |

|
88 |
|
89 |
**D) Sphiratrioth (GM)** - you are a Game Master (GM), AI becomes your player - tabletop RPG-like experience from a GM-POV!
|
90 |
+
***<<< 1-3 paragraphs, ~ between 150-350 tokens responses, around 50/50 narration and inner thoughts, capable of dialogues when situation calls, follows your story >>>***
|
91 |
|
92 |

|
93 |
(Yeah, I was sleepy - {{char}} wanted lush greenery but it accepts it's Autumn, I actually did not read properly what LLM came up with in the first place, fault on my side :-D But you get the idea of a preset at least, haha.)
|
|
|
117 |
14. Click on the "Sliders" tab in Silly Tavern UI (AI Response Configuration).
|
118 |
15. Load up my Settings Preset from the Text Completion Presets list.
|
119 |
16. Switch between the 1st Person/3rd Person narration by switching the System Prompt Presets. Theoretically, it should re-evaluate the prompt but it may not work unless you start a new chat!
|
120 |
+
17. Switch between Conversation/Roleplay/Story Modes & Creativity (Temperature) by switching the Settings (Text Completion Presets/Samplers). Add optional Regex if you want.
|
121 |
18. Enjoy.
|
122 |
<br>
|
123 |
<br>
|
|
|
131 |
2. Open up SillyTavern Extensions tab.
|
132 |
3. Find REGEX.
|
133 |
4. Import downloaded files as GLOBAL.
|
134 |
+
5. Adjust order: starts with "trim incomplete", followed by: "find last special character", followed by: "remove **"", followed by "remove ``````"", followed by: "delete quotes" (optional)
|
135 |
+
<br>
|
136 |
+
Turn Smooth Streaming in SillyTavern Settings OFF. REGEX will make your streaming "laggy" since it corrects the messages as they're generated live but - it's still so much better than unfinished sentences with lack of closing * or " or ``` signs. You can leave the normal streaming on, it's ok - just turn the Smooth Streaming OFF. It is the only way to trim very short messages around 20-50 tokens properly - if that's what you want - and it generally does its job much better than SillyTavern on itself with all normal message lengths. It's worth it.
|
137 |
<br>
|
138 |
+
Troubleshooting: if it does not allow you entering any special sign at the end of your message - open up the regex definitions (in SillyTavern, just edit them) - and uncheck the box for user messages. It will only affect the AI output then.
|
139 |
<br>
|
140 |
<br>
|
141 |
|
142 |
<h1><ins>PLANS FOR THE FUTURE:</ins></h1>
|
143 |
+
Updating the presets pack to keep up with the new, better models coming out in the future.
|
144 |
<br>
|
145 |
<br>
|
146 |
<h1><ins>ANNOTATIONS:</ins></h1>
|
147 |
|
148 |
+
I am using the full names of what's what but people simplify and people are great but messy - thus - you'll come across the words such as context or instruct meaning completely different things as you're continuing your journey in the LLMs community. No one writes context template vs context length or instruct template vs instruct mode/instruct model. Everyone simply uses context & instruct, also a story string (since it's clear it is a part of the context template, isn't it? Isn't?! Of course it is! Everyone knows at birth!). It all causes confusion for beginners. Here - a small guide for you - to understand how others operate.
|
149 |
<br>
|
150 |
<li>Context = Context Template = Story String (IN TERMS OF PRESETS)</li>
|
151 |
I'm simplifying here but people often get confused with names. Story String is a part of the Context Template - to be precise - but creators of models and presets use those terms as equivalents...
|
|
|
153 |
<li>Instruct = Instruct Template (IN TERMS OF PROPER USE OF A WORD). Again, people simplify...</li>
|
154 |
<li>Model Name - Instruct Model = a model trained to follow instructions in a given instruct template (IN TERMS OF PROPER USE OF A WORD). You catch the drill by now, don't you? :-P</li>
|
155 |
<br>
|
156 |
+
There are other great presets from Virt-io or Marinara available on the site but they come with messy preset names, less clear file structures or forced instructions such as including the character example messages through instruct/context template, which becomes the unnecessary bother. Also, they do a bit less than mine.<br><br>However, both Marinara and Virt-AI are great creators and great people - so when you learn and understand how presets actually work - be sure to give their collections a try! You may like the more, you may prefer this, who knows :-)
|
157 |
|
158 |
<a id="1">[1]</a> : Virt-io, [Silly Tavern Presets](https://huggingface.co/Virt-io/SillyTavern-Presets), 2024
|
159 |
|