sphiratrioth666 commited on
Commit
c4f660f
1 Parent(s): f663f99

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -15,6 +15,10 @@ I was experimenting with Silly Tavern lorebooks and I found a great way of imple
15
 
16
  Each entry must have: a) the same trigger words, b) position = at Depth (System), c) depth = 1, d) order = 100, e) trigger = 100, f) Prevent further recursion option on (entry will not activate other entries), g) group weight = 100 (or lower it if you want something to trigger less frequently, it's just a probability modifier, does not have to sum up to 100 in a group, as it seems), h) sticky = 10 or 20 (it makes the instruction for LLM remain active for a given number of the following messages - so it actually triggers logically within the scene, LLMs seem to understand it and do things under logical circumstances in the scene".</b>
17
 
 
 
 
 
18
  <i>You can theoretically change the weights to trigger different events with different probabilities. For simplicity, you can also match all separate "dice results" with a given fiction result or a TTRPG system DC (something like: we roll 1d6, we fail at 1-3 so: 1 = {{user}} will fail in {{user}}'s' action, 2 = {{user}} will fail in {{user}}'s' action, 3 = {{user}} will fail in {{user}}'s action', 4 = {{user}} will succeed in {{user}}'s action etc.'). I rather prefer having equal weights and repeated entries rather than messing with the weights. We never know, which actual RNG simulator a given software will use so this way - we take control of that forcing the real, equal distribution. It's also why Excell RNG for dice rolling is more realistic than dice rolling apps, just if you're curious (I'm working in game dev).</i>
19
 
20
  <b>3. Write instructions inside of the entries. They must be short, clear and include a specific word: "WILL". It seems to be very, very important. Otherwise, it might not work - at least with Mistral models and their fine-tunes.</b>
@@ -24,6 +28,10 @@ Something like: "enemies will attack {{user}}" or "road ahead will be blocked".
24
 
25
  Again, it seems that a word "will" is the best working trigger. Here, maybe "OOC" instructions would also be a good idea but since keys at depth = system are inserted already as instructions inside of a prompt itself (I checked, they're [INST] (...) [/INSTR] for Mistral), I'm not sure if it makes any sense.
26
 
 
 
 
 
27
  <b>TRICKS:</b>
28
  1. it may be good using one, specific word to trigger the entry group so it does not trigger again and again with different results as you or LLM repeats the trigger word - such as - attack or defend or whatever. You can use something like... roll 1d20 even - if you're into TTRPG. However, in different situations, recursive triggering may prove beneficial - then you may want to lower a "sticky" value but 5 seems balanced (LLM counts both {{user}} and {{char}} messages, if you're interested to know).
29
  2. depending on the use-case, you will need a couple of such entry groups (like different "dice rolls" for social encounters, different for random events in the world and different for dungeons exploring). IT WORKS VERY WELL.
 
15
 
16
  Each entry must have: a) the same trigger words, b) position = at Depth (System), c) depth = 1, d) order = 100, e) trigger = 100, f) Prevent further recursion option on (entry will not activate other entries), g) group weight = 100 (or lower it if you want something to trigger less frequently, it's just a probability modifier, does not have to sum up to 100 in a group, as it seems), h) sticky = 10 or 20 (it makes the instruction for LLM remain active for a given number of the following messages - so it actually triggers logically within the scene, LLMs seem to understand it and do things under logical circumstances in the scene".</b>
17
 
18
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/66a2a6820c4cd36ffbc95623/kT6VO8BADs3vNPGRuucs9.png)
19
+
20
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/66a2a6820c4cd36ffbc95623/a3ZVY-APXxozDZLE2lTVq.png)
21
+
22
  <i>You can theoretically change the weights to trigger different events with different probabilities. For simplicity, you can also match all separate "dice results" with a given fiction result or a TTRPG system DC (something like: we roll 1d6, we fail at 1-3 so: 1 = {{user}} will fail in {{user}}'s' action, 2 = {{user}} will fail in {{user}}'s' action, 3 = {{user}} will fail in {{user}}'s action', 4 = {{user}} will succeed in {{user}}'s action etc.'). I rather prefer having equal weights and repeated entries rather than messing with the weights. We never know, which actual RNG simulator a given software will use so this way - we take control of that forcing the real, equal distribution. It's also why Excell RNG for dice rolling is more realistic than dice rolling apps, just if you're curious (I'm working in game dev).</i>
23
 
24
  <b>3. Write instructions inside of the entries. They must be short, clear and include a specific word: "WILL". It seems to be very, very important. Otherwise, it might not work - at least with Mistral models and their fine-tunes.</b>
 
28
 
29
  Again, it seems that a word "will" is the best working trigger. Here, maybe "OOC" instructions would also be a good idea but since keys at depth = system are inserted already as instructions inside of a prompt itself (I checked, they're [INST] (...) [/INSTR] for Mistral), I'm not sure if it makes any sense.
30
 
31
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/66a2a6820c4cd36ffbc95623/QXwxJsNx1CNMyJwVLe8FJ.png)
32
+
33
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/66a2a6820c4cd36ffbc95623/Y3Qil3XhVBJGN2_3LzlT7.png)
34
+
35
  <b>TRICKS:</b>
36
  1. it may be good using one, specific word to trigger the entry group so it does not trigger again and again with different results as you or LLM repeats the trigger word - such as - attack or defend or whatever. You can use something like... roll 1d20 even - if you're into TTRPG. However, in different situations, recursive triggering may prove beneficial - then you may want to lower a "sticky" value but 5 seems balanced (LLM counts both {{user}} and {{char}} messages, if you're interested to know).
37
  2. depending on the use-case, you will need a couple of such entry groups (like different "dice rolls" for social encounters, different for random events in the world and different for dungeons exploring). IT WORKS VERY WELL.