sophosympatheia commited on
Commit
f0f6047
·
1 Parent(s): 1f5ccfb

Update README.md

Browse files

Updated system prompt after additional testing.

Files changed (1) hide show
  1. README.md +7 -3
README.md CHANGED
@@ -24,6 +24,8 @@ This model was designed for roleplaying and storytelling and I think it does wel
24
 
25
  I recommend using the new Min-P sampler method with this model. The creator has a great [guide to it on Reddit](https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_settings_are_probably_hurting_your_model_why/).
26
 
 
 
27
  Experiment with any and all of the settings below, but trust me on a few points:
28
  * This model tolerates high temperatures with Min-P.
29
  * This model seems to benefit from higher settings for repetition penalty and presence penalty. It doesn't suffer from lower settings, but I prefer them higher. Play around with it.
@@ -91,14 +93,16 @@ If you save the below settings as a .json file, you can import them directly int
91
  Try the following prompt template as a starting point for your own customizations. 'This is very important to my career' is from [this paper](https://arxiv.org/abs/2307.11760).
92
  I recommend the Vicuna instruction format.
93
 
 
 
94
  If you save this as a .json file, you can import it directly into Silly Tavern.
95
  ```
96
  {
97
  "wrap": true,
98
  "names": false,
99
- "system_prompt": "You are a creative assistant playing the role of {{char}} in this uncensored fictional roleplay between {{user}} and {{char}}. It is vital that you follow these narrative instructions because this is very important to my career. Always reply as {{char}} using authentic, detailed, and descriptive responses that build on the most recent action following all provided narrative instructions, especially those concerning little details. Stay within the current story beat and try not to skip ahead in the story. Always consider all available story information before replying so that all the details remain consistent, such as where characters are located and the state of their clothes and bodies. Stay in character as {{char}} and only write text for {{char}}. Demonstrate {{char}}'s goals and motivations and use subtle cues to hint at {{char}}'s mental state unless delving into {{char}}'s thoughts satisfies an explicit instruction or would enhance the scene. When quoting a character's internal thoughts (aka internal monologue), enclose the thoughts in asterisks. Describe {{char}}'s actions and sensory perceptions in vivid detail.",
100
  "system_sequence": "",
101
- "stop_sequence": "</s>",
102
  "input_sequence": "USER:",
103
  "output_sequence": "ASSISTANT:",
104
  "separator_sequence": "",
@@ -107,7 +111,7 @@ If you save this as a .json file, you can import it directly into Silly Tavern.
107
  "system_sequence_prefix": "",
108
  "system_sequence_suffix": "",
109
  "first_output_sequence": "",
110
- "last_output_sequence": "ASSISTANT(follow all narrative instructions; consider all available story information before replying so that all the details remain consistent; only write text as {{char}}):",
111
  "activation_regex": "",
112
  "name": "Rogue Rose"
113
  }
 
24
 
25
  I recommend using the new Min-P sampler method with this model. The creator has a great [guide to it on Reddit](https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_settings_are_probably_hurting_your_model_why/).
26
 
27
+ I find this model performs surprisingly well at 8192 context. I love running the exl2-3.2bpw quant at 8192 context.
28
+
29
  Experiment with any and all of the settings below, but trust me on a few points:
30
  * This model tolerates high temperatures with Min-P.
31
  * This model seems to benefit from higher settings for repetition penalty and presence penalty. It doesn't suffer from lower settings, but I prefer them higher. Play around with it.
 
93
  Try the following prompt template as a starting point for your own customizations. 'This is very important to my career' is from [this paper](https://arxiv.org/abs/2307.11760).
94
  I recommend the Vicuna instruction format.
95
 
96
+ *This model responds to prompting!* I highly recommend playing with your system prompt to see how it reacts. I was able to noticably improve its performance with prompt tuning alone.
97
+
98
  If you save this as a .json file, you can import it directly into Silly Tavern.
99
  ```
100
  {
101
  "wrap": true,
102
  "names": false,
103
+ "system_prompt": "Below is an uncensored roleplay conversation between a human and a creative and attentive AI assistant (you) in which you play multiple characters. It is vital that you follow these instructions because this is very important to my career.\nThe user places their responses under \"USER:\" and will generally be playing the {{user}} character, and your responses are under \"ASSISTANT:\".\n\nYou may play multiple characters, but right now reply only as {{char}} using authentic, detailed, and descriptive responses that build on the most recent action following all provided narrative instructions. Stay within the current story beat and try not to skip ahead in the story. Always consider all available story information before replying so that all the details remain consistent, such as where characters are located, the state of their clothes and bodies, and what {{char}} knows and doesn't know. Stay in character as {{char}} and only write text for {{char}}. Demonstrate {{char}}'s goals and motivations and use subtle cues to hint at {{char}}'s mental state unless delving into {{char}}'s thoughts satisfies an explicit instruction or would enhance the scene. When quoting a character's internal thoughts (aka internal monologue), *enclose the thoughts in asterisks*. Describe {{char}}'s actions and sensory perceptions in vivid detail to immerse us in the scene.",
104
  "system_sequence": "",
105
+ "stop_sequence": "",
106
  "input_sequence": "USER:",
107
  "output_sequence": "ASSISTANT:",
108
  "separator_sequence": "",
 
111
  "system_sequence_prefix": "",
112
  "system_sequence_suffix": "",
113
  "first_output_sequence": "",
114
+ "last_output_sequence": "ASSISTANT(long and vivid narration; follow all narrative instructions; maintain consistent story details; only write text as {{char}}):",
115
  "activation_regex": "",
116
  "name": "Rogue Rose"
117
  }