Text Generation
English
How to use reasoning models.
How to use thinking models.
How to create reasoninng models.
deepseek
reasoning
reason
thinking
all use cases
creative
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
romance
all genres
story
writing
vivid writing
fiction
roleplaying
bfloat16
float32
float16
role play
sillytavern
backyard
lmstudio
Text Generation WebUI
llama 3
mistral
llama 3.1
qwen 2.5
context 128k
mergekit
Merge
Update README.md
Browse files
README.md
CHANGED
@@ -287,11 +287,41 @@ Model behaviour may change with other parameter(s) and/or sampler(s) activated -
|
|
287 |
|
288 |
---
|
289 |
|
290 |
-
<B>System Role / System
|
|
|
|
|
291 |
|
292 |
---
|
293 |
|
294 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
295 |
|
296 |
SIMPLE:
|
297 |
|
|
|
287 |
|
288 |
---
|
289 |
|
290 |
+
<B>System Role / System Prompts - Reasoning On/Off/Variable and Augment The Model's Power:</b>
|
291 |
+
|
292 |
+
<small> ( <font color="red">Critical Setting for model operation </font> ) </small>
|
293 |
|
294 |
---
|
295 |
|
296 |
+
System Role / System Prompt / System Message (called "System Prompt" in this section)
|
297 |
+
is "root access" to the model and controls internal workings - both instruction following and output generation and in the
|
298 |
+
case of this model reasoning control and on/off for reasoning too.
|
299 |
+
|
300 |
+
In this section I will show you basic, advanced, and combined "code" to control the model's reasoning, instruction following and output generation.
|
301 |
+
|
302 |
+
If you do not set a "system prompt", reasoning/thinking will be OFF by default
|
303 |
+
( unless the model has automatic invoking - IE always in "thinking mode" ), and the model will operate like a normal LLM.
|
304 |
+
|
305 |
+
HOW TO SET:
|
306 |
+
|
307 |
+
Depending on your AI "app" you may have to copy/paste on of the "codes" below to enable reasoning/thinking in the
|
308 |
+
"System Prompt" or "System Role" window.
|
309 |
+
|
310 |
+
In Lmstudio set/activate "Power User" or "Developer" mode to access, copy/paste to System Prompt Box.
|
311 |
+
|
312 |
+
In SillyTavern go to the "template page" ("A") , activate "system prompt" and enter the text in the prompt box.
|
313 |
+
|
314 |
+
In Ollama see [ https://github.com/ollama/ollama/blob/main/README.md ] ; and setting the "system message".
|
315 |
+
|
316 |
+
In Koboldcpp, load the model, start it, go to settings -> select a template and enter the text in the "sys prompt" box.
|
317 |
+
|
318 |
+
SYSTEM PROMPTS AVAILABLE:
|
319 |
+
|
320 |
+
When you copy/paste PRESERVE formatting, including line breaks.
|
321 |
+
|
322 |
+
If you want to edit/adjust these only do so in NOTEPAD OR the LLM App directly.
|
323 |
+
|
324 |
+
|
325 |
|
326 |
SIMPLE:
|
327 |
|