DavidAU commited on
Commit
0857cc0
·
verified ·
1 Parent(s): 993b7a5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -2
README.md CHANGED
@@ -172,11 +172,38 @@ Model behaviour may change with other parameter(s) and/or sampler(s) activated -
172
 
173
  ---
174
 
175
- <B>System Role / System Prompt - Augment The Model's Power:</b>
 
 
176
 
177
  ---
178
 
179
- If you set / have a system prompt this will affect both "generation" and "thinking/reasoning".
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
180
 
181
  SIMPLE:
182
 
 
172
 
173
  ---
174
 
175
+ <B>System Role / System Prompts - Reasoning On/Off/Variable and Augment The Model's Power:</b>
176
+
177
+ <small> ( <font color="red">Critical Setting for model operation </font> ) </small>
178
 
179
  ---
180
 
181
+ System Role / System Prompt / System Message (called "System Prompt" in this section)
182
+ is "root access" to the model and controls internal workings - both instruction following and output generation and in the
183
+ case of this model reasoning control and on/off for reasoning too.
184
+
185
+ In this section I will show you basic, advanced, and combined "code" to control the model's reasoning, instruction following and output generation.
186
+
187
+ If you do not set a "system prompt", reasoning/thinking will be OFF by default, and the model will operate like a normal LLM.
188
+
189
+ HOW TO SET:
190
+
191
+ Depending on your AI "app" you may have to copy/paste on of the "codes" below to enable reasoning/thinking in the
192
+ "System Prompt" or "System Role" window.
193
+
194
+ In Lmstudio set/activate "Power User" or "Developer" mode to access, copy/paste to System Prompt Box.
195
+
196
+ In SillyTavern go to the "template page" ("A") , activate "system prompt" and enter the text in the prompt box.
197
+
198
+ In Ollama see [ https://github.com/ollama/ollama/blob/main/README.md ] ; and setting the "system message".
199
+
200
+ In Koboldcpp, load the model, start it, go to settings -> select "Llama 3 Chat"/"Command-R" and enter the text in the "sys prompt" box.
201
+
202
+ SYSTEM PROMPTS AVAILABLE:
203
+
204
+ When you copy/paste PRESERVE formatting, including line breaks.
205
+
206
+ If you want to edit/adjust these only do so in NOTEPAD OR the LLM App directly.
207
 
208
  SIMPLE:
209