Update README.md
Browse files
README.md
CHANGED
@@ -45,14 +45,14 @@ About half of the roleplay dataset is in Markdown asterisk format, but the major
|
|
45 |
|
46 |
Mistral really loves recommending unusual inference settings but I've been getting decent results with the settings below:
|
47 |
|
48 |
-
Yes, the temperature is correct. This model creates diversity at the training level, so any additional increase will simply cost you coherence instead.
|
49 |
-
|
50 |
```
|
51 |
"temperature": 0.5,
|
52 |
-
"repetition_penalty": 1.05,
|
53 |
"min_p": 0.05
|
54 |
```
|
55 |
|
|
|
|
|
56 |
Having character names in front of messages is not a requirement but remains a personal recommendation of mine - it seems to help the model focus more on the character(s) in question. World-focused text adventures do fine without it.
|
57 |
|
58 |
## Prompt Format
|
|
|
45 |
|
46 |
Mistral really loves recommending unusual inference settings but I've been getting decent results with the settings below:
|
47 |
|
|
|
|
|
48 |
```
|
49 |
"temperature": 0.5,
|
50 |
+
"repetition_penalty": 1.05, # Or use the DRY sampler!
|
51 |
"min_p": 0.05
|
52 |
```
|
53 |
|
54 |
+
Yes, the temperature is correct. This model creates diversity at the training level, so any additional increase will simply cost you coherence instead.
|
55 |
+
|
56 |
Having character names in front of messages is not a requirement but remains a personal recommendation of mine - it seems to help the model focus more on the character(s) in question. World-focused text adventures do fine without it.
|
57 |
|
58 |
## Prompt Format
|