This model is an early preview. Lots of work needs to be done (document usage, prepare quants, etc.).
Uses llama3 like template with these changes:
- Uses
<s>
as BOS (like regular Mistral Nemo) -- this is handled by most backends for you, so you should most likely not add it manually - Knows special
writer
role- Use
writer
for writing - Use
writer character John Doe
for role-play messages from John Doe - use
writer narrative
for role-play messages that are pure narrative without any attribution to any of the characters
- Use
- Can do reasoning, uses
<|reasoning_start|>
and<|reasoning_end|>
tokens, putThink deeply before answering.
into yoursystem
prompt or into youruser
turn -- you can enable reasoning selectively. - etc. etc.
Silly Tavern Preset
Basic Role Play
Verbose Role Play
Use this Master Preset, but change the Assistant Message Prefix to this:
<|start_header_id|>user<|end_header_id|>
Make the next message roughly 100 words long.<|eot_id|><|start_header_id|>writer character {{char}}<|end_header_id|>
(Make sure to preserve the newlines!)
You can change the instruction Make the next message roughly 100 words long.
to anything else, e.g. Make the next message roughly 100 words long, it should be 75% dialog and 25% narrative
.
You can also use /sys
message send instructions.
Example Prompts:
(Remove the <s>
if you backend adds it automatically)
{{foo}}
represents placeholders you should fill in with actual text.
Write a story based on a prompt, but plan it first
It will first plan it as assistant
and then write it as a writer
. Remove the user
turn if you don't want planning.
<s><|start_header_id|>system<|end_header_id|>
You are writer and also a writing assistant with expertise in all genres.
Please write a very short story (roughly 500 words) that is sexual following this prompt:
{{writing_prompt}}.<|eot_id|><|start_header_id|>user<|end_header_id|>
Plan the plot of the story in the form of a bullet point list<|eot_id|><|start_header_id|>assistant<|end_header_id|>
Role-play with multiple characters
Example system prompt for multi-character role-play.
You are a skilled role-play writer and writing assistant with expertise across all genres but you specialize in {{genre}}.
You will perform several tasks, switching roles as needed:
- Role-Playing: Use the \`writer\` role to write a role-play based on the provided information (plot, style, setting, characters, etc.) and user instructions. Use the \`writer character <character_name>\` role for dialog or when acting as a specific character, use the \`writer narrative\` role for narration.
- Planning: Use the \`assistant\` role to provide outline for the next scene or chapter upon request.
- Other: Use the \`assistant\` role for any other tasks the user may request.
# Role-Play Information
## Plot
{{plot_description}}
## Previous Events
{{summary_of_previous_events}}
## Writing Style
{{writing_style_description}}
## Setting
{{setting_description}}
## Characters
### {{char1}}
{{char1_description}}
### {{char2}}
{{char2_description}}
## Locations
### {{loc1}}
{{loc1_description}}
### {{loc2}}
{{loc2_description}}
## Items
...
All sections are of course optional. You cna also use different formatting if you wish.
License
- The model and its derivatives (e.g. merges, fine-tunes, etc.) is meant for non-commercial personal use only.
- The text outputs of the model are yours to do with as you please.
- Downloads last month
- 4