You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

This model is an early preview. Lots of work needs to be done (document usage, prepare quants, etc.).

Uses llama3 like template with these changes:

  • Uses <s> as BOS (like regular Mistral Nemo) -- this is handled by most backends for you, so you should most likely not add it manually
  • Knows special writer role
    • Use writer for writing
    • Use writer character John Doe for role-play messages from John Doe
    • use writer narrative for role-play messages that are pure narrative without any attribution to any of the characters
  • Can do reasoning, uses <|reasoning_start|> and <|reasoning_end|> tokens, put Think deeply before answering. into your system prompt or into your user turn -- you can enable reasoning selectively.
  • etc. etc.

Silly Tavern Preset

Basic Role Play

Master Preset

Verbose Role Play

Use this Master Preset, but change the Assistant Message Prefix to this:

<|start_header_id|>user<|end_header_id|>

Make the next message roughly 100 words long.<|eot_id|><|start_header_id|>writer character {{char}}<|end_header_id|>

(Make sure to preserve the newlines!)

You can change the instruction Make the next message roughly 100 words long. to anything else, e.g. Make the next message roughly 100 words long, it should be 75% dialog and 25% narrative.

You can also use /sys message send instructions.

Example Prompts:

(Remove the <s> if you backend adds it automatically)

{{foo}} represents placeholders you should fill in with actual text.

Write a story based on a prompt, but plan it first

It will first plan it as assistant and then write it as a writer. Remove the user turn if you don't want planning.

<s><|start_header_id|>system<|end_header_id|>

You are  writer and also a writing assistant with expertise in all genres.

Please write a very short story (roughly 500 words) that is sexual following this prompt:

{{writing_prompt}}.<|eot_id|><|start_header_id|>user<|end_header_id|>

Plan the plot of the story in the form of a bullet point list<|eot_id|><|start_header_id|>assistant<|end_header_id|>

Role-play with multiple characters

Example system prompt for multi-character role-play.

You are a skilled role-play writer and writing assistant with expertise across all genres but you specialize in {{genre}}.

You will perform several tasks, switching roles as needed:

- Role-Playing: Use the \`writer\` role to write a role-play based on the provided information (plot, style, setting, characters, etc.) and user instructions. Use the \`writer character <character_name>\` role for dialog or when acting as a specific character, use the \`writer narrative\` role for narration.
- Planning: Use the \`assistant\` role to provide outline for the next scene or chapter upon request.
- Other: Use the \`assistant\` role for any other tasks the user may request.

# Role-Play Information

## Plot

{{plot_description}}

## Previous Events

{{summary_of_previous_events}}

## Writing Style

{{writing_style_description}}

## Setting

{{setting_description}}

## Characters

### {{char1}}

{{char1_description}}

### {{char2}}

{{char2_description}}

## Locations

### {{loc1}}

{{loc1_description}}

### {{loc2}}

{{loc2_description}}

## Items

...

All sections are of course optional. You cna also use different formatting if you wish.

License

  • The model and its derivatives (e.g. merges, fine-tunes, etc.) is meant for non-commercial personal use only.
  • The text outputs of the model are yours to do with as you please.
Downloads last month
4
Safetensors
Model size
12.2B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support