Sol-Reaver 15B

Model Information

Sol-Reaver-15B-Instruct

15B parameters Creative / Fresh Prose Co-writing/Roleplay/Adventure Generalist

The first in the line of a New series of Roleplay / Adventure / Co-writer Models - Finetuned ontop of Sol-Reaver-15B-Pretrain

This model has been trained on 200M tokens of high quality Instruct data, It's focus is to provide a base for further finetuning|Merging

It's goal is to have refreshing Prose, Creativity, Good Instruct following and the *Brains*.

Quantized Versions

Available Downloads

GGUF FormatFor use with LLama.cpp & Forks(Coming Soon!)
EXL2 FormatFor use with TabbyAPI (Coming Soon!)
EXL3 FormatFor use with TabbyAPI (Slower on Ampere))

Prompting

Model has been tuned with the ChatML formatting. A typical input would look like this:

<|im_start|>user
Hi there!<|im_end|>
<|im_start|>assistant
Nice to meet you!<|im_end|>
<|im_start|>user
Can I ask a question?<|im_end|>
<|im_start|>assistant

Samplers

For testing of this model, I used Temp=1, 0.1 Min-P.

See Axolotl Config


              https://wandb.ai/new-eden/Rae/artifacts/axolotl-config/config-7d4ecudg/v0/files/axolotl_config_avyx566_.yml

Training

The training was done for 2 epoch using 8 x H200s GPUs graciously provided by Kalomaze for the fine-tuning of the model.

Credits

Thank you to Lucy Knada, Ateron, Alicat, Intervitens, Cgato, Kubernetes Bad and the rest of Anthracite.

Sol Reaver 15B