An experimental model, fine-tuned using the "multiplicative-LoRA" method on c4ai-command-r-v01.

This model is nearly identical to creative-writer-v0.1-alfa-35b except the pre-softmax logits were scaled by 1.1 during training to increased single-token Entropy, and it was trained using the new v0.2 dataset which is around 15% larger and also more carefully curated to remove any weird formatting.

Please refer to creative-writer-v0.1-alfa-35b for full details on how to use this model.

Downloads last month
11
Safetensors
Model size
35B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for jukofyork/creative-writer-v0.2-bravo-35b

Quantizations
2 models

Collection including jukofyork/creative-writer-v0.2-bravo-35b