In the right direction

#1
by notafraud - opened

Hi! Thank you for this model, it's definitely better than the base Mistral 3.1 in creative writing (tested with Mistral's template). Alas, it still generates quite a lot of "slop", but it's a move in the right direction!

Owner

Hi! Thank you for this model, it's definitely better than the base Mistral 3.1 in creative writing (tested with Mistral's template). Alas, it still generates quite a lot of "slop", but it's a move in the right direction!

Thanks a lot for the feedback! I'm still learning and experimenting, so it's great to hear it's a step up from the base. If you have any suggestions, I'd love to hear them.

Thanks a lot for the feedback! I'm still learning and experimenting, so it's great to hear it's a step up from the base. If you have any suggestions, I'd love to hear them.

I'll be as unoriginal as it can be: the slop ("dimly lit" and other similar phrases/words) is quite annoying. Mistral 3/3.1 are good at making instructions for themselves, but even those instruction help only that much.

You can test the slop using EQ's Creative Benchmark samples, they are more or less universal. Plus, it's easy to expand them.

Tested a bit more and can say that it's a very good model:

  1. Prompt adherence seems to be better than the original model
  2. Retains quality of writing and understanding the context
  3. Less censored than the original model and Omega finetunes (tested against The-Omega-Concession-M-24B-v1.0).

IMO this is how Mistral 3 should have been from the start: it's still a bit strict in writing, but feels much better - like an actual step up from Mistral 2.

Note: this is still for Mistral Tekken prompt format, haven't tested it with ChatML format yet.

Sign up or log in to comment