Underrated model
#8
by
urtuuuu
- opened
Just wanted to say that this model is incredibly strong. Just tried latest quants by Unsloth. And it seems to solve almost all hard tests questions i use for all models.
I'm starting to think that these magic settings i use are making difference :) --temp 0.6 --min_p 0 --top_k 0 (but not sure)
Yes, it's a great model. Thanks for the heads up on the temp. I've added it to the rest of my flags like this:
--temp 0.6 --top_p 0.95 --repeat_penalty 1.1 --frequency_penalty 0.1
Have you found a good system prompt for this model?
This model is mind blowing. Qwen 2.5 coder feels obsolete after using this. Wow.