Any Recommendation for Parameters?

#4
by RoadToNowhere - opened

MistralAI recommend to use a temperature of 0.3.
What about other parameters?
For example, min_p, top_p, repetition penalty, frequency penalty, top_k......

Anthracite org

I usually just ran it fully neutral (temp 1) or with a min_p of 0.1 rest reset and it worked fine for me, but it's highly subjective so I'd welcome you to experiment and see what works for your use-case.

lucyknada changed discussion status to closed

Sign up or log in to comment