Optimal Sampling Settings

#1
by kth8 - opened

What are the optimal sampling settings for this model such as TEMPERATURE, TOP_K, TOP_P, MIN_P, REPETITION_PENALTY, etc?

kth8 changed discussion status to closed

Sign up or log in to comment