unsloth

/

Jan-nano-128k-GGUF

like 21

Follow

Unsloth AI 6.66k

I'm seeing the following default parameters for Q6_K:

temperature                    0.6
top_k                          20
top_p                          0.95
repeat_penalty                 1
stop                           "<|im_start|>"
stop                           "<|im_end|>"

Which slightly differs from recommended parameters on README.