@clowman how did you know what value to use?
@joey711 I was trying to serve it with VLLM and put in a guess value and then VLLM errored out and gave me the correct value.
· Sign up or log in to comment