vllm推理32k-128k输入

#17
by luckyZhangHu - opened

vllm推理, 按默认的config.json中, max_position-embedding-128000, 是否能正常处理 32k-128k的长图文理解输入?

Sign up or log in to comment