[Error] (Qwen2.5-VL-instruct-7B) Qwen2TokenizerFast object has no attribute 'tokenizer'
#21
by
yus002
- opened
Hi,
I use Xinference to deploy Qwen2.5-VL-instruct-7B and get the error: "Qwen2TokenizerFast object has no attribute 'tokenizer".
How do I solve the issue? Is it related to the version requirement of some modules? The version of module transformers is 4.45.0.
Thanks!
I can use Xinference to deploy Qwen2-VL-7b-instruct in my current environment, but not for Qwen2.5-VL-instruct-7B.
yus002
changed discussion title from
Qwen2TokenizerFast object has no attribute 'tokenizer
to [Error] (Qwen2.5-VL-instruct-7B) Qwen2TokenizerFast object has no attribute 'tokenizer'
any updates
In the code it should be model.tokenizer.tokenizer to actually get the text tokenizer