vLLM lates dev build failing with:
Errors:
File "/home/robo/.cache/huggingface/modules/transformers_modules/baidu/ERNIE-4.5-VL-28B-A3B-PT/39a152ff17303939b06edc1b8d1a2ea7b31e8ec7/processing_ernie_45t_vl.py", line 46, in (VllmWorker rank=0 pid=93282) ERROR 07-09 03:13:08 [multiproc_executor.py:487] from .tokenization_ernie_45t_vl import Ernie4_5_VLTokenizer (VllmWorker rank=0 pid=93282) ERROR 07-09 03:13:08 [multiproc_executor.py:487] ModuleNotFoundError: No module named 'transformers_modules.baidu.ERNIE-4'
File "/home/robo/.cache/huggingface/modules/transformers_modules/ERNIE-4.5-VL-28B-A3B-PT/processing_ernie_45t_vl.py", line 46, in ERROR 07-09 03:03:16 [core.py:586] from .tokenization_ernie_45t_vl import Ernie4_5_VLTokenizer ERROR 07-09 03:03:16 [core.py:586] ModuleNotFoundError: No module named 'transformers_modules.ERNIE-4.5-VL-28B-A3B-PT' Process
The vllm running the Ernie45 multimodal model is still under development. Support will be provided in the near future, You can use FastDeploy to deploy the paddle version for priority experience
Text model is already supported in vllm 0.9.2