ERROR：Gemma3Config' object has no attribute 'vocab_size'
INFO 03-13 14:12:23 transformers.py:129] Using Transformers backend.
ERROR 03-13 14:12:23 engine.py:400] 'Gemma3Config' object has no attribute 'vocab_size'
ERROR 03-13 14:12:23 engine.py:400] Traceback (most recent call last):
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/engine/multiprocessing/engine.py", line 391, in run_mp_engine
ERROR 03-13 14:12:23 engine.py:400] engine = MQLLMEngine.from_engine_args(engine_args=engine_args,
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/engine/multiprocessing/engine.py", line 124, in from_engine_args
ERROR 03-13 14:12:23 engine.py:400] return cls(ipc_path=ipc_path,
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/engine/multiprocessing/engine.py", line 76, in init
ERROR 03-13 14:12:23 engine.py:400] self.engine = LLMEngine(*args, **kwargs)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/engine/llm_engine.py", line 273, in init
ERROR 03-13 14:12:23 engine.py:400] self.model_executor = executor_class(vllm_config=vllm_config, )
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/executor/executor_base.py", line 52, in init
ERROR 03-13 14:12:23 engine.py:400] self._init_executor()
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/executor/uniproc_executor.py", line 47, in _init_executor
ERROR 03-13 14:12:23 engine.py:400] self.collective_rpc("load_model")
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/executor/uniproc_executor.py", line 56, in collective_rpc
ERROR 03-13 14:12:23 engine.py:400] answer = run_method(self.driver_worker, method, args, kwargs)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/utils.py", line 2196, in run_method
ERROR 03-13 14:12:23 engine.py:400] return func(*args, **kwargs)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/worker/worker.py", line 183, in load_model
ERROR 03-13 14:12:23 engine.py:400] self.model_runner.load_model()
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/worker/model_runner.py", line 1112, in load_model
ERROR 03-13 14:12:23 engine.py:400] self.model = get_model(vllm_config=self.vllm_config)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/model_executor/model_loader/init.py", line 14, in get_model
ERROR 03-13 14:12:23 engine.py:400] return loader.load_model(vllm_config=vllm_config)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/model_executor/model_loader/loader.py", line 406, in load_model
ERROR 03-13 14:12:23 engine.py:400] model = _initialize_model(vllm_config=vllm_config)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/model_executor/model_loader/loader.py", line 125, in _initialize_model
ERROR 03-13 14:12:23 engine.py:400] return model_class(vllm_config=vllm_config, prefix=prefix)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/model_executor/models/transformers.py", line 135, in init
ERROR 03-13 14:12:23 engine.py:400] self.vocab_size = config.vocab_size
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/transformers/configuration_utils.py", line 214, in getattribute
ERROR 03-13 14:12:23 engine.py:400] return super().getattribute(key)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] AttributeError: 'Gemma3Config' object has no attribute 'vocab_size'
Seems like you are trying to load this model as AutoModelForCausalLM. Gemma3 is multimodal and its submodule language_model belongs to this class.
same problem here too
Apologies for the delayed response. We can confirm that this issue has been addressed and resolved in Transformers version 4.53.0.
Could you please try again by installing the latest Transformers version using !pip install -U transformers and then load the gemma-3-27b-it model with the following code:
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("google/gemma-3-27b-it")
Please let us know if this resolves the issue or if you continue to experience the same problem. Thank you.