FileNotFoundError: [Errno 2] No such file or directory: 'Qwen/Qwen3-Embedding-0.6B/sentence_xlnet_config.json'

#24
by ColinZhao - opened

使用sentence-transformers加载qwen3 embedding报错,找不到'Qwen/Qwen3-Embedding-0.6B/sentence_xlnet_config.json'
版本如下:
sentence-transformers 4.1.0
transformers 4.52.4

请问这个是什么错误呢?我使用的代码就是demo中的代码,没有一点修改。

完整报错信息如下:
"""
Traceback (most recent call last):
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/sentence_transformers/SentenceTransformer.py", line 1808, in _load_sbert_model
module = module_class(model_name_or_path, cache_dir=cache_folder, backend=self.backend, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/sentence_transformers/models/Transformer.py", line 81, in init
self._load_model(model_name_or_path, config, cache_dir, backend, is_peft_model, **model_args)
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/sentence_transformers/models/Transformer.py", line 181, in _load_model
self.auto_model = AutoModel.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/transformers/models/auto/auto_factory.py", line 571, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/transformers/modeling_utils.py", line 309, in _wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/transformers/modeling_utils.py", line 4508, in from_pretrained
model = cls(config, *model_args, **model_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/transformers/models/qwen3/modeling_qwen3.py", line 389, in init
self.post_init()
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/transformers/modeling_utils.py", line 1969, in post_init
if v not in ALL_PARALLEL_STYLES:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: argument of type 'NoneType' is not iterable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/data/zhaoxinpeng-slurm/workspace/embeddding/test.py", line 10, in
model = SentenceTransformer("Qwen/Qwen3-Embedding-0.6B")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/sentence_transformers/SentenceTransformer.py", line 309, in init
modules, self.module_kwargs = self._load_sbert_model(
^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/sentence_transformers/SentenceTransformer.py", line 1810, in _load_sbert_model
module = module_class.load(model_name_or_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/sentence_transformers/models/Transformer.py", line 536, in load
with open(sbert_config_path) as fIn:
^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: 'Qwen/Qwen3-Embedding-0.6B/sentence_xlnet_config.json'
"""

我也一样,包已经安装到最新的了

我发现transformers版本在4.51.0时候可以正常工作

非常感谢,我试了4.51.0,确实没有报错了

Sign up or log in to comment