branch "vbert" in colpali raise error: "AttributeError: 'SiglipConfig' object has no attribute 'vision_model_name'"

#1
by sic - opened

I think something wromg when the config loading

image

ModernVBERT org

Hey @sic currently investigating, don't know what's going on here

Your transformers version is 4.53.3 right ?

Hey @sic currently investigating, don't know what's going on here

Your transformers version is 4.53.3 right ?

Yes, I successfully ran it on Colab a few days ago, but today when I tried again I got the above error.

ModernVBERT org

The easy fix is to load the model and processor with the additional argument :revision="76d88a509a9951cda482c9f36002f481c2940b42"

full loading code :

path_model = "ModernVBERT/colmodernvbert-base" # base model to finetune
model = ColModernVBert.from_pretrained(path_model, revision="76d88a509a9951cda482c9f36002f481c2940b42", torch_dtype=torch.float16)
processor = ColModernVBertProcessor.from_pretrained(path_model, revision="76d88a509a9951cda482c9f36002f481c2940b42")

We're currently cleaning the modeling code on our end and the model's config was updated a bit too early which broke things. We're going to merge everything soon and all should be good, waiting for that the fix I gave you is the easiest solution.

Okay, I’ll give it a try and look forward to your fix.

ModernVBERT org

@sic everything should work as before now ! thanks for flagging it out

QuentinJG changed discussion status to closed

Sign up or log in to comment