branch "vbert" in colpali raise error: "AttributeError: 'SiglipConfig' object has no attribute 'vision_model_name'"
#1
by
sic
- opened
I think something wromg when the config loading
The easy fix is to load the model and processor with the additional argument :revision="76d88a509a9951cda482c9f36002f481c2940b42"
full loading code :
path_model = "ModernVBERT/colmodernvbert-base" # base model to finetune
model = ColModernVBert.from_pretrained(path_model, revision="76d88a509a9951cda482c9f36002f481c2940b42", torch_dtype=torch.float16)
processor = ColModernVBertProcessor.from_pretrained(path_model, revision="76d88a509a9951cda482c9f36002f481c2940b42")
We're currently cleaning the modeling code on our end and the model's config was updated a bit too early which broke things. We're going to merge everything soon and all should be good, waiting for that the fix I gave you is the easiest solution.
Okay, I’ll give it a try and look forward to your fix.
QuentinJG
changed discussion status to
closed
