question about 'model_type' in config.json

by XA-hyy - opened Feb 25

Feb 25

why param "model_type" in config.json is siglip,siglip_text_model and siglip_vision_model, not siglip2, siglip2_text_model and siglip2_vision_model？I noticed existed model class 'Siglip2Model',but still use 'SiglipModel'

qubvel-hf

Feb 25

Hey @XA-hyy , Siglip2Model is only for -naflex checkpoints. Other checkpoints are compatible with Siglip (v1)

XA-hyy

Mar 3

•

edited Mar 3

Hello @qubvel-hf ，Could you provide me a text script to reproduce the flickr30k indicator in the paper（T2I Recall@1 is 85%）? My test indicator T2I Recall@1 is only 77%(siglip2-large-patch16-384)，thanks！

JohnsonWythe

16 days ago

Hi, I still got a question here. I found it is not compatible with siglip v1. patch embedding uses conv2d in v1 but uses dense in v2.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment