Text model weight names cause error in loading.
#1
by
ostris
- opened
First, thank you for doing this! Super cool and I am experimenting with it. I wanted to bring to your attention that the text model weight keys are
text_model.text_model.embeddings.position_embedding.weight
vs
text_model.embeddings.position_embedding.weight
There is an extra text_model on all the weights that prevents it from loading with transformers.