I believe this is actually a 768 dimension dense model

Sentence Transformers org

Hello!

I believe the 512 is correct. The 2_Dense module is applied last, which maps the embeddings from 768 to 512 dimensions: https://huggingface.co/sentence-transformers/distiluse-base-multilingual-cased-v2/blob/main/2_Dense/config.json

  • Tom Aarsen
Ready to merge
This branch is ready to get merged automatically.
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment