Tom Aarsen

Indeed, prompts are done automatically with MTEB! The transformers version does likely mean that you'll get better results with an update

Quick question, were you on the recommended transformers version (https://huggingface.co/blog/embeddinggemma#sentence-transformers), and did you use the prompts (i.e. either call the model with model.encode_query/model.encode_document/model.encode(..., prompt_name="query") in Sentence Transformers?

There's a few ways for it to quietly go wrong!