deepvk

/

RuModernBERT-small

like 14

Follow

deep vk 211

python3.12
transformers == 4.48.1

204 self.drop = nn.Dropout(config.embedding_dropout)
--> 206 @torch .compile(dynamic=True)
207 def compiled_embeddings(self, input_ids: torch.LongTensor) -> torch.Tensor:
208 return self.drop(self.norm(self.tok_embeddings(input_ids)))

RuntimeError: Failed to import transformers.models.modernbert.modeling_modernbert because of the following error (look up to see its traceback):
Dynamo is not supported on Python 3.12+