Same as xlm-roberta-base, but with position embeddings that can accommodate 2048 tokens.

See this notebook for how it was created.

Downloads last month
4
Safetensors
Model size
279M params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support