loading xlm v as feature extractor and feature tokenizer

#2
by chao0619 - opened

with code

from transformers import XLMRobertaModel, XLMRobertaTokenizer

extractor = XLMRobertaModel(roberta_path)
tokenizer = XLMRobertaTokenizer(roberta_path)

then we can get word embedding from it
how can i do the same with XLM-V Modell
Although i have changed the path to XLM-V Path
A warning is thrown out
some weights were not initialized from checkpoint. You should probabely train this model on a down-stream task to be able to use it for predictions and inference

Sign up or log in to comment