error from updated tokenizer

#17
by BrentBaccala - opened

I'm having a problem loading this model, it seems to be the same issue described here:

https://github.com/huggingface/transformers/issues/22762

In short, it looks like the tokenizer code was updated, and this model's tokenizer no longer works with the most recent code.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment