Hello, I'm currently using the FAST tokenizer in a custom pipeline to train a model. The "Error decoding tokens" is happening a lot in the beginning of the training and overflows my log file. Is there a way to silent the warning ?
Thanks in advance
· Sign up or log in to comment
