shuffle_nondeterministic_EN53 / tokenizer_config.json
xiulinyang's picture
Adding model checkpoints and config files
1d59c00
raw
history blame contribute delete
43 Bytes
{"tokenizer_class": "PassthroughTokenizer"}