shuffle_deterministic57_EN53 / tokenizer_config.json
xiulinyang's picture
Adding model checkpoints and config files
5906368
raw
history blame contribute delete
43 Bytes
{"tokenizer_class": "PassthroughTokenizer"}