GPT2-AR-30k / tokenizer_config.json
xiulinyang's picture
Add checkpoint
0042a61
raw
history blame
43 Bytes
{"tokenizer_class": "PassthroughTokenizer"}