GPT2-AR-20k / tokenizer_config.json
xiulinyang's picture
Add checkpoint
1b0a601
raw
history blame
43 Bytes
{"tokenizer_class": "PassthroughTokenizer"}