sophie_rain / tokenizer

Commit History

Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json
286feed
verified

Faketrevor commited on

Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json
074e25f
verified

Faketrevor commited on

Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json
584f336
verified

Faketrevor commited on

Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt
b9b2a7b
verified

Faketrevor commited on

Rename tokenizer_merges.txt to tokenizer/tokenizer_merges.txt
09f9abc
verified

Faketrevor commited on

Rename tokenizer_special_tokens_map.json to tokenizer/tokenizer_special_tokens_map.json
507f7b2
verified

Faketrevor commited on

Rename tokenizer_tokenizer_config.json to tokenizer/tokenizer_tokenizer_config.json
72ea488
verified

Faketrevor commited on

Rename tokenizer_vocab.json to tokenizer/tokenizer_vocab.json
5156bc9
verified

Faketrevor commited on