shan_bpe_extened_tokenizer / tokenizer_config.json
NorHsangPha's picture
Upload tokenizer
28fdc01 verified
raw
history contribute delete
4.26 MB
File too large to display, you can check the raw version instead.