janakhpon
/

mon_tokenizer

Model card Files Files and versions

mon_tokenizer / tokenizer.json

janakhpon's picture

feat: migrate the artifact from SentencePiece to tokenizers JSON

954bd9d 3 months ago

Raw History Contribute Delete

4.86 MB

File too large to display, you can check the raw version instead.