eliebak
/

the-tokenizer-v2

Inference Endpoints

Model card Files Files and versions Community

the-tokenizer-v2 / tokenizer_config.json

Commit History

fix vocab size by hand

17b1f92
verified

eliebak HF staff commited on Jun 17, 2024

Upload tokenizer

4da8c10
verified

eliebak HF staff commited on Jun 17, 2024