Transformers
et_ec_bpe250 / special_tokens_map.json
iszoke's picture
Upload tokenizer
28b2429 verified
raw
history blame contribute delete
135 Bytes
{
"bos_token": "([bos])",
"eos_token": "([eos])",
"mask_token": "([mask])",
"pad_token": "([pad])",
"unk_token": "([unk])"
}