Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ZigZeug
/
wolof-tokenizer-v1
like
0
Model card
Files
Files and versions
xet
Community
main
wolof-tokenizer-v1
/
added_tokens.json
ZigZeug
Upload tokenizer
08d2e47
verified
3 months ago
raw
Copy download link
history
blame
contribute
delete
Safe
91 Bytes
{
"</s>"
:
15675
,
"<mask>"
:
15678
,
"<pad>"
:
15677
,
"<s>"
:
15674
,
"<unk>"
:
15676
}