Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ArabovMK
/
tajik-tokenizers-v1
like
0
Tajik
tajik
tokenizer
central-asia
nlp
linguistics
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
tajik-tokenizers-v1
Ctrl+K
Ctrl+K
1 contributor
History:
10 commits
ArabovMK
Update README.md
506ac9d
verified
3 months ago
.gitattributes
Safe
1.52 kB
initial commit
3 months ago
README.md
2.38 kB
Update README.md
3 months ago
tajik_bpe.json
Safe
2.41 MB
Upload tajik_bpe.json with huggingface_hub
3 months ago
tajik_sp_bpe.model
Safe
926 kB
xet
Upload tajik_sp_bpe.model with huggingface_hub
3 months ago
tajik_sp_bpe.vocab
648 kB
Upload tajik_sp_bpe.vocab with huggingface_hub
3 months ago
tajik_sp_unigram.model
Safe
965 kB
xet
Upload tajik_sp_unigram.model with huggingface_hub
3 months ago
tajik_unigram.json
Safe
2.1 MB
Upload tajik_unigram.json with huggingface_hub
3 months ago
tajik_wordpiece.json
Safe
856 kB
Upload tajik_wordpiece.json with huggingface_hub
3 months ago
