Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
jonasaise
/
oellm_tokenizer_262k_v2
like
0
42 languages
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
oellm_tokenizer_262k_v2
5.21 MB
1 contributor
History:
5 commits
jonasaise
Update languages and fix
e582746
verified
28 days ago
.gitattributes
Safe
1.52 kB
initial commit
28 days ago
README.md
3.75 kB
Update languages and fix
28 days ago
added_tokens.json
41 Bytes
Upload folder using huggingface_hub
28 days ago
special_tokens_map.json
Safe
555 Bytes
Upload folder using huggingface_hub
28 days ago
tokenizer.model
5.2 MB
xet
Upload folder using huggingface_hub
28 days ago
tokenizer_config.json
1.13 kB
Upload folder using huggingface_hub
28 days ago
