Hugging Face's logo

blester125
/
supervocab-tiktoken-gpt-4o

Model card Files Community
blester125 commited on
Commit
c3a5276
·
verified ·
1 Parent(s): 65e161a

Upload folder using huggingface_hub

Browse files
Files changed (4) hide show
  1. model.pth +1 -1
  2. tiktoken--gpt-4o.yaml +4 -0
  3. tiktoken--gpt-4o_info.json +1 -1
  4. tiktoken--gpt-4o_super_mapping.json +0 -0
model.pth CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:de9aafb9a0704f777a5db7d53b94e62ef18052ef675bf28377ba09590b7b3ca9
3
  size 8415613570
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1505289a8b499b4ed86ad3fa44e1932f73591142647f2e9e4cfce938cf3d6aa0
3
  size 8415613570
tiktoken--gpt-4o.yaml ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ data:
2
+ tokenizer:
3
+ name: tiktoken
4
+ path: gpt-4o
tiktoken--gpt-4o_info.json CHANGED
@@ -1 +1 @@
1
- {"backend": "tiktoken", "name": "gpt-4o"}
 
1
+ {"data": {"tokenizer": {"name": "tiktoken", "path": "gpt-4o"}}}
tiktoken--gpt-4o_super_mapping.json CHANGED
The diff for this file is too large to render. See raw diff