Hugging Face's logo

eliebak
/
the-tokenizer-v1.5

Transformers
Inference Endpoints
Model card Files Community
1
eliebak HF staff commited on
Commit
80079d5
·
verified ·
1 Parent(s): e418e1e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -6,8 +6,8 @@ tags: []
6
  # Model Card for Model ID
7
 
8
  `lvwerra/the-tokenizer-v1` but replacing:
9
- - <fim_prefix> -> <|im_start|> (token id 1)
10
- - <fim_middle> -> <|im_end|> (token id 2)
11
 
12
 
13
 
 
6
  # Model Card for Model ID
7
 
8
  `lvwerra/the-tokenizer-v1` but replacing:
9
+ - <\fim_prefix> -> <|im_start|> (token id 1)
10
+ - <\fim_middle> -> <|im_end|> (token id 2)
11
 
12
 
13