jqop
/

tokenizer_bpe_first

File size: 67 Bytes

ecd6dc8

{
  "bos_token": "</endoftext/>",
  "eos_token": "</endoftext/>"
}