turkce-qwen3-tokenizer / special_tokens_map.json
Huseyin's picture
Upload special_tokens_map.json with huggingface_hub
bea426d verified
{
"bos_token": "<|im_start|>",
"eos_token": "<|im_end|>",
"unk_token": "<UNK>",
"pad_token": "<PAD>",
"additional_special_tokens": [
"<|endoftext|>",
"<BOS>",
"<EOS>",
"<MASK>",
"<think>",
"</think>"
]
}