Wrong/missing BOS token
#2
by
mapestree
- opened
It looks like this (and the 1.7B model) do not have their BOS token set in the config.json file and as a result they do not work as draft models for the larger models like the 205B model.
It looks like this (and the 1.7B model) do not have their BOS token set in the config.json file and as a result they do not work as draft models for the larger models like the 205B model.
There is no BOS token for the smaller models
@bartowski has it set in https://huggingface.co/bartowski/Qwen_Qwen3-0.6B-GGUF though. Will this cause any potential issues?