Xenova

/

gpt-4o

like 63

chat_template is missing in tokenizer_config.json.

Calling AutoTokenizer.apply_chat_template raises the error
ValueError: Cannot use chat template functions because tokenizer.chat_template is not set and no template argument was passed! For information about writing templates and setting the tokenizer.chat_template attribute, please see the documentation at https://huggingface.co/docs/transformers/main/en/chat_templating

Unable to count the number of tokens for the chat.