Chat Templates
#1
by
mschmill
- opened
Trying to use this model with my own SFT data and using the code provided in the Unsloth repo's README. Getting this warning:
No chat template is defined for this tokenizer - using the default template for the LlamaTokenizerFast class. If the default is not appropriate for your model, please set `tokenizer.chat_template` to an appropriate template. See https://huggingface.co/docs/transformers/main/chat_templating for more information.
And getting an error when I try to tokenizer.apply_chat_template to my data.
I assume that this is because there is no chat template in the tokenizer_config.json files. Is it possible to get chat templates packages with the unsloth models?
@mschmill Ohh it's because this is a base model!! The instruct version has a chat template.
But on chat templates - we actually have support for chat templates in Unsloth! https://github.com/unslothai/unsloth/wiki#chat-templates and our chat template notebook: https://colab.research.google.com/drive/1Aau3lgPzeZKQ-98h69CCu1UJcvIBLmy2?usp=sharing