Update chat_template to include system prompt
#115
by
skapadia-zalando
- opened
Related to this issue: https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1/discussions/114
This current chat template doesn't support the system role, so this adds support for it
Tested over here: https://colab.research.google.com/drive/1egzjeVDcuaQ6QaEelcW5UxnnRR48A1aP?usp=sharing
Requesting review from @teven since you've worked on chat templates before. Appreciate Mistral's work so far and I would be thankful if you had a look!
I found this on an older version of the docs site: https://web.archive.org/web/20231030013339/https://docs.mistral.ai/usage/guardrailing/#appendix, seems like the <<SYS>> tokens are not supported
skapadia-zalando
changed pull request status to
closed