qn for DavidAU about your models
#2
by
ecrispy
- opened
Sorry for the very basic qn, but what tools did you use/recommend, e.g. for the sample output you have? is it using chat or instruct mode? I thought Instruct was best for story writing?
This actually depends on the model itself. Usually an instruct template can be used on most models. Whereas "chat specific" model, requires a chat template usually.
That being said, larger models often work with several templates.
The other issue: A chat template is for "back and forth" conversations, whereas instruct is used for "one shot" or "commands" so to speak.
Then there are chat-instruct templates too ;