Update Codes/01 - Fine-tuning.ipynb
Browse files
Codes/01 - Fine-tuning.ipynb
CHANGED
@@ -185,7 +185,7 @@
|
|
185 |
"source": [
|
186 |
"We will convert it later on using the chat template that comes with the tokenizer.\n",
|
187 |
"\n",
|
188 |
-
"*Remark:* Note that the system prompt is included in the very last user message of each \"chats\" that make up the dataset. This is because, even though Nemo supports system prompts (as per the Jinja code given after executing ```tokenizer.chat_template
|
189 |
]
|
190 |
},
|
191 |
{
|
|
|
185 |
"source": [
|
186 |
"We will convert it later on using the chat template that comes with the tokenizer.\n",
|
187 |
"\n",
|
188 |
+
"*Remark:* Note that the system prompt is included in the very last user message of each \"chats\" that make up the dataset. This is because, even though Nemo supports system prompts (as per the Jinja code given after executing ```tokenizer.chat_template```), there seem to be an issue with the tokenizer in this respect. It will produce the same effect anyway (the model is supposed to be aware with this way of doing)."
|
189 |
]
|
190 |
},
|
191 |
{
|