krogoldAI commited on
Commit
6f6bdcf
1 Parent(s): e1aa69a

Update Codes/01 - Fine-tuning.ipynb

Browse files
Files changed (1) hide show
  1. Codes/01 - Fine-tuning.ipynb +1 -1
Codes/01 - Fine-tuning.ipynb CHANGED
@@ -185,7 +185,7 @@
185
  "source": [
186
  "We will convert it later on using the chat template that comes with the tokenizer.\n",
187
  "\n",
188
- "*Remark:* Note that the system prompt is included in the very last user message of each \"chats\" that make up the dataset. This is because, even though Nemo supports system prompts (as per the Jinja code given after executing ```tokenizer.chat_template```, there seem to be an issue with the tokenizer in this respect. It will produce the same effect anyway (the model is supposed to be aware with this way of doing)."
189
  ]
190
  },
191
  {
 
185
  "source": [
186
  "We will convert it later on using the chat template that comes with the tokenizer.\n",
187
  "\n",
188
+ "*Remark:* Note that the system prompt is included in the very last user message of each \"chats\" that make up the dataset. This is because, even though Nemo supports system prompts (as per the Jinja code given after executing ```tokenizer.chat_template```), there seem to be an issue with the tokenizer in this respect. It will produce the same effect anyway (the model is supposed to be aware with this way of doing)."
189
  ]
190
  },
191
  {