yi-01-ai
commited on
Commit
•
6d39e4d
1
Parent(s):
f431cf3
Auto Sync from git://github.com/01-ai/Yi.git/commit/043a50fe5a24ce5fbd31d171ae9aeb4d2600accf
Browse files
README.md
CHANGED
@@ -292,6 +292,17 @@ response = tokenizer.decode(output_ids[0][input_ids.shape[1]:], skip_special_tok
|
|
292 |
print(response)
|
293 |
```
|
294 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
295 |
#### 3.2 Use the base model
|
296 |
|
297 |
```bash
|
|
|
292 |
print(response)
|
293 |
```
|
294 |
|
295 |
+
|
296 |
+
To construct the prompt template manually, you can refer the `chat_template` field in the `tokenizer_config.json` [file](https://huggingface.co/01-ai/Yi-34B-Chat/blob/main/tokenizer_config.json#L60).
|
297 |
+
|
298 |
+
```
|
299 |
+
<|im_start|>system
|
300 |
+
{system_message}<|im_end|>
|
301 |
+
<|im_start|>user
|
302 |
+
{prompt}<|im_end|>
|
303 |
+
<|im_start|>assistant
|
304 |
+
```
|
305 |
+
|
306 |
#### 3.2 Use the base model
|
307 |
|
308 |
```bash
|