yi-01-ai commited on
Commit
6d39e4d
1 Parent(s): f431cf3

Auto Sync from git://github.com/01-ai/Yi.git/commit/043a50fe5a24ce5fbd31d171ae9aeb4d2600accf

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -292,6 +292,17 @@ response = tokenizer.decode(output_ids[0][input_ids.shape[1]:], skip_special_tok
292
  print(response)
293
  ```
294
 
 
 
 
 
 
 
 
 
 
 
 
295
  #### 3.2 Use the base model
296
 
297
  ```bash
 
292
  print(response)
293
  ```
294
 
295
+
296
+ To construct the prompt template manually, you can refer the `chat_template` field in the `tokenizer_config.json` [file](https://huggingface.co/01-ai/Yi-34B-Chat/blob/main/tokenizer_config.json#L60).
297
+
298
+ ```
299
+ <|im_start|>system
300
+ {system_message}<|im_end|>
301
+ <|im_start|>user
302
+ {prompt}<|im_end|>
303
+ <|im_start|>assistant
304
+ ```
305
+
306
  #### 3.2 Use the base model
307
 
308
  ```bash