Locutusque commited on
Commit
d89c45a
·
verified ·
1 Parent(s): bdca3ed

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -19,4 +19,8 @@ However, due to the model's requirement for the setting trust_remote_code=True,
19
  <|im_start|>system message <|im_end|> <|im_start|>user message <|im_end|> <|im_start|>assistant message <|im_end|>
20
  ```
21
 
22
- I recommend passing eos_token="<|im_end|>" when initializing the tokenizer.
 
 
 
 
 
19
  <|im_start|>system message <|im_end|> <|im_start|>user message <|im_end|> <|im_start|>assistant message <|im_end|>
20
  ```
21
 
22
+ I recommend passing eos_token="<|im_end|>" when initializing the tokenizer.
23
+
24
+ # Recommended inference parameters
25
+
26
+ temperature=0.2, top_p=0.14, top_k=12, repetition_penalty=1.1