Update README.md
Browse files
README.md
CHANGED
@@ -19,4 +19,8 @@ However, due to the model's requirement for the setting trust_remote_code=True,
|
|
19 |
<|im_start|>system message <|im_end|> <|im_start|>user message <|im_end|> <|im_start|>assistant message <|im_end|>
|
20 |
```
|
21 |
|
22 |
-
I recommend passing eos_token="<|im_end|>" when initializing the tokenizer.
|
|
|
|
|
|
|
|
|
|
19 |
<|im_start|>system message <|im_end|> <|im_start|>user message <|im_end|> <|im_start|>assistant message <|im_end|>
|
20 |
```
|
21 |
|
22 |
+
I recommend passing eos_token="<|im_end|>" when initializing the tokenizer.
|
23 |
+
|
24 |
+
# Recommended inference parameters
|
25 |
+
|
26 |
+
temperature=0.2, top_p=0.14, top_k=12, repetition_penalty=1.1
|