Update README.md
Browse files
README.md
CHANGED
|
@@ -10,6 +10,14 @@ tags:
|
|
| 10 |
---
|
| 11 |
4bpw exl2 quant of: https://huggingface.co/Darkknight535/Moonlight-L3-15B-v2.5-64k
|
| 12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
### MoonLight-L3-15B-V2.5-64K
|
| 14 |
---
|
| 15 |
|
|
|
|
| 10 |
---
|
| 11 |
4bpw exl2 quant of: https://huggingface.co/Darkknight535/Moonlight-L3-15B-v2.5-64k
|
| 12 |
|
| 13 |
+
The model is a bit buggy and tends to runaway, I recommend you use:
|
| 14 |
+
|
| 15 |
+
Temperature: 0.3-0.6
|
| 16 |
+
Min_P: 0.15
|
| 17 |
+
Repetition Penalty: 1
|
| 18 |
+
|
| 19 |
+
---
|
| 20 |
+
|
| 21 |
### MoonLight-L3-15B-V2.5-64K
|
| 22 |
---
|
| 23 |
|