Update README.md
Browse files
README.md
CHANGED
@@ -32,4 +32,11 @@ The topic is about racecars
|
|
32 |
<|startoftext|>[INST]
|
33 |
Who was the was the second president of the United States?
|
34 |
[/INST]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
35 |
```
|
|
|
32 |
<|startoftext|>[INST]
|
33 |
Who was the was the second president of the United States?
|
34 |
[/INST]
|
35 |
+
```
|
36 |
+
|
37 |
+
# Training script:
|
38 |
+
Fully opensourced at: https://github.com/hengjiUSTC/learn-llm/blob/main/trl_finetune.py. Run on aws g4dn.12xlarge instance for 10 hours.
|
39 |
+
|
40 |
+
```
|
41 |
+
python3 trl_finetune.py --config configs/yi_6b-large.yml
|
42 |
```
|