Commit
·
070a697
1
Parent(s):
862c835
Update README.md
Browse files
README.md
CHANGED
|
@@ -5,6 +5,16 @@ language:
|
|
| 5 |
library_name: transformers
|
| 6 |
---
|
| 7 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
|
| 9 |
|
| 10 |
# infer code
|
|
|
|
| 5 |
library_name: transformers
|
| 6 |
---
|
| 7 |
|
| 8 |
+
# intro
|
| 9 |
+
1. 15G的中文语料
|
| 10 |
+
2. 31亿个tokens
|
| 11 |
+
3. 一张3090显卡
|
| 12 |
+
4. 训练60多个小时
|
| 13 |
+
|
| 14 |
+
最终训练出一个中文版本的gpt2，如果有想了解如何训练中文gpt2的，可以查看这个教程
|
| 15 |
+
|
| 16 |
+
# Github link
|
| 17 |
+
[https://github.com/yuanzhoulvpi2017/zero_nlp/tree/main/chinese_gpt2](https://github.com/yuanzhoulvpi2017/zero_nlp/tree/main/chinese_gpt2)
|
| 18 |
|
| 19 |
|
| 20 |
# infer code
|