File size: 266 Bytes
96e7c77
 
 
 
 
 
 
 
a83d8b0
1
2
3
4
5
6
7
8
9
---
license: apache-2.0
language:
- zh
- en
---
## 对llama-3-8B-base 使用wudao200G语料做中文全参预训练
github [https://github.com/cooper12121/llama3-Chinese](https://github.com/cooper12121/llama3-Chinese)
- 20G表示用20G语料训练得到的checkpoint