Update README.md
Browse files
README.md
CHANGED
|
@@ -16,6 +16,19 @@ https://github.com/JunnYu/RoFormer_pytorch
|
|
| 16 |
### 安装
|
| 17 |
- pip install roformer==0.4.3
|
| 18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
## pytorch & tf2.0使用
|
| 20 |
```python
|
| 21 |
import torch
|
|
|
|
| 16 |
### 安装
|
| 17 |
- pip install roformer==0.4.3
|
| 18 |
|
| 19 |
+
## 评测对比
|
| 20 |
+
|
| 21 |
+
### CLUE榜单分类任务结果，base版本。
|
| 22 |
+
|
| 23 |
+
| | iflytek | tnews | afqmc | cmnli | ocnli | wsc | csl |
|
| 24 |
+
| :-----: | :-----: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 25 |
+
| BERT | 60.06 | 56.80 | 72.41 | 79.56 | 73.93 | 78.62 | 83.93 |
|
| 26 |
+
| RoBERTa | 60.64 | 58.06 | 74.05 | 81.24 | 76.00 | **87.50** | 84.50 |
|
| 27 |
+
| RoFormer | 60.91 | 57.54 | 73.52 | 80.92 | **76.07** | 86.84 | 84.63 |
|
| 28 |
+
| GAU-α | 61.41 | 57.76 | 74.17** | **81.82** | 75.86 | 79.93 | **85.67** |
|
| 29 |
+
| RoFormerV2<sup>*</sup> | 60.87 | 56.54 | 72.75 | 80.34 | 75.36 | 80.92 | 84.67 |
|
| 30 |
+
| RoFormerV2<sup>*</sup>-pytorch(本仓库代码) | **63.15** | **58.24** | **75.42** | 80.59 | 74.17 | 83.79 | 83.73 |
|
| 31 |
+
|
| 32 |
## pytorch & tf2.0使用
|
| 33 |
```python
|
| 34 |
import torch
|