junnyu commited on
Commit
c1cfbeb
1 Parent(s): 5c82cf1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -16,6 +16,19 @@ https://github.com/JunnYu/RoFormer_pytorch
16
  ### 安装
17
  - pip install roformer==0.4.3
18
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  ## pytorch & tf2.0使用
20
  ```python
21
  import torch
 
16
  ### 安装
17
  - pip install roformer==0.4.3
18
 
19
+ ## 评测对比
20
+
21
+ ### CLUE榜单分类任务结果,base版本。
22
+
23
+ | | iflytek | tnews | afqmc | cmnli | ocnli | wsc | csl |
24
+ | :-----: | :-----: | :---: | :---: | :---: | :---: | :---: | :---: |
25
+ | BERT | 60.06 | 56.80 | 72.41 | 79.56 | 73.93 | 78.62 | 83.93 |
26
+ | RoBERTa | 60.64 | 58.06 | 74.05 | 81.24 | 76.00 | **87.50** | 84.50 |
27
+ | RoFormer | 60.91 | 57.54 | 73.52 | 80.92 | **76.07** | 86.84 | 84.63 |
28
+ | GAU-α | 61.41 | 57.76 | 74.17** | **81.82** | 75.86 | 79.93 | **85.67** |
29
+ | RoFormerV2<sup>*</sup> | 60.87 | 56.54 | 72.75 | 80.34 | 75.36 | 80.92 | 84.67 |
30
+ | RoFormerV2<sup>*</sup>-pytorch(本仓库代码) | **63.15** | **58.24** | **75.42** | 80.59 | 74.17 | 83.79 | 83.73 |
31
+
32
  ## pytorch & tf2.0使用
33
  ```python
34
  import torch