Add evaluation results on the default config and test split of billsum

#3
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -80,6 +80,39 @@ model-index:
80
  type: gen_len
81
  value: 279.8735
82
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
83
  ---
84
 
85
 
 
80
  type: gen_len
81
  value: 279.8735
82
  verified: true
83
+ - task:
84
+ type: summarization
85
+ name: Summarization
86
+ dataset:
87
+ name: billsum
88
+ type: billsum
89
+ config: default
90
+ split: test
91
+ metrics:
92
+ - name: ROUGE-1
93
+ type: rouge
94
+ value: 38.066
95
+ verified: true
96
+ - name: ROUGE-2
97
+ type: rouge
98
+ value: 12.5289
99
+ verified: true
100
+ - name: ROUGE-L
101
+ type: rouge
102
+ value: 22.3393
103
+ verified: true
104
+ - name: ROUGE-LSUM
105
+ type: rouge
106
+ value: 31.9802
107
+ verified: true
108
+ - name: loss
109
+ type: loss
110
+ value: 3.0360958576202393
111
+ verified: true
112
+ - name: gen_len
113
+ type: gen_len
114
+ value: 161.4671
115
+ verified: true
116
  ---
117
 
118