Commit
·
dfd773c
1
Parent(s):
38331ad
Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum (#6)
Browse files- Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum (8fd75e1d820b4628004d80c941b7f7acd5f64a1a)
Co-authored-by: Evaluation Bot <[email protected]>
README.md
CHANGED
@@ -148,6 +148,39 @@ model-index:
|
|
148 |
type: gen_len
|
149 |
value: 243.3453
|
150 |
verified: true
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
151 |
---
|
152 |
|
153 |
|
|
|
148 |
type: gen_len
|
149 |
value: 243.3453
|
150 |
verified: true
|
151 |
+
- task:
|
152 |
+
type: summarization
|
153 |
+
name: Summarization
|
154 |
+
dataset:
|
155 |
+
name: kmfoda/booksum
|
156 |
+
type: kmfoda/booksum
|
157 |
+
config: kmfoda--booksum
|
158 |
+
split: test
|
159 |
+
metrics:
|
160 |
+
- name: ROUGE-1
|
161 |
+
type: rouge
|
162 |
+
value: 35.2043
|
163 |
+
verified: true
|
164 |
+
- name: ROUGE-2
|
165 |
+
type: rouge
|
166 |
+
value: 5.746
|
167 |
+
verified: true
|
168 |
+
- name: ROUGE-L
|
169 |
+
type: rouge
|
170 |
+
value: 15.6794
|
171 |
+
verified: true
|
172 |
+
- name: ROUGE-LSUM
|
173 |
+
type: rouge
|
174 |
+
value: 32.1129
|
175 |
+
verified: true
|
176 |
+
- name: loss
|
177 |
+
type: loss
|
178 |
+
value: 2.945225238800049
|
179 |
+
verified: true
|
180 |
+
- name: gen_len
|
181 |
+
type: gen_len
|
182 |
+
value: 307.5493
|
183 |
+
verified: true
|
184 |
---
|
185 |
|
186 |
|