lewtun HF staff commited on
Commit
10489bf
·
1 Parent(s): f83387e

Add evaluation results on the default config of xsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the default config of the [xsum](https://huggingface.co/datasets/xsum) dataset by

@pszemraj
, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-xsum-default-6f5db0-14615984).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=xsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=xsum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -82,6 +82,39 @@ model-index:
82
  type: gen_len
83
  value: 157.3126
84
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
85
  ---
86
 
87
 
 
82
  type: gen_len
83
  value: 157.3126
84
  verified: true
85
+ - task:
86
+ type: summarization
87
+ name: Summarization
88
+ dataset:
89
+ name: xsum
90
+ type: xsum
91
+ config: default
92
+ split: test
93
+ metrics:
94
+ - name: ROUGE-1
95
+ type: rouge
96
+ value: 18.2975
97
+ verified: true
98
+ - name: ROUGE-2
99
+ type: rouge
100
+ value: 2.6806
101
+ verified: true
102
+ - name: ROUGE-L
103
+ type: rouge
104
+ value: 11.9453
105
+ verified: true
106
+ - name: ROUGE-LSUM
107
+ type: rouge
108
+ value: 14.2121
109
+ verified: true
110
+ - name: loss
111
+ type: loss
112
+ value: 4.836681365966797
113
+ verified: true
114
+ - name: gen_len
115
+ type: gen_len
116
+ value: 96.2584
117
+ verified: true
118
  ---
119
 
120