lewtun HF staff commited on
Commit
a0c1156
1 Parent(s): 45a2786

Add evaluation results on the default config of xsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the default config of the [xsum](https://huggingface.co/datasets/xsum) dataset by

@pszemraj
, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-xsum-d2b9e56c-12525674).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=xsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=xsum).

Files changed (1) hide show
  1. README.md +34 -1
README.md CHANGED
@@ -10,7 +10,7 @@ datasets:
10
  - kmfoda/booksum
11
  metrics:
12
  - rouge
13
- inference: False
14
  model-index:
15
  - name: pszemraj/long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP
16
  results:
@@ -80,6 +80,39 @@ model-index:
80
  type: gen_len
81
  value: 47.6532
82
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
83
  ---
84
 
85
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP
 
10
  - kmfoda/booksum
11
  metrics:
12
  - rouge
13
+ inference: false
14
  model-index:
15
  - name: pszemraj/long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP
16
  results:
 
80
  type: gen_len
81
  value: 47.6532
82
  verified: true
83
+ - task:
84
+ type: summarization
85
+ name: Summarization
86
+ dataset:
87
+ name: xsum
88
+ type: xsum
89
+ config: default
90
+ split: test
91
+ metrics:
92
+ - name: ROUGE-1
93
+ type: rouge
94
+ value: 19.3209
95
+ verified: true
96
+ - name: ROUGE-2
97
+ type: rouge
98
+ value: 2.7978
99
+ verified: true
100
+ - name: ROUGE-L
101
+ type: rouge
102
+ value: 12.5816
103
+ verified: true
104
+ - name: ROUGE-LSUM
105
+ type: rouge
106
+ value: 15.0239
107
+ verified: true
108
+ - name: loss
109
+ type: loss
110
+ value: 4.483709335327148
111
+ verified: true
112
+ - name: gen_len
113
+ type: gen_len
114
+ value: 82.729
115
+ verified: true
116
  ---
117
 
118
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP