lewtun HF staff commited on
Commit
20bf9e5
1 Parent(s): daddfeb

Add evaluation results on samsum dataset

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the [samsum](https://huggingface.co/datasets/samsum) dataset by

@lewtun
, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-6fbfec76-7855043).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=samsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=samsum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -20,6 +20,39 @@ model-index:
20
  - name: Rouge1
21
  type: rouge
22
  value: 46.7505
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  ---
24
 
25
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
20
  - name: Rouge1
21
  type: rouge
22
  value: 46.7505
23
+ - task:
24
+ type: summarization
25
+ name: Summarization
26
+ dataset:
27
+ name: samsum
28
+ type: samsum
29
+ config: samsum
30
+ split: test
31
+ metrics:
32
+ - name: ROUGE-1
33
+ type: rouge
34
+ value: 46.2529
35
+ verified: true
36
+ - name: ROUGE-2
37
+ type: rouge
38
+ value: 21.3374
39
+ verified: true
40
+ - name: ROUGE-L
41
+ type: rouge
42
+ value: 36.1939
43
+ verified: true
44
+ - name: ROUGE-LSUM
45
+ type: rouge
46
+ value: 42.2937
47
+ verified: true
48
+ - name: loss
49
+ type: loss
50
+ value: 2.0463898181915283
51
+ verified: true
52
+ - name: gen_len
53
+ type: gen_len
54
+ value: 31.3724
55
+ verified: true
56
  ---
57
 
58
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You