kyukyuswe commited on
Commit
0514a38
·
verified ·
1 Parent(s): 84bfa4d

End of training

Browse files
README.md CHANGED
@@ -5,10 +5,24 @@ tags:
5
  - generated_from_trainer
6
  datasets:
7
  - xsum
 
 
8
  model-index:
9
  - name: t5-small-finetuned-xsum
10
- results: []
11
- pipeline_tag: summarization
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -17,6 +31,13 @@ should probably proofread and complete it, then remove this comment. -->
17
  # t5-small-finetuned-xsum
18
 
19
  This model is a fine-tuned version of [google-t5/t5-small](https://huggingface.co/google-t5/t5-small) on the xsum dataset.
 
 
 
 
 
 
 
20
 
21
  ## Model description
22
 
@@ -44,9 +65,16 @@ The following hyperparameters were used during training:
44
  - num_epochs: 1
45
  - mixed_precision_training: Native AMP
46
 
 
 
 
 
 
 
 
47
  ### Framework versions
48
 
49
  - Transformers 4.41.2
50
  - Pytorch 2.1.2
51
  - Datasets 2.19.2
52
- - Tokenizers 0.19.1
 
5
  - generated_from_trainer
6
  datasets:
7
  - xsum
8
+ metrics:
9
+ - rouge
10
  model-index:
11
  - name: t5-small-finetuned-xsum
12
+ results:
13
+ - task:
14
+ name: Sequence-to-sequence Language Modeling
15
+ type: text2text-generation
16
+ dataset:
17
+ name: xsum
18
+ type: xsum
19
+ config: default
20
+ split: validation
21
+ args: default
22
+ metrics:
23
+ - name: Rouge1
24
+ type: rouge
25
+ value: 28.2959
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
31
  # t5-small-finetuned-xsum
32
 
33
  This model is a fine-tuned version of [google-t5/t5-small](https://huggingface.co/google-t5/t5-small) on the xsum dataset.
34
+ It achieves the following results on the evaluation set:
35
+ - Loss: 2.4781
36
+ - Rouge1: 28.2959
37
+ - Rouge2: 7.7364
38
+ - Rougel: 22.2437
39
+ - Rougelsum: 22.2447
40
+ - Gen Len: 18.8252
41
 
42
  ## Model description
43
 
 
65
  - num_epochs: 1
66
  - mixed_precision_training: Native AMP
67
 
68
+ ### Training results
69
+
70
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
71
+ |:-------------:|:-----:|:-----:|:---------------:|:-------:|:------:|:-------:|:---------:|:-------:|
72
+ | 2.7071 | 1.0 | 12753 | 2.4781 | 28.2959 | 7.7364 | 22.2437 | 22.2447 | 18.8252 |
73
+
74
+
75
  ### Framework versions
76
 
77
  - Transformers 4.41.2
78
  - Pytorch 2.1.2
79
  - Datasets 2.19.2
80
+ - Tokenizers 0.19.1
generation_config.json CHANGED
@@ -1,5 +1,4 @@
1
  {
2
- "_from_model_config": true,
3
  "decoder_start_token_id": 0,
4
  "eos_token_id": 1,
5
  "pad_token_id": 0,
 
1
  {
 
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
  "pad_token_id": 0,
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:98f960fbdfffd58fd750797b5640f4306dff2b7217a562a396f6875f1750e37a
3
  size 242041896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80329fd22851f03ceee4c2aab3399a34e91ebce5eea98cbf064352d515610a62
3
  size 242041896
runs/Jun20_04-29-11_d39f9482762b/events.out.tfevents.1718857752.d39f9482762b.24.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b982e7bbc66c99fe307c8e53e1df22f4560616ea7262d4011b5893261ec0935d
3
- size 11109
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:989189c780c2c5a076b02781f4b11f2cccc6937b758bfb17fd93db7faf1d6fa6
3
+ size 11988