Hugging Face's logo

zera09
/
long_t5_test

TensorBoard
Safetensors
longt5
Generated from Trainer
Model card Files Metrics Community
zera09 commited on
Commit
c426394
·
verified ·
1 Parent(s): 3435d27

End of training

Browse files
Files changed (3) hide show
  1. README.md +27 -10
  2. model.safetensors +1 -1
  3. runs/Dec03_22-06-08_user/events.out.tfevents.1733243769.user.1614914.0 +2 -2
README.md CHANGED
@@ -15,12 +15,12 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [google/long-t5-tglobal-base](https://huggingface.co/google/long-t5-tglobal-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 1.5497
19
- - Rouge Rouge1: 0.3896
20
- - Rouge Rouge2: 0.1402
21
- - Rouge Rougel: 0.227
22
- - Rouge Rougelsum: 0.2269
23
- - Gen Len: 392.0152
24
 
25
  ## Model description
26
 
@@ -45,15 +45,32 @@ The following hyperparameters were used during training:
45
  - seed: 42
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
- - num_epochs: 3
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Rouge Rouge1 | Rouge Rouge2 | Rouge Rougel | Rouge Rougelsum | Gen Len |
53
  |:-------------:|:-----:|:----:|:---------------:|:------------:|:------------:|:------------:|:---------------:|:--------:|
54
- | No log | 1.0 | 394 | 1.9062 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
55
- | 3.7289 | 2.0 | 788 | 1.5960 | 0.279 | 0.0991 | 0.1665 | 0.1662 | 320.4091 |
56
- | 2.0261 | 3.0 | 1182 | 1.5497 | 0.3896 | 0.1402 | 0.227 | 0.2269 | 392.0152 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
57
 
58
 
59
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [google/long-t5-tglobal-base](https://huggingface.co/google/long-t5-tglobal-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 1.3506
19
+ - Rouge Rouge1: 0.4697
20
+ - Rouge Rouge2: 0.1989
21
+ - Rouge Rougel: 0.274
22
+ - Rouge Rougelsum: 0.2736
23
+ - Gen Len: 388.0152
24
 
25
  ## Model description
26
 
 
45
  - seed: 42
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
+ - num_epochs: 20
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Rouge Rouge1 | Rouge Rouge2 | Rouge Rougel | Rouge Rougelsum | Gen Len |
53
  |:-------------:|:-----:|:----:|:---------------:|:------------:|:------------:|:------------:|:---------------:|:--------:|
54
+ | No log | 1.0 | 394 | 1.9389 | 0.0284 | 0.0089 | 0.0167 | 0.0165 | 30.2273 |
55
+ | 3.6937 | 2.0 | 788 | 1.4702 | 0.4261 | 0.1598 | 0.254 | 0.2539 | 399.0 |
56
+ | 1.8772 | 3.0 | 1182 | 1.4362 | 0.4397 | 0.1699 | 0.2592 | 0.2591 | 398.5152 |
57
+ | 1.7418 | 4.0 | 1576 | 1.4204 | 0.4434 | 0.1779 | 0.2627 | 0.2628 | 397.7374 |
58
+ | 1.7418 | 5.0 | 1970 | 1.4108 | 0.4474 | 0.181 | 0.2631 | 0.263 | 394.798 |
59
+ | 1.6623 | 6.0 | 2364 | 1.3932 | 0.4546 | 0.1873 | 0.2675 | 0.2673 | 391.8586 |
60
+ | 1.6449 | 7.0 | 2758 | 1.3872 | 0.4559 | 0.1882 | 0.2665 | 0.2664 | 393.4848 |
61
+ | 1.5757 | 8.0 | 3152 | 1.3814 | 0.458 | 0.1906 | 0.2692 | 0.2692 | 397.1061 |
62
+ | 1.5527 | 9.0 | 3546 | 1.3718 | 0.4607 | 0.1912 | 0.2705 | 0.2706 | 391.7222 |
63
+ | 1.5527 | 10.0 | 3940 | 1.3703 | 0.4649 | 0.194 | 0.2717 | 0.2719 | 393.8788 |
64
+ | 1.5302 | 11.0 | 4334 | 1.3621 | 0.4664 | 0.197 | 0.2726 | 0.2724 | 386.2071 |
65
+ | 1.5142 | 12.0 | 4728 | 1.3537 | 0.4694 | 0.1977 | 0.2731 | 0.2731 | 388.9798 |
66
+ | 1.4721 | 13.0 | 5122 | 1.3528 | 0.4652 | 0.1961 | 0.2716 | 0.2714 | 390.2828 |
67
+ | 1.4745 | 14.0 | 5516 | 1.3550 | 0.4708 | 0.2009 | 0.2742 | 0.2739 | 393.8131 |
68
+ | 1.4745 | 15.0 | 5910 | 1.3500 | 0.471 | 0.199 | 0.2742 | 0.2741 | 385.4192 |
69
+ | 1.4799 | 16.0 | 6304 | 1.3505 | 0.4725 | 0.2008 | 0.2764 | 0.2761 | 387.6364 |
70
+ | 1.4558 | 17.0 | 6698 | 1.3535 | 0.4743 | 0.2032 | 0.2765 | 0.2764 | 389.4192 |
71
+ | 1.4426 | 18.0 | 7092 | 1.3494 | 0.4743 | 0.2042 | 0.278 | 0.2776 | 386.4394 |
72
+ | 1.4426 | 19.0 | 7486 | 1.3513 | 0.4719 | 0.2019 | 0.2753 | 0.2752 | 388.6515 |
73
+ | 1.4411 | 20.0 | 7880 | 1.3506 | 0.4697 | 0.1989 | 0.274 | 0.2736 | 388.0152 |
74
 
75
 
76
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e229d7702648b57e238c4485f9c43b6fd6abb75103e100185372e3ff8731a853
3
  size 990386200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7195bb5019237ed53ff3d38dbe771e6175db36a856f238ec9674dc1723defac4
3
  size 990386200
runs/Dec03_22-06-08_user/events.out.tfevents.1733243769.user.1614914.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c85aff57ccb47150021d43c0cd439b16372c132253520ee7a0bea4485c55689e
3
- size 17538
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f488a3439d48f50b0b48ed5a2ec0c31add4e3a42ab9d1e9a4ea5bab0bb081afa
3
+ size 18441