learn3r commited on
Commit
297a3c4
·
1 Parent(s): ff95437

End of training

Browse files
Files changed (5) hide show
  1. README.md +20 -8
  2. all_results.json +18 -0
  3. eval_results.json +13 -0
  4. train_results.json +8 -0
  5. trainer_state.json +1128 -0
README.md CHANGED
@@ -3,11 +3,23 @@ license: apache-2.0
3
  base_model: google/long-t5-tglobal-xl
4
  tags:
5
  - generated_from_trainer
 
 
6
  metrics:
7
  - rouge
8
  model-index:
9
  - name: longt5_xl_sfd_bp_20
10
- results: []
 
 
 
 
 
 
 
 
 
 
11
  ---
12
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -15,14 +27,14 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # longt5_xl_sfd_bp_20
17
 
18
- This model is a fine-tuned version of [google/long-t5-tglobal-xl](https://huggingface.co/google/long-t5-tglobal-xl) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 2.8927
21
- - Rouge1: 32.7788
22
- - Rouge2: 13.9352
23
- - Rougel: 22.5175
24
- - Rougelsum: 31.548
25
- - Gen Len: 488.5134
26
 
27
  ## Model description
28
 
 
3
  base_model: google/long-t5-tglobal-xl
4
  tags:
5
  - generated_from_trainer
6
+ datasets:
7
+ - learn3r/summ_screen_fd_bp
8
  metrics:
9
  - rouge
10
  model-index:
11
  - name: longt5_xl_sfd_bp_20
12
+ results:
13
+ - task:
14
+ name: Summarization
15
+ type: summarization
16
+ dataset:
17
+ name: learn3r/summ_screen_fd_bp
18
+ type: learn3r/summ_screen_fd_bp
19
+ metrics:
20
+ - name: Rouge1
21
+ type: rouge
22
+ value: 22.11
23
  ---
24
 
25
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
27
 
28
  # longt5_xl_sfd_bp_20
29
 
30
+ This model is a fine-tuned version of [google/long-t5-tglobal-xl](https://huggingface.co/google/long-t5-tglobal-xl) on the learn3r/summ_screen_fd_bp dataset.
31
  It achieves the following results on the evaluation set:
32
+ - Loss: 1.5032
33
+ - Rouge1: 22.11
34
+ - Rouge2: 7.544
35
+ - Rougel: 19.7035
36
+ - Rougelsum: 20.2813
37
+ - Gen Len: 497.8783
38
 
39
  ## Model description
40
 
all_results.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 19.48,
3
+ "eval_gen_len": 497.8783382789318,
4
+ "eval_loss": 1.503156304359436,
5
+ "eval_rouge1": 22.11,
6
+ "eval_rouge2": 7.544,
7
+ "eval_rougeL": 19.7035,
8
+ "eval_rougeLsum": 20.2813,
9
+ "eval_runtime": 1794.2024,
10
+ "eval_samples": 337,
11
+ "eval_samples_per_second": 0.188,
12
+ "eval_steps_per_second": 0.024,
13
+ "train_loss": 0.722327525381531,
14
+ "train_runtime": 104579.6075,
15
+ "train_samples": 3673,
16
+ "train_samples_per_second": 0.702,
17
+ "train_steps_per_second": 0.003
18
+ }
eval_results.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 19.48,
3
+ "eval_gen_len": 497.8783382789318,
4
+ "eval_loss": 1.503156304359436,
5
+ "eval_rouge1": 22.11,
6
+ "eval_rouge2": 7.544,
7
+ "eval_rougeL": 19.7035,
8
+ "eval_rougeLsum": 20.2813,
9
+ "eval_runtime": 1794.2024,
10
+ "eval_samples": 337,
11
+ "eval_samples_per_second": 0.188,
12
+ "eval_steps_per_second": 0.024
13
+ }
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 19.48,
3
+ "train_loss": 0.722327525381531,
4
+ "train_runtime": 104579.6075,
5
+ "train_samples": 3673,
6
+ "train_samples_per_second": 0.702,
7
+ "train_steps_per_second": 0.003
8
+ }
trainer_state.json ADDED
@@ -0,0 +1,1128 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 1.503156304359436,
3
+ "best_model_checkpoint": "/exports/eddie/scratch/s1970716/models/summarization/longt5_xl_sfd_bp_20/checkpoint-57",
4
+ "epoch": 19.47826086956522,
5
+ "eval_steps": 500,
6
+ "global_step": 280,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.14,
13
+ "learning_rate": 0.001,
14
+ "loss": 2.9672,
15
+ "step": 2
16
+ },
17
+ {
18
+ "epoch": 0.28,
19
+ "learning_rate": 0.001,
20
+ "loss": 3.0162,
21
+ "step": 4
22
+ },
23
+ {
24
+ "epoch": 0.42,
25
+ "learning_rate": 0.001,
26
+ "loss": 3.1689,
27
+ "step": 6
28
+ },
29
+ {
30
+ "epoch": 0.56,
31
+ "learning_rate": 0.001,
32
+ "loss": 2.902,
33
+ "step": 8
34
+ },
35
+ {
36
+ "epoch": 0.7,
37
+ "learning_rate": 0.001,
38
+ "loss": 2.4891,
39
+ "step": 10
40
+ },
41
+ {
42
+ "epoch": 0.83,
43
+ "learning_rate": 0.001,
44
+ "loss": 2.8498,
45
+ "step": 12
46
+ },
47
+ {
48
+ "epoch": 0.97,
49
+ "learning_rate": 0.001,
50
+ "loss": 2.3973,
51
+ "step": 14
52
+ },
53
+ {
54
+ "epoch": 0.97,
55
+ "eval_gen_len": 511.0,
56
+ "eval_loss": 1.9073989391326904,
57
+ "eval_rouge1": 10.6164,
58
+ "eval_rouge2": 2.4585,
59
+ "eval_rougeL": 10.4856,
60
+ "eval_rougeLsum": 9.8193,
61
+ "eval_runtime": 1794.269,
62
+ "eval_samples_per_second": 0.188,
63
+ "eval_steps_per_second": 0.024,
64
+ "step": 14
65
+ },
66
+ {
67
+ "epoch": 1.11,
68
+ "learning_rate": 0.001,
69
+ "loss": 2.1921,
70
+ "step": 16
71
+ },
72
+ {
73
+ "epoch": 1.25,
74
+ "learning_rate": 0.001,
75
+ "loss": 2.0091,
76
+ "step": 18
77
+ },
78
+ {
79
+ "epoch": 1.39,
80
+ "learning_rate": 0.001,
81
+ "loss": 1.8884,
82
+ "step": 20
83
+ },
84
+ {
85
+ "epoch": 1.53,
86
+ "learning_rate": 0.001,
87
+ "loss": 1.7955,
88
+ "step": 22
89
+ },
90
+ {
91
+ "epoch": 1.67,
92
+ "learning_rate": 0.001,
93
+ "loss": 1.7023,
94
+ "step": 24
95
+ },
96
+ {
97
+ "epoch": 1.81,
98
+ "learning_rate": 0.001,
99
+ "loss": 1.8178,
100
+ "step": 26
101
+ },
102
+ {
103
+ "epoch": 1.95,
104
+ "learning_rate": 0.001,
105
+ "loss": 1.9188,
106
+ "step": 28
107
+ },
108
+ {
109
+ "epoch": 1.95,
110
+ "eval_gen_len": 511.0,
111
+ "eval_loss": 1.7082059383392334,
112
+ "eval_rouge1": 17.4258,
113
+ "eval_rouge2": 4.2128,
114
+ "eval_rougeL": 16.5213,
115
+ "eval_rougeLsum": 15.8377,
116
+ "eval_runtime": 1795.1498,
117
+ "eval_samples_per_second": 0.188,
118
+ "eval_steps_per_second": 0.024,
119
+ "step": 28
120
+ },
121
+ {
122
+ "epoch": 2.09,
123
+ "learning_rate": 0.001,
124
+ "loss": 1.6461,
125
+ "step": 30
126
+ },
127
+ {
128
+ "epoch": 2.23,
129
+ "learning_rate": 0.001,
130
+ "loss": 1.552,
131
+ "step": 32
132
+ },
133
+ {
134
+ "epoch": 2.37,
135
+ "learning_rate": 0.001,
136
+ "loss": 1.4914,
137
+ "step": 34
138
+ },
139
+ {
140
+ "epoch": 2.5,
141
+ "learning_rate": 0.001,
142
+ "loss": 1.457,
143
+ "step": 36
144
+ },
145
+ {
146
+ "epoch": 2.64,
147
+ "learning_rate": 0.001,
148
+ "loss": 1.4499,
149
+ "step": 38
150
+ },
151
+ {
152
+ "epoch": 2.78,
153
+ "learning_rate": 0.001,
154
+ "loss": 1.4868,
155
+ "step": 40
156
+ },
157
+ {
158
+ "epoch": 2.92,
159
+ "learning_rate": 0.001,
160
+ "loss": 1.4297,
161
+ "step": 42
162
+ },
163
+ {
164
+ "epoch": 2.99,
165
+ "eval_gen_len": 506.77448071216617,
166
+ "eval_loss": 1.5072847604751587,
167
+ "eval_rouge1": 18.6504,
168
+ "eval_rouge2": 5.4242,
169
+ "eval_rougeL": 17.2648,
170
+ "eval_rougeLsum": 17.0203,
171
+ "eval_runtime": 1796.521,
172
+ "eval_samples_per_second": 0.188,
173
+ "eval_steps_per_second": 0.024,
174
+ "step": 43
175
+ },
176
+ {
177
+ "epoch": 3.06,
178
+ "learning_rate": 0.001,
179
+ "loss": 1.3757,
180
+ "step": 44
181
+ },
182
+ {
183
+ "epoch": 3.2,
184
+ "learning_rate": 0.001,
185
+ "loss": 1.2701,
186
+ "step": 46
187
+ },
188
+ {
189
+ "epoch": 3.34,
190
+ "learning_rate": 0.001,
191
+ "loss": 1.2826,
192
+ "step": 48
193
+ },
194
+ {
195
+ "epoch": 3.48,
196
+ "learning_rate": 0.001,
197
+ "loss": 1.2945,
198
+ "step": 50
199
+ },
200
+ {
201
+ "epoch": 3.62,
202
+ "learning_rate": 0.001,
203
+ "loss": 1.2963,
204
+ "step": 52
205
+ },
206
+ {
207
+ "epoch": 3.76,
208
+ "learning_rate": 0.001,
209
+ "loss": 1.2933,
210
+ "step": 54
211
+ },
212
+ {
213
+ "epoch": 3.9,
214
+ "learning_rate": 0.001,
215
+ "loss": 1.2759,
216
+ "step": 56
217
+ },
218
+ {
219
+ "epoch": 3.97,
220
+ "eval_gen_len": 497.8783382789318,
221
+ "eval_loss": 1.503156304359436,
222
+ "eval_rouge1": 22.11,
223
+ "eval_rouge2": 7.544,
224
+ "eval_rougeL": 19.7035,
225
+ "eval_rougeLsum": 20.2813,
226
+ "eval_runtime": 1797.0423,
227
+ "eval_samples_per_second": 0.188,
228
+ "eval_steps_per_second": 0.024,
229
+ "step": 57
230
+ },
231
+ {
232
+ "epoch": 4.03,
233
+ "learning_rate": 0.001,
234
+ "loss": 1.2446,
235
+ "step": 58
236
+ },
237
+ {
238
+ "epoch": 4.17,
239
+ "learning_rate": 0.001,
240
+ "loss": 1.0992,
241
+ "step": 60
242
+ },
243
+ {
244
+ "epoch": 4.31,
245
+ "learning_rate": 0.001,
246
+ "loss": 1.0771,
247
+ "step": 62
248
+ },
249
+ {
250
+ "epoch": 4.45,
251
+ "learning_rate": 0.001,
252
+ "loss": 1.1254,
253
+ "step": 64
254
+ },
255
+ {
256
+ "epoch": 4.59,
257
+ "learning_rate": 0.001,
258
+ "loss": 1.1644,
259
+ "step": 66
260
+ },
261
+ {
262
+ "epoch": 4.73,
263
+ "learning_rate": 0.001,
264
+ "loss": 1.1485,
265
+ "step": 68
266
+ },
267
+ {
268
+ "epoch": 4.87,
269
+ "learning_rate": 0.001,
270
+ "loss": 1.1421,
271
+ "step": 70
272
+ },
273
+ {
274
+ "epoch": 4.94,
275
+ "eval_gen_len": 503.60237388724033,
276
+ "eval_loss": 1.5462485551834106,
277
+ "eval_rouge1": 20.6049,
278
+ "eval_rouge2": 6.7146,
279
+ "eval_rougeL": 18.5084,
280
+ "eval_rougeLsum": 19.0876,
281
+ "eval_runtime": 1793.6239,
282
+ "eval_samples_per_second": 0.188,
283
+ "eval_steps_per_second": 0.024,
284
+ "step": 71
285
+ },
286
+ {
287
+ "epoch": 5.01,
288
+ "learning_rate": 0.001,
289
+ "loss": 1.1233,
290
+ "step": 72
291
+ },
292
+ {
293
+ "epoch": 5.15,
294
+ "learning_rate": 0.001,
295
+ "loss": 0.8919,
296
+ "step": 74
297
+ },
298
+ {
299
+ "epoch": 5.29,
300
+ "learning_rate": 0.001,
301
+ "loss": 0.9349,
302
+ "step": 76
303
+ },
304
+ {
305
+ "epoch": 5.43,
306
+ "learning_rate": 0.001,
307
+ "loss": 0.9363,
308
+ "step": 78
309
+ },
310
+ {
311
+ "epoch": 5.57,
312
+ "learning_rate": 0.001,
313
+ "loss": 0.9203,
314
+ "step": 80
315
+ },
316
+ {
317
+ "epoch": 5.7,
318
+ "learning_rate": 0.001,
319
+ "loss": 0.9429,
320
+ "step": 82
321
+ },
322
+ {
323
+ "epoch": 5.84,
324
+ "learning_rate": 0.001,
325
+ "loss": 0.9495,
326
+ "step": 84
327
+ },
328
+ {
329
+ "epoch": 5.98,
330
+ "learning_rate": 0.001,
331
+ "loss": 0.9605,
332
+ "step": 86
333
+ },
334
+ {
335
+ "epoch": 5.98,
336
+ "eval_gen_len": 510.27299703264094,
337
+ "eval_loss": 1.6233196258544922,
338
+ "eval_rouge1": 22.6777,
339
+ "eval_rouge2": 7.9362,
340
+ "eval_rougeL": 18.7936,
341
+ "eval_rougeLsum": 21.41,
342
+ "eval_runtime": 1793.8682,
343
+ "eval_samples_per_second": 0.188,
344
+ "eval_steps_per_second": 0.024,
345
+ "step": 86
346
+ },
347
+ {
348
+ "epoch": 6.12,
349
+ "learning_rate": 0.001,
350
+ "loss": 0.7747,
351
+ "step": 88
352
+ },
353
+ {
354
+ "epoch": 6.26,
355
+ "learning_rate": 0.001,
356
+ "loss": 0.7664,
357
+ "step": 90
358
+ },
359
+ {
360
+ "epoch": 6.4,
361
+ "learning_rate": 0.001,
362
+ "loss": 0.7998,
363
+ "step": 92
364
+ },
365
+ {
366
+ "epoch": 6.54,
367
+ "learning_rate": 0.001,
368
+ "loss": 0.7715,
369
+ "step": 94
370
+ },
371
+ {
372
+ "epoch": 6.68,
373
+ "learning_rate": 0.001,
374
+ "loss": 0.8038,
375
+ "step": 96
376
+ },
377
+ {
378
+ "epoch": 6.82,
379
+ "learning_rate": 0.001,
380
+ "loss": 0.8059,
381
+ "step": 98
382
+ },
383
+ {
384
+ "epoch": 6.96,
385
+ "learning_rate": 0.001,
386
+ "loss": 0.8082,
387
+ "step": 100
388
+ },
389
+ {
390
+ "epoch": 6.96,
391
+ "eval_gen_len": 511.0,
392
+ "eval_loss": 1.7575491666793823,
393
+ "eval_rouge1": 26.5338,
394
+ "eval_rouge2": 9.9474,
395
+ "eval_rougeL": 20.3789,
396
+ "eval_rougeLsum": 25.0767,
397
+ "eval_runtime": 1794.6298,
398
+ "eval_samples_per_second": 0.188,
399
+ "eval_steps_per_second": 0.024,
400
+ "step": 100
401
+ },
402
+ {
403
+ "epoch": 7.1,
404
+ "learning_rate": 0.001,
405
+ "loss": 0.6708,
406
+ "step": 102
407
+ },
408
+ {
409
+ "epoch": 7.23,
410
+ "learning_rate": 0.001,
411
+ "loss": 0.6186,
412
+ "step": 104
413
+ },
414
+ {
415
+ "epoch": 7.37,
416
+ "learning_rate": 0.001,
417
+ "loss": 0.6101,
418
+ "step": 106
419
+ },
420
+ {
421
+ "epoch": 7.51,
422
+ "learning_rate": 0.001,
423
+ "loss": 0.6328,
424
+ "step": 108
425
+ },
426
+ {
427
+ "epoch": 7.65,
428
+ "learning_rate": 0.001,
429
+ "loss": 0.6529,
430
+ "step": 110
431
+ },
432
+ {
433
+ "epoch": 7.79,
434
+ "learning_rate": 0.001,
435
+ "loss": 0.6312,
436
+ "step": 112
437
+ },
438
+ {
439
+ "epoch": 7.93,
440
+ "learning_rate": 0.001,
441
+ "loss": 0.664,
442
+ "step": 114
443
+ },
444
+ {
445
+ "epoch": 8.0,
446
+ "eval_gen_len": 329.7151335311573,
447
+ "eval_loss": 1.7701919078826904,
448
+ "eval_rouge1": 35.1918,
449
+ "eval_rouge2": 13.7223,
450
+ "eval_rougeL": 26.1763,
451
+ "eval_rougeLsum": 33.3997,
452
+ "eval_runtime": 1795.1755,
453
+ "eval_samples_per_second": 0.188,
454
+ "eval_steps_per_second": 0.024,
455
+ "step": 115
456
+ },
457
+ {
458
+ "epoch": 8.07,
459
+ "learning_rate": 0.001,
460
+ "loss": 0.6177,
461
+ "step": 116
462
+ },
463
+ {
464
+ "epoch": 8.21,
465
+ "learning_rate": 0.001,
466
+ "loss": 0.5241,
467
+ "step": 118
468
+ },
469
+ {
470
+ "epoch": 8.35,
471
+ "learning_rate": 0.001,
472
+ "loss": 0.5173,
473
+ "step": 120
474
+ },
475
+ {
476
+ "epoch": 8.49,
477
+ "learning_rate": 0.001,
478
+ "loss": 0.5241,
479
+ "step": 122
480
+ },
481
+ {
482
+ "epoch": 8.63,
483
+ "learning_rate": 0.001,
484
+ "loss": 0.5546,
485
+ "step": 124
486
+ },
487
+ {
488
+ "epoch": 8.77,
489
+ "learning_rate": 0.001,
490
+ "loss": 0.5401,
491
+ "step": 126
492
+ },
493
+ {
494
+ "epoch": 8.9,
495
+ "learning_rate": 0.001,
496
+ "loss": 0.5471,
497
+ "step": 128
498
+ },
499
+ {
500
+ "epoch": 8.97,
501
+ "eval_gen_len": 506.82789317507417,
502
+ "eval_loss": 1.938284993171692,
503
+ "eval_rouge1": 27.0414,
504
+ "eval_rouge2": 10.4166,
505
+ "eval_rougeL": 20.1803,
506
+ "eval_rougeLsum": 25.6283,
507
+ "eval_runtime": 1797.9806,
508
+ "eval_samples_per_second": 0.187,
509
+ "eval_steps_per_second": 0.024,
510
+ "step": 129
511
+ },
512
+ {
513
+ "epoch": 9.04,
514
+ "learning_rate": 0.001,
515
+ "loss": 0.526,
516
+ "step": 130
517
+ },
518
+ {
519
+ "epoch": 9.18,
520
+ "learning_rate": 0.001,
521
+ "loss": 0.409,
522
+ "step": 132
523
+ },
524
+ {
525
+ "epoch": 9.32,
526
+ "learning_rate": 0.001,
527
+ "loss": 0.4163,
528
+ "step": 134
529
+ },
530
+ {
531
+ "epoch": 9.46,
532
+ "learning_rate": 0.001,
533
+ "loss": 0.4304,
534
+ "step": 136
535
+ },
536
+ {
537
+ "epoch": 9.6,
538
+ "learning_rate": 0.001,
539
+ "loss": 0.4512,
540
+ "step": 138
541
+ },
542
+ {
543
+ "epoch": 9.74,
544
+ "learning_rate": 0.001,
545
+ "loss": 0.4396,
546
+ "step": 140
547
+ },
548
+ {
549
+ "epoch": 9.88,
550
+ "learning_rate": 0.001,
551
+ "loss": 0.4349,
552
+ "step": 142
553
+ },
554
+ {
555
+ "epoch": 9.95,
556
+ "eval_gen_len": 454.7032640949555,
557
+ "eval_loss": 1.9607620239257812,
558
+ "eval_rouge1": 29.5613,
559
+ "eval_rouge2": 11.7633,
560
+ "eval_rougeL": 22.7176,
561
+ "eval_rougeLsum": 27.9563,
562
+ "eval_runtime": 1794.1152,
563
+ "eval_samples_per_second": 0.188,
564
+ "eval_steps_per_second": 0.024,
565
+ "step": 143
566
+ },
567
+ {
568
+ "epoch": 10.02,
569
+ "learning_rate": 0.001,
570
+ "loss": 0.4077,
571
+ "step": 144
572
+ },
573
+ {
574
+ "epoch": 10.16,
575
+ "learning_rate": 0.001,
576
+ "loss": 0.3439,
577
+ "step": 146
578
+ },
579
+ {
580
+ "epoch": 10.3,
581
+ "learning_rate": 0.001,
582
+ "loss": 0.3503,
583
+ "step": 148
584
+ },
585
+ {
586
+ "epoch": 10.43,
587
+ "learning_rate": 0.001,
588
+ "loss": 0.3572,
589
+ "step": 150
590
+ },
591
+ {
592
+ "epoch": 10.57,
593
+ "learning_rate": 0.001,
594
+ "loss": 0.3643,
595
+ "step": 152
596
+ },
597
+ {
598
+ "epoch": 10.71,
599
+ "learning_rate": 0.001,
600
+ "loss": 0.3516,
601
+ "step": 154
602
+ },
603
+ {
604
+ "epoch": 10.85,
605
+ "learning_rate": 0.001,
606
+ "loss": 0.377,
607
+ "step": 156
608
+ },
609
+ {
610
+ "epoch": 10.99,
611
+ "learning_rate": 0.001,
612
+ "loss": 0.4338,
613
+ "step": 158
614
+ },
615
+ {
616
+ "epoch": 10.99,
617
+ "eval_gen_len": 493.3234421364985,
618
+ "eval_loss": 2.1197292804718018,
619
+ "eval_rouge1": 31.2004,
620
+ "eval_rouge2": 12.8569,
621
+ "eval_rougeL": 22.1282,
622
+ "eval_rougeLsum": 29.8827,
623
+ "eval_runtime": 1793.5921,
624
+ "eval_samples_per_second": 0.188,
625
+ "eval_steps_per_second": 0.024,
626
+ "step": 158
627
+ },
628
+ {
629
+ "epoch": 11.13,
630
+ "learning_rate": 0.001,
631
+ "loss": 0.2715,
632
+ "step": 160
633
+ },
634
+ {
635
+ "epoch": 11.27,
636
+ "learning_rate": 0.001,
637
+ "loss": 0.2391,
638
+ "step": 162
639
+ },
640
+ {
641
+ "epoch": 11.41,
642
+ "learning_rate": 0.001,
643
+ "loss": 0.2958,
644
+ "step": 164
645
+ },
646
+ {
647
+ "epoch": 11.55,
648
+ "learning_rate": 0.001,
649
+ "loss": 0.3101,
650
+ "step": 166
651
+ },
652
+ {
653
+ "epoch": 11.69,
654
+ "learning_rate": 0.001,
655
+ "loss": 0.3417,
656
+ "step": 168
657
+ },
658
+ {
659
+ "epoch": 11.83,
660
+ "learning_rate": 0.001,
661
+ "loss": 0.3292,
662
+ "step": 170
663
+ },
664
+ {
665
+ "epoch": 11.97,
666
+ "learning_rate": 0.001,
667
+ "loss": 0.2887,
668
+ "step": 172
669
+ },
670
+ {
671
+ "epoch": 11.97,
672
+ "eval_gen_len": 381.35905044510383,
673
+ "eval_loss": 2.1204545497894287,
674
+ "eval_rouge1": 34.9566,
675
+ "eval_rouge2": 13.8574,
676
+ "eval_rougeL": 25.1764,
677
+ "eval_rougeLsum": 33.2914,
678
+ "eval_runtime": 1792.804,
679
+ "eval_samples_per_second": 0.188,
680
+ "eval_steps_per_second": 0.024,
681
+ "step": 172
682
+ },
683
+ {
684
+ "epoch": 12.1,
685
+ "learning_rate": 0.001,
686
+ "loss": 0.2532,
687
+ "step": 174
688
+ },
689
+ {
690
+ "epoch": 12.24,
691
+ "learning_rate": 0.001,
692
+ "loss": 0.2565,
693
+ "step": 176
694
+ },
695
+ {
696
+ "epoch": 12.38,
697
+ "learning_rate": 0.001,
698
+ "loss": 0.2791,
699
+ "step": 178
700
+ },
701
+ {
702
+ "epoch": 12.52,
703
+ "learning_rate": 0.001,
704
+ "loss": 0.2803,
705
+ "step": 180
706
+ },
707
+ {
708
+ "epoch": 12.66,
709
+ "learning_rate": 0.001,
710
+ "loss": 0.3015,
711
+ "step": 182
712
+ },
713
+ {
714
+ "epoch": 12.8,
715
+ "learning_rate": 0.001,
716
+ "loss": 0.2764,
717
+ "step": 184
718
+ },
719
+ {
720
+ "epoch": 12.94,
721
+ "learning_rate": 0.001,
722
+ "loss": 0.2753,
723
+ "step": 186
724
+ },
725
+ {
726
+ "epoch": 12.94,
727
+ "eval_gen_len": 338.7240356083086,
728
+ "eval_loss": 2.429886817932129,
729
+ "eval_rouge1": 36.3877,
730
+ "eval_rouge2": 13.8584,
731
+ "eval_rougeL": 25.7829,
732
+ "eval_rougeLsum": 34.8601,
733
+ "eval_runtime": 1789.0093,
734
+ "eval_samples_per_second": 0.188,
735
+ "eval_steps_per_second": 0.024,
736
+ "step": 186
737
+ },
738
+ {
739
+ "epoch": 13.08,
740
+ "learning_rate": 0.001,
741
+ "loss": 0.2563,
742
+ "step": 188
743
+ },
744
+ {
745
+ "epoch": 13.22,
746
+ "learning_rate": 0.001,
747
+ "loss": 0.2024,
748
+ "step": 190
749
+ },
750
+ {
751
+ "epoch": 13.36,
752
+ "learning_rate": 0.001,
753
+ "loss": 0.2252,
754
+ "step": 192
755
+ },
756
+ {
757
+ "epoch": 13.5,
758
+ "learning_rate": 0.001,
759
+ "loss": 0.2487,
760
+ "step": 194
761
+ },
762
+ {
763
+ "epoch": 13.63,
764
+ "learning_rate": 0.001,
765
+ "loss": 0.2086,
766
+ "step": 196
767
+ },
768
+ {
769
+ "epoch": 13.77,
770
+ "learning_rate": 0.001,
771
+ "loss": 0.2181,
772
+ "step": 198
773
+ },
774
+ {
775
+ "epoch": 13.91,
776
+ "learning_rate": 0.001,
777
+ "loss": 0.2114,
778
+ "step": 200
779
+ },
780
+ {
781
+ "epoch": 13.98,
782
+ "eval_gen_len": 302.48367952522256,
783
+ "eval_loss": 2.5798637866973877,
784
+ "eval_rouge1": 39.7535,
785
+ "eval_rouge2": 16.1209,
786
+ "eval_rougeL": 27.8512,
787
+ "eval_rougeLsum": 37.8553,
788
+ "eval_runtime": 1773.2158,
789
+ "eval_samples_per_second": 0.19,
790
+ "eval_steps_per_second": 0.024,
791
+ "step": 201
792
+ },
793
+ {
794
+ "epoch": 14.05,
795
+ "learning_rate": 0.001,
796
+ "loss": 0.1828,
797
+ "step": 202
798
+ },
799
+ {
800
+ "epoch": 14.19,
801
+ "learning_rate": 0.001,
802
+ "loss": 0.2025,
803
+ "step": 204
804
+ },
805
+ {
806
+ "epoch": 14.33,
807
+ "learning_rate": 0.001,
808
+ "loss": 0.1991,
809
+ "step": 206
810
+ },
811
+ {
812
+ "epoch": 14.47,
813
+ "learning_rate": 0.001,
814
+ "loss": 0.1844,
815
+ "step": 208
816
+ },
817
+ {
818
+ "epoch": 14.61,
819
+ "learning_rate": 0.001,
820
+ "loss": 0.1934,
821
+ "step": 210
822
+ },
823
+ {
824
+ "epoch": 14.75,
825
+ "learning_rate": 0.001,
826
+ "loss": 0.2,
827
+ "step": 212
828
+ },
829
+ {
830
+ "epoch": 14.89,
831
+ "learning_rate": 0.001,
832
+ "loss": 0.1805,
833
+ "step": 214
834
+ },
835
+ {
836
+ "epoch": 14.96,
837
+ "eval_gen_len": 442.9258160237389,
838
+ "eval_loss": 2.612277030944824,
839
+ "eval_rouge1": 33.3254,
840
+ "eval_rouge2": 13.0868,
841
+ "eval_rougeL": 23.3214,
842
+ "eval_rougeLsum": 31.7901,
843
+ "eval_runtime": 1794.4617,
844
+ "eval_samples_per_second": 0.188,
845
+ "eval_steps_per_second": 0.024,
846
+ "step": 215
847
+ },
848
+ {
849
+ "epoch": 15.03,
850
+ "learning_rate": 0.001,
851
+ "loss": 0.1739,
852
+ "step": 216
853
+ },
854
+ {
855
+ "epoch": 15.17,
856
+ "learning_rate": 0.001,
857
+ "loss": 0.1504,
858
+ "step": 218
859
+ },
860
+ {
861
+ "epoch": 15.3,
862
+ "learning_rate": 0.001,
863
+ "loss": 0.1431,
864
+ "step": 220
865
+ },
866
+ {
867
+ "epoch": 15.44,
868
+ "learning_rate": 0.001,
869
+ "loss": 0.152,
870
+ "step": 222
871
+ },
872
+ {
873
+ "epoch": 15.58,
874
+ "learning_rate": 0.001,
875
+ "loss": 0.142,
876
+ "step": 224
877
+ },
878
+ {
879
+ "epoch": 15.72,
880
+ "learning_rate": 0.001,
881
+ "loss": 0.145,
882
+ "step": 226
883
+ },
884
+ {
885
+ "epoch": 15.86,
886
+ "learning_rate": 0.001,
887
+ "loss": 0.1476,
888
+ "step": 228
889
+ },
890
+ {
891
+ "epoch": 16.0,
892
+ "learning_rate": 0.001,
893
+ "loss": 0.1543,
894
+ "step": 230
895
+ },
896
+ {
897
+ "epoch": 16.0,
898
+ "eval_gen_len": 463.080118694362,
899
+ "eval_loss": 2.563481330871582,
900
+ "eval_rouge1": 31.7816,
901
+ "eval_rouge2": 13.1085,
902
+ "eval_rougeL": 22.9117,
903
+ "eval_rougeLsum": 30.2286,
904
+ "eval_runtime": 1793.3728,
905
+ "eval_samples_per_second": 0.188,
906
+ "eval_steps_per_second": 0.024,
907
+ "step": 230
908
+ },
909
+ {
910
+ "epoch": 16.14,
911
+ "learning_rate": 0.001,
912
+ "loss": 0.1245,
913
+ "step": 232
914
+ },
915
+ {
916
+ "epoch": 16.28,
917
+ "learning_rate": 0.001,
918
+ "loss": 0.1204,
919
+ "step": 234
920
+ },
921
+ {
922
+ "epoch": 16.42,
923
+ "learning_rate": 0.001,
924
+ "loss": 0.2117,
925
+ "step": 236
926
+ },
927
+ {
928
+ "epoch": 16.56,
929
+ "learning_rate": 0.001,
930
+ "loss": 0.6894,
931
+ "step": 238
932
+ },
933
+ {
934
+ "epoch": 16.7,
935
+ "learning_rate": 0.001,
936
+ "loss": 0.35,
937
+ "step": 240
938
+ },
939
+ {
940
+ "epoch": 16.83,
941
+ "learning_rate": 0.001,
942
+ "loss": 0.8395,
943
+ "step": 242
944
+ },
945
+ {
946
+ "epoch": 16.97,
947
+ "learning_rate": 0.001,
948
+ "loss": 0.5166,
949
+ "step": 244
950
+ },
951
+ {
952
+ "epoch": 16.97,
953
+ "eval_gen_len": 511.0,
954
+ "eval_loss": 2.513441562652588,
955
+ "eval_rouge1": 30.3969,
956
+ "eval_rouge2": 12.1295,
957
+ "eval_rougeL": 21.6616,
958
+ "eval_rougeLsum": 28.7606,
959
+ "eval_runtime": 1793.8473,
960
+ "eval_samples_per_second": 0.188,
961
+ "eval_steps_per_second": 0.024,
962
+ "step": 244
963
+ },
964
+ {
965
+ "epoch": 17.11,
966
+ "learning_rate": 0.001,
967
+ "loss": 0.202,
968
+ "step": 246
969
+ },
970
+ {
971
+ "epoch": 17.25,
972
+ "learning_rate": 0.001,
973
+ "loss": 0.1247,
974
+ "step": 248
975
+ },
976
+ {
977
+ "epoch": 17.39,
978
+ "learning_rate": 0.001,
979
+ "loss": 0.1368,
980
+ "step": 250
981
+ },
982
+ {
983
+ "epoch": 17.53,
984
+ "learning_rate": 0.001,
985
+ "loss": 0.1096,
986
+ "step": 252
987
+ },
988
+ {
989
+ "epoch": 17.67,
990
+ "learning_rate": 0.001,
991
+ "loss": 0.1066,
992
+ "step": 254
993
+ },
994
+ {
995
+ "epoch": 17.81,
996
+ "learning_rate": 0.001,
997
+ "loss": 0.1078,
998
+ "step": 256
999
+ },
1000
+ {
1001
+ "epoch": 17.95,
1002
+ "learning_rate": 0.001,
1003
+ "loss": 0.1117,
1004
+ "step": 258
1005
+ },
1006
+ {
1007
+ "epoch": 17.95,
1008
+ "eval_gen_len": 431.11572700296733,
1009
+ "eval_loss": 2.8108906745910645,
1010
+ "eval_rouge1": 35.336,
1011
+ "eval_rouge2": 14.9492,
1012
+ "eval_rougeL": 24.1938,
1013
+ "eval_rougeLsum": 33.822,
1014
+ "eval_runtime": 1792.5735,
1015
+ "eval_samples_per_second": 0.188,
1016
+ "eval_steps_per_second": 0.024,
1017
+ "step": 258
1018
+ },
1019
+ {
1020
+ "epoch": 18.09,
1021
+ "learning_rate": 0.001,
1022
+ "loss": 0.0934,
1023
+ "step": 260
1024
+ },
1025
+ {
1026
+ "epoch": 18.23,
1027
+ "learning_rate": 0.001,
1028
+ "loss": 0.0793,
1029
+ "step": 262
1030
+ },
1031
+ {
1032
+ "epoch": 18.37,
1033
+ "learning_rate": 0.001,
1034
+ "loss": 0.0887,
1035
+ "step": 264
1036
+ },
1037
+ {
1038
+ "epoch": 18.5,
1039
+ "learning_rate": 0.001,
1040
+ "loss": 0.103,
1041
+ "step": 266
1042
+ },
1043
+ {
1044
+ "epoch": 18.64,
1045
+ "learning_rate": 0.001,
1046
+ "loss": 0.0847,
1047
+ "step": 268
1048
+ },
1049
+ {
1050
+ "epoch": 18.78,
1051
+ "learning_rate": 0.001,
1052
+ "loss": 0.0869,
1053
+ "step": 270
1054
+ },
1055
+ {
1056
+ "epoch": 18.92,
1057
+ "learning_rate": 0.001,
1058
+ "loss": 0.0895,
1059
+ "step": 272
1060
+ },
1061
+ {
1062
+ "epoch": 18.99,
1063
+ "eval_gen_len": 240.13649851632047,
1064
+ "eval_loss": 2.7576751708984375,
1065
+ "eval_rouge1": 41.0982,
1066
+ "eval_rouge2": 16.3935,
1067
+ "eval_rougeL": 28.1073,
1068
+ "eval_rougeLsum": 39.1641,
1069
+ "eval_runtime": 1702.7984,
1070
+ "eval_samples_per_second": 0.198,
1071
+ "eval_steps_per_second": 0.025,
1072
+ "step": 273
1073
+ },
1074
+ {
1075
+ "epoch": 19.06,
1076
+ "learning_rate": 0.001,
1077
+ "loss": 0.0884,
1078
+ "step": 274
1079
+ },
1080
+ {
1081
+ "epoch": 19.2,
1082
+ "learning_rate": 0.001,
1083
+ "loss": 0.0838,
1084
+ "step": 276
1085
+ },
1086
+ {
1087
+ "epoch": 19.34,
1088
+ "learning_rate": 0.001,
1089
+ "loss": 0.0731,
1090
+ "step": 278
1091
+ },
1092
+ {
1093
+ "epoch": 19.48,
1094
+ "learning_rate": 0.001,
1095
+ "loss": 0.0779,
1096
+ "step": 280
1097
+ },
1098
+ {
1099
+ "epoch": 19.48,
1100
+ "eval_gen_len": 488.513353115727,
1101
+ "eval_loss": 2.8927440643310547,
1102
+ "eval_rouge1": 32.7788,
1103
+ "eval_rouge2": 13.9352,
1104
+ "eval_rougeL": 22.5175,
1105
+ "eval_rougeLsum": 31.548,
1106
+ "eval_runtime": 1795.5446,
1107
+ "eval_samples_per_second": 0.188,
1108
+ "eval_steps_per_second": 0.024,
1109
+ "step": 280
1110
+ },
1111
+ {
1112
+ "epoch": 19.48,
1113
+ "step": 280,
1114
+ "total_flos": 4.895224157149471e+18,
1115
+ "train_loss": 0.722327525381531,
1116
+ "train_runtime": 104579.6075,
1117
+ "train_samples_per_second": 0.702,
1118
+ "train_steps_per_second": 0.003
1119
+ }
1120
+ ],
1121
+ "logging_steps": 2,
1122
+ "max_steps": 280,
1123
+ "num_train_epochs": 20,
1124
+ "save_steps": 500,
1125
+ "total_flos": 4.895224157149471e+18,
1126
+ "trial_name": null,
1127
+ "trial_params": null
1128
+ }