File size: 9,072 Bytes
e302db6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
Writing logs to ./outputs/2024-03-22-01-16-17-693140/train_log.txt.
Wrote original training args to ./outputs/2024-03-22-01-16-17-693140/training_args.json.
***** Running training *****
  Num examples = 560000
  Num epochs = 50
  Num clean epochs = 50
  Instantaneous batch size per device = 8
  Total train batch size (w. parallel, distributed & accumulation) = 8
  Gradient accumulation steps = 1
  Total optimization steps = 3500000
==========================================================
Epoch 1
Running clean epoch 1/50
Train accuracy: 81.85%
Eval accuracy: 88.42%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 2
Running clean epoch 2/50
Train accuracy: 88.95%
Eval accuracy: 88.87%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 3
Running clean epoch 3/50
Train accuracy: 89.65%
Eval accuracy: 89.58%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 4
Running clean epoch 4/50
Train accuracy: 90.02%
Eval accuracy: 89.53%
==========================================================
Epoch 5
Running clean epoch 5/50
Train accuracy: 90.22%
Eval accuracy: 89.73%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 6
Running clean epoch 6/50
Train accuracy: 90.43%
Eval accuracy: 89.60%
==========================================================
Epoch 7
Running clean epoch 7/50
Train accuracy: 90.64%
Eval accuracy: 89.83%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 8
Running clean epoch 8/50
Train accuracy: 90.79%
Eval accuracy: 90.04%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 9
Running clean epoch 9/50
Train accuracy: 90.97%
Eval accuracy: 90.22%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 10
Running clean epoch 10/50
Train accuracy: 91.16%
Eval accuracy: 90.33%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 11
Running clean epoch 11/50
Train accuracy: 91.37%
Eval accuracy: 90.50%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 12
Running clean epoch 12/50
Train accuracy: 91.58%
Eval accuracy: 90.42%
==========================================================
Epoch 13
Running clean epoch 13/50
Train accuracy: 91.81%
Eval accuracy: 90.64%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 14
Running clean epoch 14/50
Train accuracy: 92.01%
Eval accuracy: 90.71%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 15
Running clean epoch 15/50
Train accuracy: 92.23%
Eval accuracy: 90.88%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 16
Running clean epoch 16/50
Train accuracy: 92.41%
Eval accuracy: 90.95%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 17
Running clean epoch 17/50
Train accuracy: 92.59%
Eval accuracy: 90.72%
==========================================================
Epoch 18
Running clean epoch 18/50
Train accuracy: 92.78%
Eval accuracy: 91.12%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 19
Running clean epoch 19/50
Train accuracy: 92.97%
Eval accuracy: 91.19%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 20
Running clean epoch 20/50
Train accuracy: 93.12%
Eval accuracy: 91.43%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 21
Running clean epoch 21/50
Train accuracy: 93.28%
Eval accuracy: 91.47%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 22
Running clean epoch 22/50
Train accuracy: 93.42%
Eval accuracy: 91.52%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 23
Running clean epoch 23/50
Train accuracy: 93.54%
Eval accuracy: 91.71%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 24
Running clean epoch 24/50
Train accuracy: 93.69%
Eval accuracy: 91.61%
==========================================================
Epoch 25
Running clean epoch 25/50
Train accuracy: 93.86%
Eval accuracy: 91.69%
==========================================================
Epoch 26
Running clean epoch 26/50
Train accuracy: 93.98%
Eval accuracy: 91.63%
==========================================================
Epoch 27
Running clean epoch 27/50
Train accuracy: 94.12%
Eval accuracy: 91.57%
==========================================================
Epoch 28
Running clean epoch 28/50
Train accuracy: 94.24%
Eval accuracy: 91.74%
Best score found. Saved model to ./outputs/2024-03-22-01-16-17-693140/best_model/
==========================================================
Epoch 29
Running clean epoch 29/50
Train accuracy: 94.37%
Eval accuracy: 91.73%
==========================================================
Epoch 30
Running clean epoch 30/50
Train accuracy: 94.47%
Eval accuracy: 91.45%
==========================================================
Epoch 31
Running clean epoch 31/50
Train accuracy: 94.62%
Eval accuracy: 91.34%
==========================================================
Epoch 32
Running clean epoch 32/50
Train accuracy: 94.72%
Eval accuracy: 91.58%
==========================================================
Epoch 33
Running clean epoch 33/50
Train accuracy: 94.86%
Eval accuracy: 91.61%
==========================================================
Epoch 34
Running clean epoch 34/50
Train accuracy: 94.96%
Eval accuracy: 91.70%
==========================================================
Epoch 35
Running clean epoch 35/50
Train accuracy: 95.06%
Eval accuracy: 91.65%
==========================================================
Epoch 36
Running clean epoch 36/50
Train accuracy: 95.17%
Eval accuracy: 91.71%
==========================================================
Epoch 37
Running clean epoch 37/50
Train accuracy: 95.28%
Eval accuracy: 91.58%
==========================================================
Epoch 38
Running clean epoch 38/50
Train accuracy: 95.37%
Eval accuracy: 91.52%
==========================================================
Epoch 39
Running clean epoch 39/50
Train accuracy: 95.49%
Eval accuracy: 91.10%
==========================================================
Epoch 40
Running clean epoch 40/50
Train accuracy: 95.58%
Eval accuracy: 91.54%
==========================================================
Epoch 41
Running clean epoch 41/50
Train accuracy: 95.68%
Eval accuracy: 91.37%
==========================================================
Epoch 42
Running clean epoch 42/50
Train accuracy: 95.76%
Eval accuracy: 91.34%
==========================================================
Epoch 43
Running clean epoch 43/50
Train accuracy: 95.85%
Eval accuracy: 91.01%
==========================================================
Epoch 44
Running clean epoch 44/50
Train accuracy: 95.95%
Eval accuracy: 91.35%
==========================================================
Epoch 45
Running clean epoch 45/50
Train accuracy: 96.03%
Eval accuracy: 91.23%
==========================================================
Epoch 46
Running clean epoch 46/50
Train accuracy: 96.10%
Eval accuracy: 91.19%
==========================================================
Epoch 47
Running clean epoch 47/50
Train accuracy: 96.18%
Eval accuracy: 91.14%
==========================================================
Epoch 48
Running clean epoch 48/50
Train accuracy: 96.29%
Eval accuracy: 91.27%
==========================================================
Epoch 49
Running clean epoch 49/50
Train accuracy: 96.39%
Eval accuracy: 91.14%
==========================================================
Epoch 50
Running clean epoch 50/50
Train accuracy: 96.46%
Eval accuracy: 91.11%
Wrote README to ./outputs/2024-03-22-01-16-17-693140/README.md.