File size: 27,435 Bytes
730e691
 
 
 
 
 
1d6d4e9
730e691
 
 
 
 
 
1d6d4e9
730e691
 
 
1d6d4e9
 
 
 
730e691
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1d6d4e9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
730e691
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run1_AugV5_k19_task2_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run1_AugV5_k19_task2_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.5696
- Qwk: 0.4897
- Mse: 0.5696
- Rmse: 0.7547

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.0206 | 2    | 4.1380          | -0.0300 | 4.1380 | 2.0342 |
| No log        | 0.0412 | 4    | 2.1926          | 0.0655  | 2.1926 | 1.4808 |
| No log        | 0.0619 | 6    | 1.4841          | 0.0107  | 1.4841 | 1.2182 |
| No log        | 0.0825 | 8    | 0.9411          | 0.0165  | 0.9411 | 0.9701 |
| No log        | 0.1031 | 10   | 0.8170          | 0.1922  | 0.8170 | 0.9039 |
| No log        | 0.1237 | 12   | 0.9094          | 0.0622  | 0.9094 | 0.9536 |
| No log        | 0.1443 | 14   | 1.2401          | 0.0554  | 1.2401 | 1.1136 |
| No log        | 0.1649 | 16   | 1.1642          | 0.0757  | 1.1642 | 1.0790 |
| No log        | 0.1856 | 18   | 1.3339          | 0.0857  | 1.3339 | 1.1549 |
| No log        | 0.2062 | 20   | 1.6360          | 0.0862  | 1.6360 | 1.2791 |
| No log        | 0.2268 | 22   | 1.7574          | 0.1414  | 1.7574 | 1.3257 |
| No log        | 0.2474 | 24   | 2.1597          | 0.0775  | 2.1597 | 1.4696 |
| No log        | 0.2680 | 26   | 2.1791          | 0.0676  | 2.1791 | 1.4762 |
| No log        | 0.2887 | 28   | 1.7777          | 0.1236  | 1.7777 | 1.3333 |
| No log        | 0.3093 | 30   | 1.2289          | 0.1649  | 1.2289 | 1.1085 |
| No log        | 0.3299 | 32   | 0.9522          | 0.1883  | 0.9522 | 0.9758 |
| No log        | 0.3505 | 34   | 0.9189          | 0.2167  | 0.9189 | 0.9586 |
| No log        | 0.3711 | 36   | 0.8797          | 0.2156  | 0.8797 | 0.9379 |
| No log        | 0.3918 | 38   | 0.8558          | 0.2856  | 0.8558 | 0.9251 |
| No log        | 0.4124 | 40   | 0.8375          | 0.2856  | 0.8375 | 0.9152 |
| No log        | 0.4330 | 42   | 0.8897          | 0.2847  | 0.8897 | 0.9432 |
| No log        | 0.4536 | 44   | 1.1178          | 0.2153  | 1.1178 | 1.0573 |
| No log        | 0.4742 | 46   | 1.4243          | 0.2083  | 1.4243 | 1.1934 |
| No log        | 0.4948 | 48   | 1.2828          | 0.2767  | 1.2828 | 1.1326 |
| No log        | 0.5155 | 50   | 1.0754          | 0.3302  | 1.0754 | 1.0370 |
| No log        | 0.5361 | 52   | 0.7237          | 0.4574  | 0.7237 | 0.8507 |
| No log        | 0.5567 | 54   | 0.5801          | 0.5855  | 0.5801 | 0.7616 |
| No log        | 0.5773 | 56   | 0.5903          | 0.6084  | 0.5903 | 0.7683 |
| No log        | 0.5979 | 58   | 0.6423          | 0.4870  | 0.6423 | 0.8015 |
| No log        | 0.6186 | 60   | 1.1732          | 0.2948  | 1.1732 | 1.0832 |
| No log        | 0.6392 | 62   | 1.8445          | 0.1594  | 1.8445 | 1.3581 |
| No log        | 0.6598 | 64   | 1.6898          | 0.1747  | 1.6898 | 1.2999 |
| No log        | 0.6804 | 66   | 1.0295          | 0.2667  | 1.0295 | 1.0147 |
| No log        | 0.7010 | 68   | 0.5469          | 0.4793  | 0.5469 | 0.7396 |
| No log        | 0.7216 | 70   | 0.5913          | 0.4665  | 0.5913 | 0.7690 |
| No log        | 0.7423 | 72   | 0.6382          | 0.4312  | 0.6382 | 0.7988 |
| No log        | 0.7629 | 74   | 0.7290          | 0.4084  | 0.7290 | 0.8538 |
| No log        | 0.7835 | 76   | 1.0808          | 0.2105  | 1.0808 | 1.0396 |
| No log        | 0.8041 | 78   | 1.6330          | 0.2362  | 1.6330 | 1.2779 |
| No log        | 0.8247 | 80   | 1.5265          | 0.2802  | 1.5265 | 1.2355 |
| No log        | 0.8454 | 82   | 1.0409          | 0.3253  | 1.0409 | 1.0202 |
| No log        | 0.8660 | 84   | 0.6581          | 0.5063  | 0.6581 | 0.8112 |
| No log        | 0.8866 | 86   | 0.6249          | 0.4432  | 0.6249 | 0.7905 |
| No log        | 0.9072 | 88   | 0.6474          | 0.4465  | 0.6474 | 0.8046 |
| No log        | 0.9278 | 90   | 0.6722          | 0.3996  | 0.6722 | 0.8199 |
| No log        | 0.9485 | 92   | 0.8848          | 0.3940  | 0.8848 | 0.9406 |
| No log        | 0.9691 | 94   | 1.2016          | 0.2877  | 1.2016 | 1.0962 |
| No log        | 0.9897 | 96   | 1.3564          | 0.2467  | 1.3564 | 1.1647 |
| No log        | 1.0103 | 98   | 1.2072          | 0.3063  | 1.2072 | 1.0987 |
| No log        | 1.0309 | 100  | 0.8765          | 0.3948  | 0.8765 | 0.9362 |
| No log        | 1.0515 | 102  | 0.6178          | 0.4411  | 0.6178 | 0.7860 |
| No log        | 1.0722 | 104  | 0.5961          | 0.4473  | 0.5961 | 0.7721 |
| No log        | 1.0928 | 106  | 0.6444          | 0.4320  | 0.6444 | 0.8027 |
| No log        | 1.1134 | 108  | 0.6210          | 0.4435  | 0.6210 | 0.7880 |
| No log        | 1.1340 | 110  | 0.6036          | 0.5054  | 0.6036 | 0.7769 |
| No log        | 1.1546 | 112  | 0.6216          | 0.5163  | 0.6216 | 0.7884 |
| No log        | 1.1753 | 114  | 0.6414          | 0.4962  | 0.6414 | 0.8009 |
| No log        | 1.1959 | 116  | 0.6506          | 0.4589  | 0.6506 | 0.8066 |
| No log        | 1.2165 | 118  | 0.6427          | 0.4897  | 0.6427 | 0.8017 |
| No log        | 1.2371 | 120  | 0.6384          | 0.4690  | 0.6384 | 0.7990 |
| No log        | 1.2577 | 122  | 0.6236          | 0.4792  | 0.6236 | 0.7897 |
| No log        | 1.2784 | 124  | 0.6175          | 0.5327  | 0.6175 | 0.7858 |
| No log        | 1.2990 | 126  | 0.6521          | 0.5088  | 0.6521 | 0.8075 |
| No log        | 1.3196 | 128  | 0.6032          | 0.5482  | 0.6032 | 0.7767 |
| No log        | 1.3402 | 130  | 0.5962          | 0.5365  | 0.5962 | 0.7722 |
| No log        | 1.3608 | 132  | 0.6235          | 0.5327  | 0.6235 | 0.7896 |
| No log        | 1.3814 | 134  | 0.6193          | 0.5183  | 0.6193 | 0.7869 |
| No log        | 1.4021 | 136  | 0.6203          | 0.5228  | 0.6203 | 0.7876 |
| No log        | 1.4227 | 138  | 0.6221          | 0.5312  | 0.6221 | 0.7887 |
| No log        | 1.4433 | 140  | 0.6229          | 0.5772  | 0.6229 | 0.7892 |
| No log        | 1.4639 | 142  | 0.6591          | 0.5003  | 0.6591 | 0.8118 |
| No log        | 1.4845 | 144  | 0.6437          | 0.5247  | 0.6437 | 0.8023 |
| No log        | 1.5052 | 146  | 0.6130          | 0.4690  | 0.6130 | 0.7829 |
| No log        | 1.5258 | 148  | 0.6337          | 0.4327  | 0.6337 | 0.7961 |
| No log        | 1.5464 | 150  | 0.6409          | 0.4860  | 0.6409 | 0.8006 |
| No log        | 1.5670 | 152  | 0.6451          | 0.5172  | 0.6451 | 0.8032 |
| No log        | 1.5876 | 154  | 0.6684          | 0.4767  | 0.6684 | 0.8176 |
| No log        | 1.6082 | 156  | 0.6713          | 0.4527  | 0.6713 | 0.8193 |
| No log        | 1.6289 | 158  | 0.6331          | 0.5476  | 0.6331 | 0.7957 |
| No log        | 1.6495 | 160  | 0.7267          | 0.5148  | 0.7267 | 0.8525 |
| No log        | 1.6701 | 162  | 0.8591          | 0.4346  | 0.8591 | 0.9269 |
| No log        | 1.6907 | 164  | 0.8062          | 0.4543  | 0.8062 | 0.8979 |
| No log        | 1.7113 | 166  | 0.6479          | 0.5777  | 0.6479 | 0.8049 |
| No log        | 1.7320 | 168  | 0.6130          | 0.5409  | 0.6130 | 0.7829 |
| No log        | 1.7526 | 170  | 0.6079          | 0.5295  | 0.6079 | 0.7797 |
| No log        | 1.7732 | 172  | 0.6118          | 0.5804  | 0.6118 | 0.7822 |
| No log        | 1.7938 | 174  | 0.6449          | 0.5904  | 0.6449 | 0.8030 |
| No log        | 1.8144 | 176  | 0.6292          | 0.5747  | 0.6292 | 0.7932 |
| No log        | 1.8351 | 178  | 0.6284          | 0.5271  | 0.6284 | 0.7927 |
| No log        | 1.8557 | 180  | 0.6304          | 0.5294  | 0.6304 | 0.7940 |
| No log        | 1.8763 | 182  | 0.6206          | 0.5162  | 0.6206 | 0.7878 |
| No log        | 1.8969 | 184  | 0.6560          | 0.4971  | 0.6560 | 0.8099 |
| No log        | 1.9175 | 186  | 0.6472          | 0.4801  | 0.6472 | 0.8045 |
| No log        | 1.9381 | 188  | 0.6155          | 0.4592  | 0.6155 | 0.7846 |
| No log        | 1.9588 | 190  | 0.6242          | 0.4788  | 0.6242 | 0.7901 |
| No log        | 1.9794 | 192  | 0.5884          | 0.4481  | 0.5884 | 0.7671 |
| No log        | 2.0    | 194  | 0.5942          | 0.4349  | 0.5942 | 0.7709 |
| No log        | 2.0206 | 196  | 0.7119          | 0.4539  | 0.7119 | 0.8437 |
| No log        | 2.0412 | 198  | 0.7090          | 0.4675  | 0.7090 | 0.8420 |
| No log        | 2.0619 | 200  | 0.6274          | 0.5308  | 0.6274 | 0.7921 |
| No log        | 2.0825 | 202  | 0.6138          | 0.5164  | 0.6138 | 0.7834 |
| No log        | 2.1031 | 204  | 0.6268          | 0.5135  | 0.6268 | 0.7917 |
| No log        | 2.1237 | 206  | 0.7358          | 0.4467  | 0.7358 | 0.8578 |
| No log        | 2.1443 | 208  | 0.7692          | 0.4298  | 0.7692 | 0.8770 |
| No log        | 2.1649 | 210  | 0.6562          | 0.5195  | 0.6562 | 0.8101 |
| No log        | 2.1856 | 212  | 0.6383          | 0.4998  | 0.6383 | 0.7989 |
| No log        | 2.2062 | 214  | 0.6457          | 0.4896  | 0.6457 | 0.8035 |
| No log        | 2.2268 | 216  | 0.6272          | 0.4799  | 0.6272 | 0.7919 |
| No log        | 2.2474 | 218  | 0.6729          | 0.4835  | 0.6729 | 0.8203 |
| No log        | 2.2680 | 220  | 0.6537          | 0.4983  | 0.6537 | 0.8085 |
| No log        | 2.2887 | 222  | 0.6228          | 0.4640  | 0.6228 | 0.7892 |
| No log        | 2.3093 | 224  | 0.6342          | 0.4548  | 0.6342 | 0.7963 |
| No log        | 2.3299 | 226  | 0.6319          | 0.4810  | 0.6319 | 0.7949 |
| No log        | 2.3505 | 228  | 0.6961          | 0.4881  | 0.6961 | 0.8343 |
| No log        | 2.3711 | 230  | 0.7336          | 0.5070  | 0.7336 | 0.8565 |
| No log        | 2.3918 | 232  | 0.6844          | 0.4761  | 0.6844 | 0.8273 |
| No log        | 2.4124 | 234  | 0.6651          | 0.4750  | 0.6651 | 0.8155 |
| No log        | 2.4330 | 236  | 0.6995          | 0.4797  | 0.6995 | 0.8364 |
| No log        | 2.4536 | 238  | 0.6746          | 0.4342  | 0.6746 | 0.8213 |
| No log        | 2.4742 | 240  | 0.6560          | 0.4505  | 0.6560 | 0.8099 |
| No log        | 2.4948 | 242  | 0.6561          | 0.4978  | 0.6561 | 0.8100 |
| No log        | 2.5155 | 244  | 0.6702          | 0.4788  | 0.6702 | 0.8187 |
| No log        | 2.5361 | 246  | 0.6312          | 0.5016  | 0.6312 | 0.7945 |
| No log        | 2.5567 | 248  | 0.6257          | 0.4649  | 0.6257 | 0.7910 |
| No log        | 2.5773 | 250  | 0.5853          | 0.4853  | 0.5853 | 0.7651 |
| No log        | 2.5979 | 252  | 0.5713          | 0.4795  | 0.5713 | 0.7558 |
| No log        | 2.6186 | 254  | 0.5715          | 0.4976  | 0.5715 | 0.7560 |
| No log        | 2.6392 | 256  | 0.5757          | 0.4877  | 0.5757 | 0.7587 |
| No log        | 2.6598 | 258  | 0.6168          | 0.4954  | 0.6168 | 0.7853 |
| No log        | 2.6804 | 260  | 0.6772          | 0.4858  | 0.6772 | 0.8229 |
| No log        | 2.7010 | 262  | 0.6510          | 0.4996  | 0.6510 | 0.8068 |
| No log        | 2.7216 | 264  | 0.6191          | 0.5222  | 0.6191 | 0.7868 |
| No log        | 2.7423 | 266  | 0.6761          | 0.5091  | 0.6761 | 0.8222 |
| No log        | 2.7629 | 268  | 0.7089          | 0.4831  | 0.7089 | 0.8420 |
| No log        | 2.7835 | 270  | 0.6751          | 0.5202  | 0.6751 | 0.8217 |
| No log        | 2.8041 | 272  | 0.6333          | 0.5298  | 0.6333 | 0.7958 |
| No log        | 2.8247 | 274  | 0.7017          | 0.5261  | 0.7017 | 0.8377 |
| No log        | 2.8454 | 276  | 0.7825          | 0.5050  | 0.7825 | 0.8846 |
| No log        | 2.8660 | 278  | 0.7395          | 0.4745  | 0.7395 | 0.8600 |
| No log        | 2.8866 | 280  | 0.7296          | 0.4673  | 0.7296 | 0.8542 |
| No log        | 2.9072 | 282  | 0.7109          | 0.4788  | 0.7109 | 0.8431 |
| No log        | 2.9278 | 284  | 0.7029          | 0.4606  | 0.7029 | 0.8384 |
| No log        | 2.9485 | 286  | 0.6403          | 0.4639  | 0.6403 | 0.8002 |
| No log        | 2.9691 | 288  | 0.5970          | 0.4894  | 0.5970 | 0.7727 |
| No log        | 2.9897 | 290  | 0.5966          | 0.5090  | 0.5966 | 0.7724 |
| No log        | 3.0103 | 292  | 0.6046          | 0.4743  | 0.6046 | 0.7775 |
| No log        | 3.0309 | 294  | 0.6563          | 0.4598  | 0.6563 | 0.8101 |
| No log        | 3.0515 | 296  | 0.6260          | 0.4480  | 0.6260 | 0.7912 |
| No log        | 3.0722 | 298  | 0.6205          | 0.5019  | 0.6205 | 0.7877 |
| No log        | 3.0928 | 300  | 0.6842          | 0.4310  | 0.6842 | 0.8271 |
| No log        | 3.1134 | 302  | 0.6589          | 0.3948  | 0.6589 | 0.8117 |
| No log        | 3.1340 | 304  | 0.6096          | 0.4953  | 0.6096 | 0.7807 |
| No log        | 3.1546 | 306  | 0.6520          | 0.4613  | 0.6520 | 0.8075 |
| No log        | 3.1753 | 308  | 0.6604          | 0.4554  | 0.6604 | 0.8126 |
| No log        | 3.1959 | 310  | 0.6224          | 0.4730  | 0.6224 | 0.7889 |
| No log        | 3.2165 | 312  | 0.6637          | 0.4425  | 0.6637 | 0.8147 |
| No log        | 3.2371 | 314  | 0.7207          | 0.4556  | 0.7207 | 0.8489 |
| No log        | 3.2577 | 316  | 0.6875          | 0.4091  | 0.6875 | 0.8292 |
| No log        | 3.2784 | 318  | 0.6330          | 0.4724  | 0.6330 | 0.7956 |
| No log        | 3.2990 | 320  | 0.6299          | 0.4565  | 0.6299 | 0.7936 |
| No log        | 3.3196 | 322  | 0.6736          | 0.5156  | 0.6736 | 0.8207 |
| No log        | 3.3402 | 324  | 0.6877          | 0.5162  | 0.6877 | 0.8293 |
| No log        | 3.3608 | 326  | 0.6621          | 0.5003  | 0.6621 | 0.8137 |
| No log        | 3.3814 | 328  | 0.6191          | 0.4897  | 0.6191 | 0.7868 |
| No log        | 3.4021 | 330  | 0.6398          | 0.3931  | 0.6398 | 0.7999 |
| No log        | 3.4227 | 332  | 0.6319          | 0.4125  | 0.6319 | 0.7949 |
| No log        | 3.4433 | 334  | 0.6236          | 0.4817  | 0.6236 | 0.7897 |
| No log        | 3.4639 | 336  | 0.6769          | 0.5056  | 0.6769 | 0.8228 |
| No log        | 3.4845 | 338  | 0.6420          | 0.4733  | 0.6420 | 0.8013 |
| No log        | 3.5052 | 340  | 0.6054          | 0.4763  | 0.6054 | 0.7781 |
| No log        | 3.5258 | 342  | 0.5934          | 0.4352  | 0.5934 | 0.7703 |
| No log        | 3.5464 | 344  | 0.5899          | 0.4177  | 0.5899 | 0.7680 |
| No log        | 3.5670 | 346  | 0.5853          | 0.4212  | 0.5853 | 0.7651 |
| No log        | 3.5876 | 348  | 0.5856          | 0.4732  | 0.5856 | 0.7653 |
| No log        | 3.6082 | 350  | 0.5855          | 0.4630  | 0.5855 | 0.7652 |
| No log        | 3.6289 | 352  | 0.5888          | 0.4598  | 0.5888 | 0.7673 |
| No log        | 3.6495 | 354  | 0.5780          | 0.4625  | 0.5780 | 0.7603 |
| No log        | 3.6701 | 356  | 0.6076          | 0.5228  | 0.6076 | 0.7795 |
| No log        | 3.6907 | 358  | 0.6223          | 0.5201  | 0.6223 | 0.7888 |
| No log        | 3.7113 | 360  | 0.5909          | 0.4939  | 0.5909 | 0.7687 |
| No log        | 3.7320 | 362  | 0.5827          | 0.4582  | 0.5827 | 0.7634 |
| No log        | 3.7526 | 364  | 0.5909          | 0.4405  | 0.5909 | 0.7687 |
| No log        | 3.7732 | 366  | 0.5887          | 0.4454  | 0.5887 | 0.7673 |
| No log        | 3.7938 | 368  | 0.5943          | 0.5042  | 0.5943 | 0.7709 |
| No log        | 3.8144 | 370  | 0.6155          | 0.5218  | 0.6155 | 0.7845 |
| No log        | 3.8351 | 372  | 0.6295          | 0.5124  | 0.6295 | 0.7934 |
| No log        | 3.8557 | 374  | 0.5974          | 0.4804  | 0.5974 | 0.7729 |
| No log        | 3.8763 | 376  | 0.5931          | 0.4903  | 0.5931 | 0.7701 |
| No log        | 3.8969 | 378  | 0.6024          | 0.5046  | 0.6024 | 0.7761 |
| No log        | 3.9175 | 380  | 0.6068          | 0.4869  | 0.6068 | 0.7790 |
| No log        | 3.9381 | 382  | 0.6060          | 0.5011  | 0.6060 | 0.7785 |
| No log        | 3.9588 | 384  | 0.6073          | 0.4941  | 0.6073 | 0.7793 |
| No log        | 3.9794 | 386  | 0.6112          | 0.5032  | 0.6112 | 0.7818 |
| No log        | 4.0    | 388  | 0.6586          | 0.4747  | 0.6586 | 0.8115 |
| No log        | 4.0206 | 390  | 0.7199          | 0.4871  | 0.7199 | 0.8485 |
| No log        | 4.0412 | 392  | 0.6913          | 0.5062  | 0.6913 | 0.8315 |
| No log        | 4.0619 | 394  | 0.6096          | 0.4722  | 0.6096 | 0.7808 |
| No log        | 4.0825 | 396  | 0.5821          | 0.5422  | 0.5821 | 0.7629 |
| No log        | 4.1031 | 398  | 0.5870          | 0.5329  | 0.5870 | 0.7661 |
| No log        | 4.1237 | 400  | 0.5799          | 0.5251  | 0.5799 | 0.7615 |
| No log        | 4.1443 | 402  | 0.6102          | 0.5153  | 0.6102 | 0.7811 |
| No log        | 4.1649 | 404  | 0.6121          | 0.4983  | 0.6121 | 0.7824 |
| No log        | 4.1856 | 406  | 0.6060          | 0.4792  | 0.6060 | 0.7784 |
| No log        | 4.2062 | 408  | 0.6139          | 0.5351  | 0.6139 | 0.7835 |
| No log        | 4.2268 | 410  | 0.6150          | 0.4839  | 0.6150 | 0.7842 |
| No log        | 4.2474 | 412  | 0.6507          | 0.4554  | 0.6507 | 0.8066 |
| No log        | 4.2680 | 414  | 0.6901          | 0.4591  | 0.6901 | 0.8307 |
| No log        | 4.2887 | 416  | 0.7909          | 0.4677  | 0.7909 | 0.8893 |
| No log        | 4.3093 | 418  | 0.7504          | 0.4970  | 0.7504 | 0.8663 |
| No log        | 4.3299 | 420  | 0.6851          | 0.4706  | 0.6851 | 0.8277 |
| No log        | 4.3505 | 422  | 0.6194          | 0.5031  | 0.6194 | 0.7870 |
| No log        | 4.3711 | 424  | 0.6035          | 0.5335  | 0.6035 | 0.7769 |
| No log        | 4.3918 | 426  | 0.6026          | 0.4772  | 0.6026 | 0.7763 |
| No log        | 4.4124 | 428  | 0.5871          | 0.5236  | 0.5871 | 0.7662 |
| No log        | 4.4330 | 430  | 0.5784          | 0.5046  | 0.5784 | 0.7605 |
| No log        | 4.4536 | 432  | 0.5865          | 0.5173  | 0.5865 | 0.7659 |
| No log        | 4.4742 | 434  | 0.5854          | 0.5147  | 0.5854 | 0.7651 |
| No log        | 4.4948 | 436  | 0.5877          | 0.5122  | 0.5877 | 0.7666 |
| No log        | 4.5155 | 438  | 0.6068          | 0.5005  | 0.6068 | 0.7790 |
| No log        | 4.5361 | 440  | 0.5937          | 0.5341  | 0.5937 | 0.7705 |
| No log        | 4.5567 | 442  | 0.5900          | 0.5692  | 0.5900 | 0.7681 |
| No log        | 4.5773 | 444  | 0.6375          | 0.5487  | 0.6375 | 0.7984 |
| No log        | 4.5979 | 446  | 0.6428          | 0.5430  | 0.6428 | 0.8018 |
| No log        | 4.6186 | 448  | 0.5890          | 0.5529  | 0.5890 | 0.7674 |
| No log        | 4.6392 | 450  | 0.5431          | 0.5097  | 0.5431 | 0.7369 |
| No log        | 4.6598 | 452  | 0.5442          | 0.5327  | 0.5442 | 0.7377 |
| No log        | 4.6804 | 454  | 0.5439          | 0.5327  | 0.5439 | 0.7375 |
| No log        | 4.7010 | 456  | 0.5456          | 0.5361  | 0.5456 | 0.7387 |
| No log        | 4.7216 | 458  | 0.5931          | 0.5358  | 0.5931 | 0.7701 |
| No log        | 4.7423 | 460  | 0.7570          | 0.4870  | 0.7570 | 0.8701 |
| No log        | 4.7629 | 462  | 0.8102          | 0.4872  | 0.8102 | 0.9001 |
| No log        | 4.7835 | 464  | 0.6820          | 0.5369  | 0.6820 | 0.8258 |
| No log        | 4.8041 | 466  | 0.6161          | 0.5220  | 0.6161 | 0.7849 |
| No log        | 4.8247 | 468  | 0.5818          | 0.5558  | 0.5818 | 0.7627 |
| No log        | 4.8454 | 470  | 0.5692          | 0.5040  | 0.5692 | 0.7545 |
| No log        | 4.8660 | 472  | 0.5712          | 0.4922  | 0.5712 | 0.7557 |
| No log        | 4.8866 | 474  | 0.5821          | 0.4860  | 0.5821 | 0.7630 |
| No log        | 4.9072 | 476  | 0.6070          | 0.4773  | 0.6070 | 0.7791 |
| No log        | 4.9278 | 478  | 0.6099          | 0.5404  | 0.6099 | 0.7810 |
| No log        | 4.9485 | 480  | 0.6386          | 0.5491  | 0.6386 | 0.7991 |
| No log        | 4.9691 | 482  | 0.6285          | 0.5610  | 0.6285 | 0.7928 |
| No log        | 4.9897 | 484  | 0.5990          | 0.5796  | 0.5990 | 0.7740 |
| No log        | 5.0103 | 486  | 0.5899          | 0.5120  | 0.5899 | 0.7680 |
| No log        | 5.0309 | 488  | 0.5872          | 0.5444  | 0.5872 | 0.7663 |
| No log        | 5.0515 | 490  | 0.5815          | 0.5254  | 0.5815 | 0.7626 |
| No log        | 5.0722 | 492  | 0.5868          | 0.5385  | 0.5868 | 0.7660 |
| No log        | 5.0928 | 494  | 0.5797          | 0.5610  | 0.5797 | 0.7614 |
| No log        | 5.1134 | 496  | 0.5723          | 0.5218  | 0.5723 | 0.7565 |
| No log        | 5.1340 | 498  | 0.5875          | 0.5352  | 0.5875 | 0.7665 |
| 0.3861        | 5.1546 | 500  | 0.5769          | 0.5215  | 0.5769 | 0.7596 |
| 0.3861        | 5.1753 | 502  | 0.5817          | 0.5695  | 0.5817 | 0.7627 |
| 0.3861        | 5.1959 | 504  | 0.6012          | 0.5691  | 0.6012 | 0.7754 |
| 0.3861        | 5.2165 | 506  | 0.5812          | 0.5451  | 0.5812 | 0.7623 |
| 0.3861        | 5.2371 | 508  | 0.5761          | 0.5312  | 0.5761 | 0.7590 |
| 0.3861        | 5.2577 | 510  | 0.5850          | 0.5571  | 0.5850 | 0.7648 |
| 0.3861        | 5.2784 | 512  | 0.6126          | 0.5009  | 0.6126 | 0.7827 |
| 0.3861        | 5.2990 | 514  | 0.6207          | 0.4996  | 0.6207 | 0.7878 |
| 0.3861        | 5.3196 | 516  | 0.6217          | 0.4996  | 0.6217 | 0.7885 |
| 0.3861        | 5.3402 | 518  | 0.5689          | 0.5544  | 0.5689 | 0.7542 |
| 0.3861        | 5.3608 | 520  | 0.5556          | 0.5647  | 0.5556 | 0.7454 |
| 0.3861        | 5.3814 | 522  | 0.5487          | 0.5556  | 0.5487 | 0.7408 |
| 0.3861        | 5.4021 | 524  | 0.5494          | 0.5740  | 0.5494 | 0.7412 |
| 0.3861        | 5.4227 | 526  | 0.5550          | 0.5817  | 0.5550 | 0.7450 |
| 0.3861        | 5.4433 | 528  | 0.5534          | 0.5579  | 0.5534 | 0.7439 |
| 0.3861        | 5.4639 | 530  | 0.5575          | 0.5438  | 0.5575 | 0.7467 |
| 0.3861        | 5.4845 | 532  | 0.5775          | 0.5408  | 0.5775 | 0.7599 |
| 0.3861        | 5.5052 | 534  | 0.5938          | 0.5652  | 0.5938 | 0.7706 |
| 0.3861        | 5.5258 | 536  | 0.6113          | 0.5616  | 0.6113 | 0.7818 |
| 0.3861        | 5.5464 | 538  | 0.6275          | 0.5618  | 0.6275 | 0.7922 |
| 0.3861        | 5.5670 | 540  | 0.6924          | 0.5809  | 0.6924 | 0.8321 |
| 0.3861        | 5.5876 | 542  | 0.7861          | 0.5123  | 0.7861 | 0.8866 |
| 0.3861        | 5.6082 | 544  | 0.8001          | 0.4808  | 0.8001 | 0.8945 |
| 0.3861        | 5.6289 | 546  | 0.7375          | 0.5408  | 0.7375 | 0.8588 |
| 0.3861        | 5.6495 | 548  | 0.6222          | 0.5587  | 0.6222 | 0.7888 |
| 0.3861        | 5.6701 | 550  | 0.5690          | 0.5758  | 0.5690 | 0.7543 |
| 0.3861        | 5.6907 | 552  | 0.5787          | 0.5823  | 0.5787 | 0.7607 |
| 0.3861        | 5.7113 | 554  | 0.5749          | 0.5520  | 0.5749 | 0.7582 |
| 0.3861        | 5.7320 | 556  | 0.5503          | 0.5579  | 0.5503 | 0.7418 |
| 0.3861        | 5.7526 | 558  | 0.5395          | 0.5702  | 0.5395 | 0.7345 |
| 0.3861        | 5.7732 | 560  | 0.5459          | 0.5703  | 0.5459 | 0.7388 |
| 0.3861        | 5.7938 | 562  | 0.5539          | 0.5534  | 0.5539 | 0.7442 |
| 0.3861        | 5.8144 | 564  | 0.5552          | 0.5534  | 0.5552 | 0.7451 |
| 0.3861        | 5.8351 | 566  | 0.5536          | 0.5626  | 0.5536 | 0.7440 |
| 0.3861        | 5.8557 | 568  | 0.5625          | 0.5541  | 0.5625 | 0.7500 |
| 0.3861        | 5.8763 | 570  | 0.5678          | 0.5637  | 0.5678 | 0.7535 |
| 0.3861        | 5.8969 | 572  | 0.5680          | 0.5694  | 0.5680 | 0.7537 |
| 0.3861        | 5.9175 | 574  | 0.5669          | 0.5563  | 0.5669 | 0.7529 |
| 0.3861        | 5.9381 | 576  | 0.5684          | 0.5497  | 0.5684 | 0.7539 |
| 0.3861        | 5.9588 | 578  | 0.5688          | 0.5271  | 0.5688 | 0.7542 |
| 0.3861        | 5.9794 | 580  | 0.5886          | 0.5106  | 0.5886 | 0.7672 |
| 0.3861        | 6.0    | 582  | 0.6190          | 0.5278  | 0.6190 | 0.7868 |
| 0.3861        | 6.0206 | 584  | 0.6129          | 0.5199  | 0.6129 | 0.7829 |
| 0.3861        | 6.0412 | 586  | 0.5768          | 0.5089  | 0.5768 | 0.7595 |
| 0.3861        | 6.0619 | 588  | 0.5636          | 0.5415  | 0.5636 | 0.7507 |
| 0.3861        | 6.0825 | 590  | 0.5543          | 0.5847  | 0.5543 | 0.7445 |
| 0.3861        | 6.1031 | 592  | 0.5442          | 0.5562  | 0.5442 | 0.7377 |
| 0.3861        | 6.1237 | 594  | 0.5482          | 0.5704  | 0.5482 | 0.7404 |
| 0.3861        | 6.1443 | 596  | 0.5535          | 0.5952  | 0.5535 | 0.7440 |
| 0.3861        | 6.1649 | 598  | 0.5538          | 0.5731  | 0.5538 | 0.7442 |
| 0.3861        | 6.1856 | 600  | 0.5486          | 0.6032  | 0.5486 | 0.7407 |
| 0.3861        | 6.2062 | 602  | 0.5420          | 0.5891  | 0.5420 | 0.7362 |
| 0.3861        | 6.2268 | 604  | 0.5446          | 0.5822  | 0.5446 | 0.7380 |
| 0.3861        | 6.2474 | 606  | 0.5410          | 0.5988  | 0.5410 | 0.7355 |
| 0.3861        | 6.2680 | 608  | 0.5347          | 0.6017  | 0.5347 | 0.7312 |
| 0.3861        | 6.2887 | 610  | 0.5233          | 0.6026  | 0.5233 | 0.7234 |
| 0.3861        | 6.3093 | 612  | 0.5204          | 0.5601  | 0.5204 | 0.7214 |
| 0.3861        | 6.3299 | 614  | 0.5204          | 0.5462  | 0.5204 | 0.7214 |
| 0.3861        | 6.3505 | 616  | 0.5191          | 0.5229  | 0.5191 | 0.7205 |
| 0.3861        | 6.3711 | 618  | 0.5208          | 0.5773  | 0.5208 | 0.7216 |
| 0.3861        | 6.3918 | 620  | 0.5225          | 0.5717  | 0.5225 | 0.7228 |
| 0.3861        | 6.4124 | 622  | 0.5488          | 0.5029  | 0.5488 | 0.7408 |
| 0.3861        | 6.4330 | 624  | 0.6047          | 0.4776  | 0.6047 | 0.7776 |
| 0.3861        | 6.4536 | 626  | 0.5943          | 0.4953  | 0.5943 | 0.7709 |
| 0.3861        | 6.4742 | 628  | 0.5479          | 0.5171  | 0.5479 | 0.7402 |
| 0.3861        | 6.4948 | 630  | 0.5502          | 0.5579  | 0.5502 | 0.7417 |
| 0.3861        | 6.5155 | 632  | 0.5669          | 0.5544  | 0.5669 | 0.7529 |
| 0.3861        | 6.5361 | 634  | 0.5635          | 0.5370  | 0.5635 | 0.7506 |
| 0.3861        | 6.5567 | 636  | 0.5495          | 0.4736  | 0.5495 | 0.7413 |
| 0.3861        | 6.5773 | 638  | 0.5538          | 0.5233  | 0.5538 | 0.7442 |
| 0.3861        | 6.5979 | 640  | 0.5737          | 0.4923  | 0.5737 | 0.7574 |
| 0.3861        | 6.6186 | 642  | 0.6011          | 0.4605  | 0.6011 | 0.7753 |
| 0.3861        | 6.6392 | 644  | 0.5925          | 0.4635  | 0.5925 | 0.7698 |
| 0.3861        | 6.6598 | 646  | 0.5638          | 0.5045  | 0.5638 | 0.7509 |
| 0.3861        | 6.6804 | 648  | 0.5696          | 0.4897  | 0.5696 | 0.7547 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1