File size: 22,790 Bytes
43b6833
 
 
 
 
 
e04b520
43b6833
 
 
 
 
 
e04b520
43b6833
 
 
e04b520
 
 
 
43b6833
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e04b520
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
43b6833
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k13_task7_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k13_task7_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.5192
- Qwk: 0.4774
- Mse: 0.5192
- Rmse: 0.7206

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch   | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:-------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.0588  | 2    | 2.5594          | -0.0449 | 2.5594 | 1.5998 |
| No log        | 0.1176  | 4    | 1.4126          | 0.0745  | 1.4126 | 1.1885 |
| No log        | 0.1765  | 6    | 1.0381          | -0.0970 | 1.0381 | 1.0189 |
| No log        | 0.2353  | 8    | 0.8738          | -0.0025 | 0.8738 | 0.9348 |
| No log        | 0.2941  | 10   | 0.7635          | 0.0444  | 0.7635 | 0.8738 |
| No log        | 0.3529  | 12   | 0.7323          | 0.1660  | 0.7323 | 0.8558 |
| No log        | 0.4118  | 14   | 0.7389          | 0.2085  | 0.7389 | 0.8596 |
| No log        | 0.4706  | 16   | 0.6634          | 0.2374  | 0.6634 | 0.8145 |
| No log        | 0.5294  | 18   | 0.8164          | 0.2672  | 0.8164 | 0.9035 |
| No log        | 0.5882  | 20   | 0.9101          | 0.1521  | 0.9101 | 0.9540 |
| No log        | 0.6471  | 22   | 0.7448          | 0.2642  | 0.7448 | 0.8630 |
| No log        | 0.7059  | 24   | 0.6353          | 0.2740  | 0.6353 | 0.7970 |
| No log        | 0.7647  | 26   | 0.7678          | 0.2227  | 0.7678 | 0.8763 |
| No log        | 0.8235  | 28   | 1.0758          | 0.0713  | 1.0758 | 1.0372 |
| No log        | 0.8824  | 30   | 1.1740          | 0.0263  | 1.1740 | 1.0835 |
| No log        | 0.9412  | 32   | 0.9041          | 0.1822  | 0.9041 | 0.9509 |
| No log        | 1.0     | 34   | 0.8479          | 0.1373  | 0.8479 | 0.9208 |
| No log        | 1.0588  | 36   | 0.9137          | 0.1501  | 0.9137 | 0.9559 |
| No log        | 1.1176  | 38   | 1.2658          | 0.0688  | 1.2658 | 1.1251 |
| No log        | 1.1765  | 40   | 1.3941          | -0.0102 | 1.3941 | 1.1807 |
| No log        | 1.2353  | 42   | 1.0966          | 0.1599  | 1.0966 | 1.0472 |
| No log        | 1.2941  | 44   | 0.7795          | 0.1416  | 0.7795 | 0.8829 |
| No log        | 1.3529  | 46   | 0.7401          | 0.2319  | 0.7401 | 0.8603 |
| No log        | 1.4118  | 48   | 0.7150          | 0.3197  | 0.7150 | 0.8456 |
| No log        | 1.4706  | 50   | 0.7576          | 0.1815  | 0.7576 | 0.8704 |
| No log        | 1.5294  | 52   | 0.7473          | 0.2227  | 0.7473 | 0.8645 |
| No log        | 1.5882  | 54   | 0.7126          | 0.2857  | 0.7126 | 0.8442 |
| No log        | 1.6471  | 56   | 0.7179          | 0.2857  | 0.7179 | 0.8473 |
| No log        | 1.7059  | 58   | 0.7864          | 0.2012  | 0.7864 | 0.8868 |
| No log        | 1.7647  | 60   | 0.9939          | 0.2363  | 0.9939 | 0.9970 |
| No log        | 1.8235  | 62   | 1.0253          | 0.1827  | 1.0253 | 1.0126 |
| No log        | 1.8824  | 64   | 0.7689          | 0.3519  | 0.7689 | 0.8769 |
| No log        | 1.9412  | 66   | 0.6555          | 0.4308  | 0.6555 | 0.8097 |
| No log        | 2.0     | 68   | 0.6892          | 0.4283  | 0.6892 | 0.8302 |
| No log        | 2.0588  | 70   | 0.6777          | 0.4234  | 0.6777 | 0.8232 |
| No log        | 2.1176  | 72   | 0.5715          | 0.4265  | 0.5715 | 0.7560 |
| No log        | 2.1765  | 74   | 0.7043          | 0.4404  | 0.7043 | 0.8392 |
| No log        | 2.2353  | 76   | 0.7034          | 0.4328  | 0.7034 | 0.8387 |
| No log        | 2.2941  | 78   | 0.5727          | 0.4808  | 0.5727 | 0.7568 |
| No log        | 2.3529  | 80   | 0.6822          | 0.2853  | 0.6822 | 0.8259 |
| No log        | 2.4118  | 82   | 0.6656          | 0.2886  | 0.6656 | 0.8158 |
| No log        | 2.4706  | 84   | 0.5700          | 0.4019  | 0.5700 | 0.7550 |
| No log        | 2.5294  | 86   | 0.6587          | 0.4576  | 0.6587 | 0.8116 |
| No log        | 2.5882  | 88   | 0.7495          | 0.3822  | 0.7495 | 0.8658 |
| No log        | 2.6471  | 90   | 0.6609          | 0.4576  | 0.6609 | 0.8130 |
| No log        | 2.7059  | 92   | 0.5779          | 0.4701  | 0.5779 | 0.7602 |
| No log        | 2.7647  | 94   | 0.6975          | 0.3402  | 0.6975 | 0.8351 |
| No log        | 2.8235  | 96   | 0.7107          | 0.3941  | 0.7107 | 0.8430 |
| No log        | 2.8824  | 98   | 0.6058          | 0.4972  | 0.6058 | 0.7784 |
| No log        | 2.9412  | 100  | 0.6761          | 0.4409  | 0.6761 | 0.8222 |
| No log        | 3.0     | 102  | 0.8333          | 0.4255  | 0.8333 | 0.9128 |
| No log        | 3.0588  | 104  | 0.7380          | 0.4409  | 0.7380 | 0.8591 |
| No log        | 3.1176  | 106  | 0.6812          | 0.4167  | 0.6812 | 0.8253 |
| No log        | 3.1765  | 108  | 0.6351          | 0.4617  | 0.6351 | 0.7969 |
| No log        | 3.2353  | 110  | 0.6972          | 0.5200  | 0.6972 | 0.8350 |
| No log        | 3.2941  | 112  | 0.8106          | 0.4724  | 0.8106 | 0.9003 |
| No log        | 3.3529  | 114  | 0.8025          | 0.4596  | 0.8025 | 0.8958 |
| No log        | 3.4118  | 116  | 0.7718          | 0.3760  | 0.7718 | 0.8785 |
| No log        | 3.4706  | 118  | 0.7436          | 0.3710  | 0.7436 | 0.8623 |
| No log        | 3.5294  | 120  | 0.7155          | 0.4036  | 0.7155 | 0.8458 |
| No log        | 3.5882  | 122  | 0.6147          | 0.4516  | 0.6147 | 0.7840 |
| No log        | 3.6471  | 124  | 0.6805          | 0.4373  | 0.6805 | 0.8249 |
| No log        | 3.7059  | 126  | 0.6564          | 0.4373  | 0.6564 | 0.8102 |
| No log        | 3.7647  | 128  | 0.6117          | 0.4398  | 0.6117 | 0.7821 |
| No log        | 3.8235  | 130  | 0.7010          | 0.4335  | 0.7010 | 0.8373 |
| No log        | 3.8824  | 132  | 0.7199          | 0.3976  | 0.7199 | 0.8485 |
| No log        | 3.9412  | 134  | 0.6022          | 0.4753  | 0.6022 | 0.7760 |
| No log        | 4.0     | 136  | 0.6192          | 0.4783  | 0.6192 | 0.7869 |
| No log        | 4.0588  | 138  | 0.6277          | 0.4800  | 0.6277 | 0.7923 |
| No log        | 4.1176  | 140  | 0.6009          | 0.4824  | 0.6009 | 0.7752 |
| No log        | 4.1765  | 142  | 0.6273          | 0.4315  | 0.6273 | 0.7920 |
| No log        | 4.2353  | 144  | 0.6565          | 0.5235  | 0.6565 | 0.8103 |
| No log        | 4.2941  | 146  | 0.6621          | 0.5355  | 0.6621 | 0.8137 |
| No log        | 4.3529  | 148  | 0.6602          | 0.5103  | 0.6602 | 0.8125 |
| No log        | 4.4118  | 150  | 0.6367          | 0.5070  | 0.6367 | 0.7980 |
| No log        | 4.4706  | 152  | 0.5829          | 0.4806  | 0.5829 | 0.7635 |
| No log        | 4.5294  | 154  | 0.5611          | 0.4444  | 0.5611 | 0.7491 |
| No log        | 4.5882  | 156  | 0.5572          | 0.4681  | 0.5572 | 0.7465 |
| No log        | 4.6471  | 158  | 0.5585          | 0.4419  | 0.5585 | 0.7473 |
| No log        | 4.7059  | 160  | 0.5700          | 0.4206  | 0.5700 | 0.7550 |
| No log        | 4.7647  | 162  | 0.5814          | 0.4206  | 0.5814 | 0.7625 |
| No log        | 4.8235  | 164  | 0.5931          | 0.4459  | 0.5931 | 0.7701 |
| No log        | 4.8824  | 166  | 0.6112          | 0.4100  | 0.6112 | 0.7818 |
| No log        | 4.9412  | 168  | 0.6896          | 0.4582  | 0.6896 | 0.8304 |
| No log        | 5.0     | 170  | 0.6729          | 0.4602  | 0.6729 | 0.8203 |
| No log        | 5.0588  | 172  | 0.6247          | 0.4721  | 0.6247 | 0.7903 |
| No log        | 5.1176  | 174  | 0.6366          | 0.4721  | 0.6366 | 0.7979 |
| No log        | 5.1765  | 176  | 0.6104          | 0.4724  | 0.6104 | 0.7813 |
| No log        | 5.2353  | 178  | 0.5879          | 0.4493  | 0.5879 | 0.7667 |
| No log        | 5.2941  | 180  | 0.5843          | 0.4493  | 0.5843 | 0.7644 |
| No log        | 5.3529  | 182  | 0.5684          | 0.4828  | 0.5684 | 0.7539 |
| No log        | 5.4118  | 184  | 0.5708          | 0.4234  | 0.5708 | 0.7555 |
| No log        | 5.4706  | 186  | 0.5672          | 0.4234  | 0.5672 | 0.7531 |
| No log        | 5.5294  | 188  | 0.5978          | 0.3918  | 0.5978 | 0.7732 |
| No log        | 5.5882  | 190  | 0.5818          | 0.4190  | 0.5818 | 0.7628 |
| No log        | 5.6471  | 192  | 0.6076          | 0.4190  | 0.6076 | 0.7795 |
| No log        | 5.7059  | 194  | 0.5857          | 0.4081  | 0.5857 | 0.7653 |
| No log        | 5.7647  | 196  | 0.5654          | 0.5725  | 0.5654 | 0.7519 |
| No log        | 5.8235  | 198  | 0.6279          | 0.5471  | 0.6279 | 0.7924 |
| No log        | 5.8824  | 200  | 0.6149          | 0.5471  | 0.6149 | 0.7841 |
| No log        | 5.9412  | 202  | 0.5667          | 0.5434  | 0.5667 | 0.7528 |
| No log        | 6.0     | 204  | 0.7536          | 0.4933  | 0.7536 | 0.8681 |
| No log        | 6.0588  | 206  | 0.8128          | 0.4275  | 0.8128 | 0.9016 |
| No log        | 6.1176  | 208  | 0.6205          | 0.4007  | 0.6205 | 0.7877 |
| No log        | 6.1765  | 210  | 0.5864          | 0.5246  | 0.5864 | 0.7658 |
| No log        | 6.2353  | 212  | 0.6043          | 0.3315  | 0.6043 | 0.7774 |
| No log        | 6.2941  | 214  | 0.5710          | 0.5114  | 0.5710 | 0.7556 |
| No log        | 6.3529  | 216  | 0.5511          | 0.4493  | 0.5511 | 0.7424 |
| No log        | 6.4118  | 218  | 0.5241          | 0.5488  | 0.5241 | 0.7239 |
| No log        | 6.4706  | 220  | 0.5634          | 0.5621  | 0.5634 | 0.7506 |
| No log        | 6.5294  | 222  | 0.5582          | 0.5268  | 0.5582 | 0.7471 |
| No log        | 6.5882  | 224  | 0.5228          | 0.5604  | 0.5228 | 0.7230 |
| No log        | 6.6471  | 226  | 0.5379          | 0.5619  | 0.5379 | 0.7334 |
| No log        | 6.7059  | 228  | 0.5784          | 0.5317  | 0.5784 | 0.7605 |
| No log        | 6.7647  | 230  | 0.5748          | 0.5320  | 0.5748 | 0.7582 |
| No log        | 6.8235  | 232  | 0.5838          | 0.4740  | 0.5838 | 0.7641 |
| No log        | 6.8824  | 234  | 0.5896          | 0.4542  | 0.5896 | 0.7679 |
| No log        | 6.9412  | 236  | 0.5545          | 0.5517  | 0.5545 | 0.7447 |
| No log        | 7.0     | 238  | 0.6215          | 0.4290  | 0.6215 | 0.7883 |
| No log        | 7.0588  | 240  | 0.7020          | 0.4297  | 0.7020 | 0.8379 |
| No log        | 7.1176  | 242  | 0.6570          | 0.4396  | 0.6570 | 0.8106 |
| No log        | 7.1765  | 244  | 0.6034          | 0.4789  | 0.6034 | 0.7768 |
| No log        | 7.2353  | 246  | 0.5493          | 0.4984  | 0.5493 | 0.7411 |
| No log        | 7.2941  | 248  | 0.5618          | 0.5104  | 0.5618 | 0.7495 |
| No log        | 7.3529  | 250  | 0.5559          | 0.5159  | 0.5559 | 0.7456 |
| No log        | 7.4118  | 252  | 0.6408          | 0.4616  | 0.6408 | 0.8005 |
| No log        | 7.4706  | 254  | 0.7428          | 0.4051  | 0.7428 | 0.8619 |
| No log        | 7.5294  | 256  | 0.6728          | 0.4670  | 0.6728 | 0.8203 |
| No log        | 7.5882  | 258  | 0.5854          | 0.5517  | 0.5854 | 0.7651 |
| No log        | 7.6471  | 260  | 0.6560          | 0.4165  | 0.6560 | 0.8099 |
| No log        | 7.7059  | 262  | 0.6652          | 0.4218  | 0.6652 | 0.8156 |
| No log        | 7.7647  | 264  | 0.6060          | 0.4948  | 0.6060 | 0.7785 |
| No log        | 7.8235  | 266  | 0.6666          | 0.4923  | 0.6666 | 0.8164 |
| No log        | 7.8824  | 268  | 0.7125          | 0.4654  | 0.7125 | 0.8441 |
| No log        | 7.9412  | 270  | 0.6442          | 0.4906  | 0.6442 | 0.8026 |
| No log        | 8.0     | 272  | 0.5941          | 0.5304  | 0.5941 | 0.7708 |
| No log        | 8.0588  | 274  | 0.5871          | 0.5647  | 0.5871 | 0.7662 |
| No log        | 8.1176  | 276  | 0.5849          | 0.5101  | 0.5849 | 0.7648 |
| No log        | 8.1765  | 278  | 0.6013          | 0.4599  | 0.6013 | 0.7755 |
| No log        | 8.2353  | 280  | 0.6155          | 0.4599  | 0.6155 | 0.7845 |
| No log        | 8.2941  | 282  | 0.5934          | 0.4757  | 0.5934 | 0.7704 |
| No log        | 8.3529  | 284  | 0.6061          | 0.4769  | 0.6061 | 0.7785 |
| No log        | 8.4118  | 286  | 0.6114          | 0.4769  | 0.6114 | 0.7819 |
| No log        | 8.4706  | 288  | 0.6171          | 0.4769  | 0.6171 | 0.7856 |
| No log        | 8.5294  | 290  | 0.6024          | 0.5056  | 0.6024 | 0.7761 |
| No log        | 8.5882  | 292  | 0.5979          | 0.5056  | 0.5979 | 0.7733 |
| No log        | 8.6471  | 294  | 0.6127          | 0.5016  | 0.6127 | 0.7828 |
| No log        | 8.7059  | 296  | 0.6414          | 0.4782  | 0.6414 | 0.8009 |
| No log        | 8.7647  | 298  | 0.6262          | 0.5254  | 0.6262 | 0.7913 |
| No log        | 8.8235  | 300  | 0.6069          | 0.4806  | 0.6069 | 0.7791 |
| No log        | 8.8824  | 302  | 0.6074          | 0.4710  | 0.6074 | 0.7794 |
| No log        | 8.9412  | 304  | 0.5739          | 0.4883  | 0.5739 | 0.7576 |
| No log        | 9.0     | 306  | 0.5577          | 0.5437  | 0.5577 | 0.7468 |
| No log        | 9.0588  | 308  | 0.5678          | 0.5086  | 0.5678 | 0.7535 |
| No log        | 9.1176  | 310  | 0.5444          | 0.5703  | 0.5444 | 0.7378 |
| No log        | 9.1765  | 312  | 0.5494          | 0.5009  | 0.5494 | 0.7412 |
| No log        | 9.2353  | 314  | 0.5546          | 0.5352  | 0.5546 | 0.7447 |
| No log        | 9.2941  | 316  | 0.5754          | 0.4729  | 0.5754 | 0.7586 |
| No log        | 9.3529  | 318  | 0.5640          | 0.4789  | 0.5640 | 0.7510 |
| No log        | 9.4118  | 320  | 0.5351          | 0.5751  | 0.5351 | 0.7315 |
| No log        | 9.4706  | 322  | 0.5284          | 0.5768  | 0.5284 | 0.7269 |
| No log        | 9.5294  | 324  | 0.5428          | 0.5831  | 0.5428 | 0.7368 |
| No log        | 9.5882  | 326  | 0.5303          | 0.5492  | 0.5303 | 0.7282 |
| No log        | 9.6471  | 328  | 0.5565          | 0.5442  | 0.5565 | 0.7460 |
| No log        | 9.7059  | 330  | 0.5695          | 0.5378  | 0.5695 | 0.7547 |
| No log        | 9.7647  | 332  | 0.5468          | 0.5781  | 0.5468 | 0.7394 |
| No log        | 9.8235  | 334  | 0.5475          | 0.6018  | 0.5475 | 0.7399 |
| No log        | 9.8824  | 336  | 0.6630          | 0.5107  | 0.6630 | 0.8142 |
| No log        | 9.9412  | 338  | 0.6480          | 0.5042  | 0.6480 | 0.8050 |
| No log        | 10.0    | 340  | 0.5901          | 0.5206  | 0.5901 | 0.7682 |
| No log        | 10.0588 | 342  | 0.5408          | 0.5135  | 0.5408 | 0.7354 |
| No log        | 10.1176 | 344  | 0.5698          | 0.5710  | 0.5698 | 0.7548 |
| No log        | 10.1765 | 346  | 0.5555          | 0.5368  | 0.5555 | 0.7453 |
| No log        | 10.2353 | 348  | 0.5547          | 0.5501  | 0.5547 | 0.7448 |
| No log        | 10.2941 | 350  | 0.5862          | 0.4845  | 0.5862 | 0.7657 |
| No log        | 10.3529 | 352  | 0.5793          | 0.4929  | 0.5793 | 0.7611 |
| No log        | 10.4118 | 354  | 0.5499          | 0.4953  | 0.5499 | 0.7415 |
| No log        | 10.4706 | 356  | 0.5578          | 0.5368  | 0.5578 | 0.7468 |
| No log        | 10.5294 | 358  | 0.5847          | 0.5538  | 0.5847 | 0.7647 |
| No log        | 10.5882 | 360  | 0.6027          | 0.5471  | 0.6027 | 0.7764 |
| No log        | 10.6471 | 362  | 0.5754          | 0.5120  | 0.5754 | 0.7586 |
| No log        | 10.7059 | 364  | 0.5464          | 0.5076  | 0.5464 | 0.7392 |
| No log        | 10.7647 | 366  | 0.5678          | 0.4684  | 0.5678 | 0.7536 |
| No log        | 10.8235 | 368  | 0.5458          | 0.5307  | 0.5458 | 0.7388 |
| No log        | 10.8824 | 370  | 0.5341          | 0.5286  | 0.5341 | 0.7308 |
| No log        | 10.9412 | 372  | 0.5634          | 0.5190  | 0.5634 | 0.7506 |
| No log        | 11.0    | 374  | 0.5429          | 0.4883  | 0.5429 | 0.7368 |
| No log        | 11.0588 | 376  | 0.5146          | 0.4768  | 0.5146 | 0.7173 |
| No log        | 11.1176 | 378  | 0.5109          | 0.5076  | 0.5109 | 0.7148 |
| No log        | 11.1765 | 380  | 0.5267          | 0.4795  | 0.5267 | 0.7258 |
| No log        | 11.2353 | 382  | 0.5207          | 0.4768  | 0.5207 | 0.7216 |
| No log        | 11.2941 | 384  | 0.5235          | 0.4768  | 0.5235 | 0.7235 |
| No log        | 11.3529 | 386  | 0.5249          | 0.5326  | 0.5249 | 0.7245 |
| No log        | 11.4118 | 388  | 0.5177          | 0.5022  | 0.5177 | 0.7195 |
| No log        | 11.4706 | 390  | 0.5226          | 0.5326  | 0.5226 | 0.7229 |
| No log        | 11.5294 | 392  | 0.5491          | 0.4795  | 0.5491 | 0.7410 |
| No log        | 11.5882 | 394  | 0.5526          | 0.5017  | 0.5526 | 0.7433 |
| No log        | 11.6471 | 396  | 0.5257          | 0.4774  | 0.5257 | 0.7251 |
| No log        | 11.7059 | 398  | 0.4904          | 0.5056  | 0.4904 | 0.7003 |
| No log        | 11.7647 | 400  | 0.4706          | 0.5800  | 0.4706 | 0.6860 |
| No log        | 11.8235 | 402  | 0.4673          | 0.5326  | 0.4673 | 0.6836 |
| No log        | 11.8824 | 404  | 0.4952          | 0.4774  | 0.4952 | 0.7037 |
| No log        | 11.9412 | 406  | 0.5513          | 0.4597  | 0.5513 | 0.7425 |
| No log        | 12.0    | 408  | 0.5970          | 0.4597  | 0.5970 | 0.7727 |
| No log        | 12.0588 | 410  | 0.5809          | 0.5017  | 0.5809 | 0.7621 |
| No log        | 12.1176 | 412  | 0.5211          | 0.5195  | 0.5211 | 0.7219 |
| No log        | 12.1765 | 414  | 0.5010          | 0.5550  | 0.5010 | 0.7078 |
| No log        | 12.2353 | 416  | 0.5514          | 0.4517  | 0.5514 | 0.7426 |
| No log        | 12.2941 | 418  | 0.5688          | 0.3902  | 0.5688 | 0.7542 |
| No log        | 12.3529 | 420  | 0.5322          | 0.4338  | 0.5322 | 0.7295 |
| No log        | 12.4118 | 422  | 0.5348          | 0.5131  | 0.5348 | 0.7313 |
| No log        | 12.4706 | 424  | 0.5742          | 0.5017  | 0.5742 | 0.7578 |
| No log        | 12.5294 | 426  | 0.5624          | 0.5017  | 0.5624 | 0.7499 |
| No log        | 12.5882 | 428  | 0.5152          | 0.5195  | 0.5152 | 0.7178 |
| No log        | 12.6471 | 430  | 0.5137          | 0.5357  | 0.5137 | 0.7167 |
| No log        | 12.7059 | 432  | 0.5624          | 0.5538  | 0.5624 | 0.7499 |
| No log        | 12.7647 | 434  | 0.5513          | 0.5738  | 0.5513 | 0.7425 |
| No log        | 12.8235 | 436  | 0.4995          | 0.5722  | 0.4995 | 0.7067 |
| No log        | 12.8824 | 438  | 0.4884          | 0.5753  | 0.4884 | 0.6989 |
| No log        | 12.9412 | 440  | 0.4915          | 0.5609  | 0.4915 | 0.7010 |
| No log        | 13.0    | 442  | 0.5176          | 0.5016  | 0.5176 | 0.7194 |
| No log        | 13.0588 | 444  | 0.5070          | 0.5289  | 0.5070 | 0.7121 |
| No log        | 13.1176 | 446  | 0.4876          | 0.5567  | 0.4876 | 0.6983 |
| No log        | 13.1765 | 448  | 0.4970          | 0.5475  | 0.4970 | 0.7050 |
| No log        | 13.2353 | 450  | 0.4982          | 0.4991  | 0.4982 | 0.7058 |
| No log        | 13.2941 | 452  | 0.4915          | 0.5195  | 0.4915 | 0.7011 |
| No log        | 13.3529 | 454  | 0.4967          | 0.5125  | 0.4967 | 0.7047 |
| No log        | 13.4118 | 456  | 0.5425          | 0.5457  | 0.5425 | 0.7366 |
| No log        | 13.4706 | 458  | 0.5632          | 0.5269  | 0.5632 | 0.7505 |
| No log        | 13.5294 | 460  | 0.5411          | 0.5368  | 0.5411 | 0.7356 |
| No log        | 13.5882 | 462  | 0.5304          | 0.4885  | 0.5304 | 0.7283 |
| No log        | 13.6471 | 464  | 0.5755          | 0.4774  | 0.5755 | 0.7586 |
| No log        | 13.7059 | 466  | 0.5916          | 0.4774  | 0.5916 | 0.7692 |
| No log        | 13.7647 | 468  | 0.5605          | 0.4774  | 0.5605 | 0.7487 |
| No log        | 13.8235 | 470  | 0.5406          | 0.5379  | 0.5406 | 0.7352 |
| No log        | 13.8824 | 472  | 0.5376          | 0.4885  | 0.5376 | 0.7332 |
| No log        | 13.9412 | 474  | 0.5416          | 0.5625  | 0.5416 | 0.7359 |
| No log        | 14.0    | 476  | 0.5454          | 0.5379  | 0.5454 | 0.7385 |
| No log        | 14.0588 | 478  | 0.5529          | 0.5289  | 0.5529 | 0.7436 |
| No log        | 14.1176 | 480  | 0.5407          | 0.5036  | 0.5407 | 0.7353 |
| No log        | 14.1765 | 482  | 0.5208          | 0.5326  | 0.5208 | 0.7216 |
| No log        | 14.2353 | 484  | 0.5231          | 0.4701  | 0.5231 | 0.7233 |
| No log        | 14.2941 | 486  | 0.5296          | 0.4768  | 0.5296 | 0.7277 |
| No log        | 14.3529 | 488  | 0.5481          | 0.4614  | 0.5481 | 0.7403 |
| No log        | 14.4118 | 490  | 0.5702          | 0.4774  | 0.5702 | 0.7551 |
| No log        | 14.4706 | 492  | 0.5599          | 0.4774  | 0.5599 | 0.7482 |
| No log        | 14.5294 | 494  | 0.5421          | 0.5307  | 0.5421 | 0.7362 |
| No log        | 14.5882 | 496  | 0.5339          | 0.4885  | 0.5339 | 0.7307 |
| No log        | 14.6471 | 498  | 0.5454          | 0.5383  | 0.5454 | 0.7385 |
| 0.2859        | 14.7059 | 500  | 0.5414          | 0.5383  | 0.5414 | 0.7358 |
| 0.2859        | 14.7647 | 502  | 0.5341          | 0.5301  | 0.5341 | 0.7309 |
| 0.2859        | 14.8235 | 504  | 0.5263          | 0.5549  | 0.5263 | 0.7255 |
| 0.2859        | 14.8824 | 506  | 0.5608          | 0.4964  | 0.5608 | 0.7488 |
| 0.2859        | 14.9412 | 508  | 0.5601          | 0.4724  | 0.5601 | 0.7484 |
| 0.2859        | 15.0    | 510  | 0.5358          | 0.5692  | 0.5358 | 0.7320 |
| 0.2859        | 15.0588 | 512  | 0.5413          | 0.5301  | 0.5413 | 0.7357 |
| 0.2859        | 15.1176 | 514  | 0.5596          | 0.5592  | 0.5596 | 0.7481 |
| 0.2859        | 15.1765 | 516  | 0.5735          | 0.5414  | 0.5735 | 0.7573 |
| 0.2859        | 15.2353 | 518  | 0.5292          | 0.5026  | 0.5292 | 0.7275 |
| 0.2859        | 15.2941 | 520  | 0.5117          | 0.5056  | 0.5117 | 0.7153 |
| 0.2859        | 15.3529 | 522  | 0.5380          | 0.4867  | 0.5380 | 0.7335 |
| 0.2859        | 15.4118 | 524  | 0.5408          | 0.4774  | 0.5408 | 0.7354 |
| 0.2859        | 15.4706 | 526  | 0.5192          | 0.4774  | 0.5192 | 0.7206 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1