File size: 42,092 Bytes
cbe054a
5a27a9e
 
cbe054a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5a27a9e
cbe054a
5a27a9e
 
 
 
 
cbe054a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5a27a9e
cbe054a
 
 
 
 
5a27a9e
cbe054a
 
 
 
 
5a27a9e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
cbe054a
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
---
license: apache-2.0
base_model: SZTAKI-HLT/hubert-base-cc
tags:
- generated_from_trainer
metrics:
- precision
- recall
- f1
- accuracy
model-index:
- name: kmdb_ner_model
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# kmdb_ner_model

This model is a fine-tuned version of [SZTAKI-HLT/hubert-base-cc](https://huggingface.co/SZTAKI-HLT/hubert-base-cc) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0324
- Precision: 0.8534
- Recall: 0.8663
- F1: 0.8598
- Accuracy: 0.9888

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 4

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Precision | Recall | F1     | Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
| 0.1602        | 0.01  | 100   | 0.1829          | 0.3243    | 0.4688 | 0.3834 | 0.9394   |
| 0.0987        | 0.02  | 200   | 0.0950          | 0.4735    | 0.5440 | 0.5063 | 0.9645   |
| 0.0798        | 0.03  | 300   | 0.0797          | 0.5444    | 0.6213 | 0.5804 | 0.9700   |
| 0.0621        | 0.04  | 400   | 0.0721          | 0.6397    | 0.6657 | 0.6524 | 0.9702   |
| 0.0755        | 0.05  | 500   | 0.0754          | 0.3976    | 0.5034 | 0.4443 | 0.9685   |
| 0.0652        | 0.05  | 600   | 0.0756          | 0.4717    | 0.5575 | 0.5110 | 0.9666   |
| 0.0469        | 0.06  | 700   | 0.0753          | 0.6274    | 0.6476 | 0.6373 | 0.9705   |
| 0.0611        | 0.07  | 800   | 0.0650          | 0.6423    | 0.6597 | 0.6509 | 0.9715   |
| 0.0683        | 0.08  | 900   | 0.0664          | 0.5837    | 0.6236 | 0.6030 | 0.9712   |
| 0.0465        | 0.09  | 1000  | 0.0654          | 0.6410    | 0.6559 | 0.6483 | 0.9711   |
| 0.0668        | 0.1   | 1100  | 0.0648          | 0.6061    | 0.6521 | 0.6283 | 0.9713   |
| 0.0561        | 0.11  | 1200  | 0.0667          | 0.4814    | 0.5733 | 0.5233 | 0.9717   |
| 0.049         | 0.12  | 1300  | 0.0612          | 0.6627    | 0.7160 | 0.6883 | 0.9761   |
| 0.0619        | 0.13  | 1400  | 0.0602          | 0.6138    | 0.6461 | 0.6296 | 0.9712   |
| 0.0362        | 0.14  | 1500  | 0.0580          | 0.7041    | 0.7258 | 0.7148 | 0.9769   |
| 0.0503        | 0.15  | 1600  | 0.0575          | 0.5589    | 0.6311 | 0.5928 | 0.9752   |
| 0.0521        | 0.16  | 1700  | 0.0594          | 0.5843    | 0.6356 | 0.6089 | 0.9737   |
| 0.0537        | 0.16  | 1800  | 0.0602          | 0.6281    | 0.6814 | 0.6537 | 0.9758   |
| 0.0439        | 0.17  | 1900  | 0.0538          | 0.6605    | 0.7280 | 0.6926 | 0.9790   |
| 0.0376        | 0.18  | 2000  | 0.0553          | 0.7142    | 0.7303 | 0.7221 | 0.9779   |
| 0.0421        | 0.19  | 2100  | 0.0554          | 0.6985    | 0.7258 | 0.7119 | 0.9780   |
| 0.0387        | 0.2   | 2200  | 0.0560          | 0.7076    | 0.7145 | 0.7110 | 0.9775   |
| 0.0548        | 0.21  | 2300  | 0.0559          | 0.5948    | 0.6551 | 0.6235 | 0.9753   |
| 0.0502        | 0.22  | 2400  | 0.0555          | 0.6095    | 0.6860 | 0.6455 | 0.9768   |
| 0.0461        | 0.23  | 2500  | 0.0510          | 0.6838    | 0.7100 | 0.6966 | 0.9783   |
| 0.0482        | 0.24  | 2600  | 0.0559          | 0.6608    | 0.7010 | 0.6803 | 0.9771   |
| 0.0647        | 0.25  | 2700  | 0.0478          | 0.6293    | 0.7130 | 0.6685 | 0.9797   |
| 0.0587        | 0.26  | 2800  | 0.0516          | 0.6861    | 0.7175 | 0.7014 | 0.9775   |
| 0.0618        | 0.27  | 2900  | 0.0566          | 0.6164    | 0.7040 | 0.6573 | 0.9776   |
| 0.0418        | 0.27  | 3000  | 0.0622          | 0.6069    | 0.6694 | 0.6367 | 0.9714   |
| 0.0401        | 0.28  | 3100  | 0.0493          | 0.6623    | 0.7205 | 0.6902 | 0.9780   |
| 0.0488        | 0.29  | 3200  | 0.0531          | 0.6982    | 0.7423 | 0.7196 | 0.9785   |
| 0.0396        | 0.3   | 3300  | 0.0505          | 0.6872    | 0.7393 | 0.7123 | 0.9795   |
| 0.0475        | 0.31  | 3400  | 0.0521          | 0.7220    | 0.7415 | 0.7317 | 0.9789   |
| 0.0455        | 0.32  | 3500  | 0.0566          | 0.5941    | 0.6664 | 0.6282 | 0.9766   |
| 0.0411        | 0.33  | 3600  | 0.0478          | 0.6477    | 0.7100 | 0.6774 | 0.9791   |
| 0.0582        | 0.34  | 3700  | 0.0548          | 0.6767    | 0.7092 | 0.6926 | 0.9759   |
| 0.066         | 0.35  | 3800  | 0.0523          | 0.6894    | 0.7355 | 0.7117 | 0.9775   |
| 0.0309        | 0.36  | 3900  | 0.0472          | 0.6868    | 0.7348 | 0.7100 | 0.9800   |
| 0.0562        | 0.37  | 4000  | 0.0492          | 0.6776    | 0.7265 | 0.7012 | 0.9782   |
| 0.0419        | 0.38  | 4100  | 0.0535          | 0.6655    | 0.7130 | 0.6884 | 0.9778   |
| 0.0459        | 0.38  | 4200  | 0.0433          | 0.6897    | 0.7431 | 0.7154 | 0.9808   |
| 0.047         | 0.39  | 4300  | 0.0481          | 0.6817    | 0.7273 | 0.7037 | 0.9794   |
| 0.0527        | 0.4   | 4400  | 0.0496          | 0.6165    | 0.6980 | 0.6547 | 0.9788   |
| 0.0427        | 0.41  | 4500  | 0.0458          | 0.6577    | 0.7175 | 0.6863 | 0.9792   |
| 0.0597        | 0.42  | 4600  | 0.0446          | 0.7123    | 0.7385 | 0.7252 | 0.9789   |
| 0.0457        | 0.43  | 4700  | 0.0491          | 0.6816    | 0.7303 | 0.7051 | 0.9795   |
| 0.0439        | 0.44  | 4800  | 0.0483          | 0.6987    | 0.7438 | 0.7205 | 0.9785   |
| 0.0488        | 0.45  | 4900  | 0.0495          | 0.6920    | 0.7393 | 0.7149 | 0.9804   |
| 0.0401        | 0.46  | 5000  | 0.0476          | 0.7116    | 0.7415 | 0.7263 | 0.9790   |
| 0.0432        | 0.47  | 5100  | 0.0490          | 0.6914    | 0.7220 | 0.7064 | 0.9796   |
| 0.0572        | 0.48  | 5200  | 0.0459          | 0.6770    | 0.7528 | 0.7129 | 0.9811   |
| 0.0496        | 0.48  | 5300  | 0.0536          | 0.7123    | 0.7461 | 0.7288 | 0.9781   |
| 0.0547        | 0.49  | 5400  | 0.0532          | 0.6403    | 0.6942 | 0.6662 | 0.9747   |
| 0.0509        | 0.5   | 5500  | 0.0499          | 0.6758    | 0.7378 | 0.7055 | 0.9796   |
| 0.0531        | 0.51  | 5600  | 0.0460          | 0.6980    | 0.7521 | 0.7241 | 0.9813   |
| 0.0611        | 0.52  | 5700  | 0.0466          | 0.644     | 0.7258 | 0.6824 | 0.9804   |
| 0.0487        | 0.53  | 5800  | 0.0465          | 0.6978    | 0.7513 | 0.7236 | 0.9805   |
| 0.0339        | 0.54  | 5900  | 0.0489          | 0.7001    | 0.7453 | 0.7220 | 0.9801   |
| 0.04          | 0.55  | 6000  | 0.0475          | 0.6674    | 0.7250 | 0.6950 | 0.9809   |
| 0.0571        | 0.56  | 6100  | 0.0495          | 0.6787    | 0.7363 | 0.7063 | 0.9806   |
| 0.0469        | 0.57  | 6200  | 0.0471          | 0.7212    | 0.7423 | 0.7316 | 0.9788   |
| 0.0371        | 0.58  | 6300  | 0.0531          | 0.5764    | 0.6521 | 0.6119 | 0.9774   |
| 0.0469        | 0.59  | 6400  | 0.0485          | 0.7135    | 0.7483 | 0.7305 | 0.9789   |
| 0.0388        | 0.59  | 6500  | 0.0480          | 0.7370    | 0.7370 | 0.7370 | 0.9788   |
| 0.045         | 0.6   | 6600  | 0.0455          | 0.6893    | 0.7385 | 0.7131 | 0.9813   |
| 0.0456        | 0.61  | 6700  | 0.0530          | 0.6611    | 0.6829 | 0.6718 | 0.9744   |
| 0.0485        | 0.62  | 6800  | 0.0499          | 0.6855    | 0.7400 | 0.7117 | 0.9797   |
| 0.0383        | 0.63  | 6900  | 0.0467          | 0.7344    | 0.7603 | 0.7471 | 0.9814   |
| 0.0424        | 0.64  | 7000  | 0.0445          | 0.7104    | 0.7573 | 0.7331 | 0.9818   |
| 0.0391        | 0.65  | 7100  | 0.0430          | 0.7576    | 0.7844 | 0.7708 | 0.9823   |
| 0.0563        | 0.66  | 7200  | 0.0437          | 0.7536    | 0.7791 | 0.7662 | 0.9834   |
| 0.0509        | 0.67  | 7300  | 0.0442          | 0.7424    | 0.7663 | 0.7542 | 0.9815   |
| 0.0441        | 0.68  | 7400  | 0.0459          | 0.7101    | 0.7378 | 0.7237 | 0.9797   |
| 0.0387        | 0.69  | 7500  | 0.0436          | 0.7395    | 0.7528 | 0.7461 | 0.9808   |
| 0.0397        | 0.7   | 7600  | 0.0450          | 0.7437    | 0.7588 | 0.7512 | 0.9810   |
| 0.0387        | 0.7   | 7700  | 0.0421          | 0.7436    | 0.7693 | 0.7563 | 0.9817   |
| 0.0425        | 0.71  | 7800  | 0.0438          | 0.7321    | 0.7761 | 0.7535 | 0.9812   |
| 0.0361        | 0.72  | 7900  | 0.0463          | 0.7412    | 0.7769 | 0.7586 | 0.9805   |
| 0.0405        | 0.73  | 8000  | 0.0449          | 0.7603    | 0.7866 | 0.7733 | 0.9825   |
| 0.0418        | 0.74  | 8100  | 0.0419          | 0.7681    | 0.7986 | 0.7831 | 0.9836   |
| 0.0333        | 0.75  | 8200  | 0.0437          | 0.7302    | 0.7603 | 0.7449 | 0.9809   |
| 0.0376        | 0.76  | 8300  | 0.0419          | 0.7600    | 0.7874 | 0.7734 | 0.9830   |
| 0.0381        | 0.77  | 8400  | 0.0442          | 0.7455    | 0.7701 | 0.7576 | 0.9804   |
| 0.0355        | 0.78  | 8500  | 0.0434          | 0.7390    | 0.7829 | 0.7603 | 0.9825   |
| 0.0431        | 0.79  | 8600  | 0.0486          | 0.6938    | 0.7288 | 0.7109 | 0.9791   |
| 0.0399        | 0.8   | 8700  | 0.0502          | 0.7317    | 0.7724 | 0.7515 | 0.9798   |
| 0.0533        | 0.8   | 8800  | 0.0441          | 0.7194    | 0.7588 | 0.7386 | 0.9811   |
| 0.0336        | 0.81  | 8900  | 0.0433          | 0.6454    | 0.7288 | 0.6845 | 0.9803   |
| 0.0527        | 0.82  | 9000  | 0.0449          | 0.75      | 0.7754 | 0.7625 | 0.9823   |
| 0.0384        | 0.83  | 9100  | 0.0438          | 0.7124    | 0.7573 | 0.7342 | 0.9808   |
| 0.0362        | 0.84  | 9200  | 0.0442          | 0.7200    | 0.7536 | 0.7364 | 0.9818   |
| 0.0446        | 0.85  | 9300  | 0.0497          | 0.6768    | 0.7220 | 0.6987 | 0.9778   |
| 0.0394        | 0.86  | 9400  | 0.0436          | 0.7268    | 0.7536 | 0.7399 | 0.9805   |
| 0.0467        | 0.87  | 9500  | 0.0464          | 0.7246    | 0.7393 | 0.7319 | 0.9790   |
| 0.0513        | 0.88  | 9600  | 0.0431          | 0.7207    | 0.7656 | 0.7424 | 0.9816   |
| 0.0498        | 0.89  | 9700  | 0.0418          | 0.7184    | 0.7724 | 0.7444 | 0.9816   |
| 0.0323        | 0.9   | 9800  | 0.0445          | 0.7014    | 0.7483 | 0.7241 | 0.9807   |
| 0.0353        | 0.91  | 9900  | 0.0436          | 0.75      | 0.7799 | 0.7646 | 0.9824   |
| 0.0404        | 0.91  | 10000 | 0.0439          | 0.7415    | 0.7693 | 0.7552 | 0.9803   |
| 0.0404        | 0.92  | 10100 | 0.0438          | 0.7300    | 0.7596 | 0.7445 | 0.9811   |
| 0.0355        | 0.93  | 10200 | 0.0423          | 0.7420    | 0.7866 | 0.7637 | 0.9824   |
| 0.0423        | 0.94  | 10300 | 0.0443          | 0.7292    | 0.7686 | 0.7484 | 0.9804   |
| 0.0376        | 0.95  | 10400 | 0.0444          | 0.7468    | 0.7844 | 0.7651 | 0.9827   |
| 0.0351        | 0.96  | 10500 | 0.0395          | 0.7373    | 0.7761 | 0.7562 | 0.9827   |
| 0.0264        | 0.97  | 10600 | 0.0429          | 0.7487    | 0.7836 | 0.7658 | 0.9814   |
| 0.0368        | 0.98  | 10700 | 0.0420          | 0.6840    | 0.7415 | 0.7116 | 0.9811   |
| 0.0318        | 0.99  | 10800 | 0.0399          | 0.7599    | 0.7754 | 0.7676 | 0.9830   |
| 0.0501        | 1.0   | 10900 | 0.0389          | 0.7393    | 0.7776 | 0.7580 | 0.9823   |
| 0.0309        | 1.01  | 11000 | 0.0419          | 0.7307    | 0.7806 | 0.7548 | 0.9834   |
| 0.0402        | 1.02  | 11100 | 0.0378          | 0.7649    | 0.8092 | 0.7864 | 0.9845   |
| 0.0417        | 1.02  | 11200 | 0.0404          | 0.7570    | 0.7889 | 0.7726 | 0.9837   |
| 0.031         | 1.03  | 11300 | 0.0402          | 0.7428    | 0.7746 | 0.7584 | 0.9819   |
| 0.039         | 1.04  | 11400 | 0.0409          | 0.7460    | 0.7791 | 0.7622 | 0.9822   |
| 0.0245        | 1.05  | 11500 | 0.0425          | 0.744     | 0.7686 | 0.7561 | 0.9816   |
| 0.0341        | 1.06  | 11600 | 0.0392          | 0.7420    | 0.7821 | 0.7615 | 0.9830   |
| 0.0359        | 1.07  | 11700 | 0.0422          | 0.7211    | 0.7633 | 0.7416 | 0.9824   |
| 0.0292        | 1.08  | 11800 | 0.0417          | 0.7457    | 0.7844 | 0.7646 | 0.9829   |
| 0.0427        | 1.09  | 11900 | 0.0380          | 0.7687    | 0.7889 | 0.7786 | 0.9840   |
| 0.0465        | 1.1   | 12000 | 0.0393          | 0.7502    | 0.7739 | 0.7618 | 0.9819   |
| 0.0264        | 1.11  | 12100 | 0.0408          | 0.7417    | 0.7746 | 0.7578 | 0.9823   |
| 0.038         | 1.12  | 12200 | 0.0386          | 0.7737    | 0.7964 | 0.7849 | 0.9839   |
| 0.0383        | 1.13  | 12300 | 0.0439          | 0.7430    | 0.7754 | 0.7588 | 0.9823   |
| 0.0324        | 1.13  | 12400 | 0.0401          | 0.7491    | 0.7851 | 0.7667 | 0.9821   |
| 0.0374        | 1.14  | 12500 | 0.0387          | 0.7836    | 0.7889 | 0.7862 | 0.9834   |
| 0.0314        | 1.15  | 12600 | 0.0410          | 0.7641    | 0.7934 | 0.7785 | 0.9836   |
| 0.0343        | 1.16  | 12700 | 0.0430          | 0.7626    | 0.7866 | 0.7744 | 0.9823   |
| 0.0319        | 1.17  | 12800 | 0.0405          | 0.7450    | 0.7791 | 0.7617 | 0.9830   |
| 0.0367        | 1.18  | 12900 | 0.0447          | 0.7660    | 0.8017 | 0.7834 | 0.9831   |
| 0.0347        | 1.19  | 13000 | 0.0409          | 0.7786    | 0.7979 | 0.7881 | 0.9833   |
| 0.0293        | 1.2   | 13100 | 0.0408          | 0.7686    | 0.8084 | 0.7880 | 0.9839   |
| 0.0288        | 1.21  | 13200 | 0.0406          | 0.7656    | 0.8002 | 0.7825 | 0.9836   |
| 0.0409        | 1.22  | 13300 | 0.0424          | 0.7502    | 0.7896 | 0.7694 | 0.9826   |
| 0.0326        | 1.23  | 13400 | 0.0416          | 0.7952    | 0.8137 | 0.8043 | 0.9843   |
| 0.0381        | 1.23  | 13500 | 0.0406          | 0.7629    | 0.7761 | 0.7695 | 0.9826   |
| 0.0343        | 1.24  | 13600 | 0.1198          | 0.7383    | 0.7926 | 0.7645 | 0.9821   |
| 0.0238        | 1.25  | 13700 | 0.0379          | 0.7778    | 0.7889 | 0.7833 | 0.9835   |
| 0.0333        | 1.26  | 13800 | 0.0400          | 0.7655    | 0.8047 | 0.7846 | 0.9834   |
| 0.0423        | 1.27  | 13900 | 0.0425          | 0.7351    | 0.7671 | 0.7507 | 0.9803   |
| 0.0277        | 1.28  | 14000 | 0.0393          | 0.7766    | 0.8069 | 0.7915 | 0.9837   |
| 0.0363        | 1.29  | 14100 | 0.0416          | 0.7548    | 0.7724 | 0.7635 | 0.9821   |
| 0.0286        | 1.3   | 14200 | 0.0425          | 0.7653    | 0.7889 | 0.7769 | 0.9828   |
| 0.0373        | 1.31  | 14300 | 0.0384          | 0.7738    | 0.7994 | 0.7864 | 0.9844   |
| 0.0348        | 1.32  | 14400 | 0.0367          | 0.7691    | 0.8032 | 0.7857 | 0.9845   |
| 0.0394        | 1.33  | 14500 | 0.0362          | 0.7893    | 0.8107 | 0.7999 | 0.9844   |
| 0.0321        | 1.34  | 14600 | 0.0378          | 0.7908    | 0.8152 | 0.8028 | 0.9846   |
| 0.0347        | 1.34  | 14700 | 0.0393          | 0.7559    | 0.7979 | 0.7763 | 0.9834   |
| 0.0317        | 1.35  | 14800 | 0.0388          | 0.7667    | 0.8002 | 0.7831 | 0.9841   |
| 0.0293        | 1.36  | 14900 | 0.0356          | 0.7889    | 0.8144 | 0.8015 | 0.9852   |
| 0.0396        | 1.37  | 15000 | 0.0353          | 0.7907    | 0.8174 | 0.8038 | 0.9856   |
| 0.0342        | 1.38  | 15100 | 0.0390          | 0.7717    | 0.7896 | 0.7805 | 0.9822   |
| 0.0262        | 1.39  | 15200 | 0.0396          | 0.7325    | 0.7776 | 0.7544 | 0.9827   |
| 0.0343        | 1.4   | 15300 | 0.0373          | 0.7834    | 0.8069 | 0.7950 | 0.9842   |
| 0.036         | 1.41  | 15400 | 0.0366          | 0.7720    | 0.8039 | 0.7876 | 0.9852   |
| 0.0355        | 1.42  | 15500 | 0.0479          | 0.7231    | 0.7476 | 0.7351 | 0.9797   |
| 0.037         | 1.43  | 15600 | 0.0372          | 0.7961    | 0.8182 | 0.8070 | 0.9849   |
| 0.0354        | 1.44  | 15700 | 0.0366          | 0.7852    | 0.8129 | 0.7988 | 0.9837   |
| 0.0311        | 1.45  | 15800 | 0.0391          | 0.7764    | 0.8009 | 0.7885 | 0.9842   |
| 0.0375        | 1.45  | 15900 | 0.0378          | 0.7919    | 0.8122 | 0.8019 | 0.9845   |
| 0.031         | 1.46  | 16000 | 0.0378          | 0.7902    | 0.8152 | 0.8025 | 0.9848   |
| 0.0326        | 1.47  | 16100 | 0.0369          | 0.7969    | 0.8227 | 0.8096 | 0.9846   |
| 0.0258        | 1.48  | 16200 | 0.0392          | 0.7900    | 0.8167 | 0.8031 | 0.9844   |
| 0.0238        | 1.49  | 16300 | 0.0430          | 0.7870    | 0.8077 | 0.7972 | 0.9834   |
| 0.0302        | 1.5   | 16400 | 0.0369          | 0.7980    | 0.8310 | 0.8141 | 0.9854   |
| 0.0319        | 1.51  | 16500 | 0.0379          | 0.8054    | 0.8242 | 0.8147 | 0.9853   |
| 0.0275        | 1.52  | 16600 | 0.0369          | 0.7942    | 0.8295 | 0.8115 | 0.9852   |
| 0.0426        | 1.53  | 16700 | 0.0359          | 0.7865    | 0.8167 | 0.8013 | 0.9848   |
| 0.0184        | 1.54  | 16800 | 0.0379          | 0.7906    | 0.8227 | 0.8063 | 0.9856   |
| 0.0334        | 1.55  | 16900 | 0.0369          | 0.8130    | 0.8362 | 0.8244 | 0.9857   |
| 0.0361        | 1.56  | 17000 | 0.0356          | 0.7847    | 0.8189 | 0.8015 | 0.9851   |
| 0.0319        | 1.56  | 17100 | 0.0359          | 0.7923    | 0.8197 | 0.8058 | 0.9852   |
| 0.0336        | 1.57  | 17200 | 0.0383          | 0.7726    | 0.8092 | 0.7905 | 0.9843   |
| 0.03          | 1.58  | 17300 | 0.0384          | 0.7968    | 0.8219 | 0.8092 | 0.9855   |
| 0.0399        | 1.59  | 17400 | 0.0367          | 0.8074    | 0.8317 | 0.8194 | 0.9860   |
| 0.0405        | 1.6   | 17500 | 0.0359          | 0.8093    | 0.8227 | 0.8159 | 0.9850   |
| 0.0262        | 1.61  | 17600 | 0.0388          | 0.7809    | 0.8219 | 0.8009 | 0.9848   |
| 0.0291        | 1.62  | 17700 | 0.0406          | 0.8071    | 0.8234 | 0.8152 | 0.9850   |
| 0.0201        | 1.63  | 17800 | 0.0351          | 0.8078    | 0.8272 | 0.8174 | 0.9860   |
| 0.0269        | 1.64  | 17900 | 0.0386          | 0.7833    | 0.8174 | 0.8000 | 0.9851   |
| 0.0386        | 1.65  | 18000 | 0.0381          | 0.8141    | 0.8325 | 0.8232 | 0.9860   |
| 0.0316        | 1.66  | 18100 | 0.0360          | 0.7996    | 0.8242 | 0.8117 | 0.9850   |
| 0.026         | 1.66  | 18200 | 0.0346          | 0.8004    | 0.8347 | 0.8172 | 0.9864   |
| 0.0356        | 1.67  | 18300 | 0.0336          | 0.8032    | 0.8279 | 0.8154 | 0.9865   |
| 0.0424        | 1.68  | 18400 | 0.0346          | 0.7896    | 0.8122 | 0.8007 | 0.9849   |
| 0.035         | 1.69  | 18500 | 0.0335          | 0.8084    | 0.8400 | 0.8239 | 0.9863   |
| 0.033         | 1.7   | 18600 | 0.0352          | 0.8069    | 0.8257 | 0.8162 | 0.9858   |
| 0.0287        | 1.71  | 18700 | 0.0353          | 0.8025    | 0.8242 | 0.8132 | 0.9852   |
| 0.0341        | 1.72  | 18800 | 0.0347          | 0.7950    | 0.8189 | 0.8068 | 0.9863   |
| 0.0285        | 1.73  | 18900 | 0.0362          | 0.7945    | 0.8219 | 0.8080 | 0.9850   |
| 0.0307        | 1.74  | 19000 | 0.0340          | 0.8076    | 0.8422 | 0.8246 | 0.9862   |
| 0.0227        | 1.75  | 19100 | 0.0363          | 0.8084    | 0.8370 | 0.8224 | 0.9855   |
| 0.0377        | 1.76  | 19200 | 0.0351          | 0.7922    | 0.8249 | 0.8082 | 0.9849   |
| 0.0309        | 1.77  | 19300 | 0.0325          | 0.808     | 0.8347 | 0.8211 | 0.9869   |
| 0.0378        | 1.77  | 19400 | 0.0332          | 0.8066    | 0.8272 | 0.8168 | 0.9862   |
| 0.0353        | 1.78  | 19500 | 0.0335          | 0.8105    | 0.8355 | 0.8228 | 0.9861   |
| 0.0338        | 1.79  | 19600 | 0.0324          | 0.8026    | 0.8310 | 0.8165 | 0.9864   |
| 0.0304        | 1.8   | 19700 | 0.0343          | 0.8015    | 0.8189 | 0.8101 | 0.9852   |
| 0.0359        | 1.81  | 19800 | 0.0351          | 0.8029    | 0.8234 | 0.8131 | 0.9860   |
| 0.0314        | 1.82  | 19900 | 0.0343          | 0.8045    | 0.8317 | 0.8179 | 0.9857   |
| 0.0275        | 1.83  | 20000 | 0.0330          | 0.8055    | 0.8340 | 0.8195 | 0.9866   |
| 0.0352        | 1.84  | 20100 | 0.0338          | 0.8150    | 0.8340 | 0.8244 | 0.9862   |
| 0.0367        | 1.85  | 20200 | 0.0355          | 0.8050    | 0.8279 | 0.8163 | 0.9852   |
| 0.035         | 1.86  | 20300 | 0.0313          | 0.8224    | 0.8385 | 0.8304 | 0.9876   |
| 0.0327        | 1.87  | 20400 | 0.0329          | 0.8272    | 0.8415 | 0.8343 | 0.9871   |
| 0.0339        | 1.88  | 20500 | 0.0326          | 0.8142    | 0.8362 | 0.8251 | 0.9871   |
| 0.0327        | 1.88  | 20600 | 0.0322          | 0.8242    | 0.8385 | 0.8313 | 0.9872   |
| 0.0288        | 1.89  | 20700 | 0.0321          | 0.8267    | 0.8460 | 0.8362 | 0.9871   |
| 0.0423        | 1.9   | 20800 | 0.0313          | 0.8112    | 0.8392 | 0.8250 | 0.9869   |
| 0.0311        | 1.91  | 20900 | 0.0314          | 0.8245    | 0.8542 | 0.8391 | 0.9870   |
| 0.025         | 1.92  | 21000 | 0.0325          | 0.8218    | 0.8422 | 0.8319 | 0.9864   |
| 0.0261        | 1.93  | 21100 | 0.0330          | 0.8200    | 0.8452 | 0.8324 | 0.9864   |
| 0.0382        | 1.94  | 21200 | 0.0334          | 0.8148    | 0.8332 | 0.8239 | 0.9860   |
| 0.0341        | 1.95  | 21300 | 0.0340          | 0.7906    | 0.8227 | 0.8063 | 0.9857   |
| 0.0291        | 1.96  | 21400 | 0.0340          | 0.8173    | 0.8370 | 0.8270 | 0.9864   |
| 0.0387        | 1.97  | 21500 | 0.0336          | 0.8082    | 0.8295 | 0.8187 | 0.9863   |
| 0.032         | 1.98  | 21600 | 0.0338          | 0.8165    | 0.8325 | 0.8244 | 0.9866   |
| 0.0351        | 1.98  | 21700 | 0.0345          | 0.8073    | 0.8340 | 0.8204 | 0.9866   |
| 0.033         | 1.99  | 21800 | 0.0317          | 0.8047    | 0.8295 | 0.8169 | 0.9866   |
| 0.024         | 2.0   | 21900 | 0.0317          | 0.8244    | 0.8467 | 0.8354 | 0.9871   |
| 0.0291        | 2.01  | 22000 | 0.0311          | 0.8309    | 0.8490 | 0.8398 | 0.9867   |
| 0.025         | 2.02  | 22100 | 0.0326          | 0.8363    | 0.8482 | 0.8422 | 0.9870   |
| 0.0238        | 2.03  | 22200 | 0.0325          | 0.7980    | 0.8310 | 0.8141 | 0.9867   |
| 0.022         | 2.04  | 22300 | 0.0328          | 0.8087    | 0.8385 | 0.8233 | 0.9865   |
| 0.0202        | 2.05  | 22400 | 0.0314          | 0.8007    | 0.8302 | 0.8152 | 0.9860   |
| 0.0226        | 2.06  | 22500 | 0.0316          | 0.8246    | 0.8407 | 0.8326 | 0.9867   |
| 0.0326        | 2.07  | 22600 | 0.0359          | 0.8042    | 0.8302 | 0.8170 | 0.9860   |
| 0.0324        | 2.08  | 22700 | 0.0330          | 0.8135    | 0.8355 | 0.8243 | 0.9864   |
| 0.0283        | 2.09  | 22800 | 0.0329          | 0.8269    | 0.8467 | 0.8367 | 0.9868   |
| 0.0206        | 2.09  | 22900 | 0.0330          | 0.8338    | 0.8482 | 0.8410 | 0.9870   |
| 0.0272        | 2.1   | 23000 | 0.0338          | 0.8202    | 0.8400 | 0.8300 | 0.9864   |
| 0.0212        | 2.11  | 23100 | 0.0331          | 0.8206    | 0.8385 | 0.8294 | 0.9866   |
| 0.0238        | 2.12  | 23200 | 0.0339          | 0.8326    | 0.8520 | 0.8422 | 0.9879   |
| 0.025         | 2.13  | 23300 | 0.0328          | 0.8205    | 0.8415 | 0.8309 | 0.9871   |
| 0.0268        | 2.14  | 23400 | 0.0358          | 0.8164    | 0.8287 | 0.8225 | 0.9864   |
| 0.03          | 2.15  | 23500 | 0.0343          | 0.8233    | 0.8332 | 0.8282 | 0.9862   |
| 0.0273        | 2.16  | 23600 | 0.0339          | 0.8142    | 0.8362 | 0.8251 | 0.9861   |
| 0.0209        | 2.17  | 23700 | 0.0359          | 0.8204    | 0.8340 | 0.8271 | 0.9864   |
| 0.0262        | 2.18  | 23800 | 0.0359          | 0.8170    | 0.8385 | 0.8276 | 0.9866   |
| 0.0223        | 2.19  | 23900 | 0.0347          | 0.8315    | 0.8490 | 0.8401 | 0.9870   |
| 0.019         | 2.2   | 24000 | 0.0352          | 0.8203    | 0.8302 | 0.8252 | 0.9863   |
| 0.0308        | 2.2   | 24100 | 0.0321          | 0.8303    | 0.8452 | 0.8377 | 0.9871   |
| 0.0244        | 2.21  | 24200 | 0.0323          | 0.8103    | 0.8249 | 0.8176 | 0.9868   |
| 0.0255        | 2.22  | 24300 | 0.0337          | 0.8315    | 0.8452 | 0.8383 | 0.9869   |
| 0.0304        | 2.23  | 24400 | 0.0328          | 0.8138    | 0.8407 | 0.8271 | 0.9863   |
| 0.0328        | 2.24  | 24500 | 0.0350          | 0.8107    | 0.8332 | 0.8218 | 0.9861   |
| 0.0235        | 2.25  | 24600 | 0.0313          | 0.8380    | 0.8512 | 0.8446 | 0.9873   |
| 0.0203        | 2.26  | 24700 | 0.0349          | 0.8159    | 0.8422 | 0.8288 | 0.9864   |
| 0.0243        | 2.27  | 24800 | 0.0337          | 0.8216    | 0.8340 | 0.8277 | 0.9862   |
| 0.0222        | 2.28  | 24900 | 0.0328          | 0.8144    | 0.8437 | 0.8288 | 0.9866   |
| 0.0279        | 2.29  | 25000 | 0.0345          | 0.7971    | 0.8204 | 0.8086 | 0.9855   |
| 0.0225        | 2.3   | 25100 | 0.0341          | 0.8168    | 0.8377 | 0.8272 | 0.9864   |
| 0.0228        | 2.31  | 25200 | 0.0339          | 0.8080    | 0.8317 | 0.8197 | 0.9860   |
| 0.0279        | 2.31  | 25300 | 0.0333          | 0.8202    | 0.8430 | 0.8314 | 0.9867   |
| 0.0146        | 2.32  | 25400 | 0.0378          | 0.8123    | 0.8355 | 0.8237 | 0.9851   |
| 0.0215        | 2.33  | 25500 | 0.0350          | 0.8197    | 0.8437 | 0.8315 | 0.9858   |
| 0.0237        | 2.34  | 25600 | 0.0326          | 0.8312    | 0.8475 | 0.8393 | 0.9876   |
| 0.0291        | 2.35  | 25700 | 0.0327          | 0.8214    | 0.8430 | 0.8320 | 0.9870   |
| 0.026         | 2.36  | 25800 | 0.0344          | 0.8200    | 0.8422 | 0.8310 | 0.9867   |
| 0.0261        | 2.37  | 25900 | 0.0343          | 0.8165    | 0.8392 | 0.8277 | 0.9864   |
| 0.0268        | 2.38  | 26000 | 0.0356          | 0.8162    | 0.8310 | 0.8235 | 0.9863   |
| 0.0262        | 2.39  | 26100 | 0.0352          | 0.8263    | 0.8400 | 0.8331 | 0.9861   |
| 0.0202        | 2.4   | 26200 | 0.0347          | 0.8228    | 0.8475 | 0.8349 | 0.9867   |
| 0.0307        | 2.41  | 26300 | 0.0332          | 0.8288    | 0.8437 | 0.8362 | 0.9867   |
| 0.0253        | 2.41  | 26400 | 0.0325          | 0.8322    | 0.8497 | 0.8409 | 0.9875   |
| 0.0318        | 2.42  | 26500 | 0.0324          | 0.8236    | 0.8385 | 0.8310 | 0.9866   |
| 0.0216        | 2.43  | 26600 | 0.0326          | 0.8369    | 0.8482 | 0.8425 | 0.9872   |
| 0.0241        | 2.44  | 26700 | 0.0326          | 0.8292    | 0.8460 | 0.8375 | 0.9865   |
| 0.0226        | 2.45  | 26800 | 0.0321          | 0.8341    | 0.8535 | 0.8437 | 0.9879   |
| 0.0229        | 2.46  | 26900 | 0.0352          | 0.8136    | 0.8295 | 0.8214 | 0.9860   |
| 0.029         | 2.47  | 27000 | 0.0323          | 0.8395    | 0.8527 | 0.8461 | 0.9875   |
| 0.0197        | 2.48  | 27100 | 0.0341          | 0.8216    | 0.8407 | 0.8310 | 0.9864   |
| 0.0175        | 2.49  | 27200 | 0.0349          | 0.8237    | 0.8392 | 0.8314 | 0.9865   |
| 0.0193        | 2.5   | 27300 | 0.0325          | 0.8322    | 0.8460 | 0.8390 | 0.9872   |
| 0.0292        | 2.51  | 27400 | 0.0325          | 0.8255    | 0.8422 | 0.8338 | 0.9867   |
| 0.0217        | 2.52  | 27500 | 0.0344          | 0.8328    | 0.8460 | 0.8394 | 0.9872   |
| 0.0249        | 2.52  | 27600 | 0.0328          | 0.8269    | 0.8467 | 0.8367 | 0.9876   |
| 0.0277        | 2.53  | 27700 | 0.0307          | 0.8416    | 0.8542 | 0.8479 | 0.9876   |
| 0.0285        | 2.54  | 27800 | 0.0311          | 0.8201    | 0.8460 | 0.8328 | 0.9871   |
| 0.0238        | 2.55  | 27900 | 0.0306          | 0.8305    | 0.8467 | 0.8385 | 0.9870   |
| 0.0261        | 2.56  | 28000 | 0.0326          | 0.8300    | 0.8475 | 0.8387 | 0.9873   |
| 0.0258        | 2.57  | 28100 | 0.0319          | 0.8323    | 0.8467 | 0.8395 | 0.9872   |
| 0.0208        | 2.58  | 28200 | 0.0322          | 0.8259    | 0.8482 | 0.8369 | 0.9875   |
| 0.0191        | 2.59  | 28300 | 0.0337          | 0.8230    | 0.8385 | 0.8307 | 0.9867   |
| 0.0254        | 2.6   | 28400 | 0.0308          | 0.8385    | 0.8505 | 0.8445 | 0.9878   |
| 0.0283        | 2.61  | 28500 | 0.0313          | 0.8273    | 0.8422 | 0.8347 | 0.9876   |
| 0.032         | 2.62  | 28600 | 0.0311          | 0.8293    | 0.8430 | 0.8361 | 0.9879   |
| 0.0175        | 2.63  | 28700 | 0.0326          | 0.8363    | 0.8557 | 0.8459 | 0.9877   |
| 0.0298        | 2.63  | 28800 | 0.0315          | 0.8396    | 0.8535 | 0.8465 | 0.9882   |
| 0.0156        | 2.64  | 28900 | 0.0305          | 0.8337    | 0.8512 | 0.8424 | 0.9880   |
| 0.0185        | 2.65  | 29000 | 0.0327          | 0.8320    | 0.8445 | 0.8382 | 0.9873   |
| 0.0259        | 2.66  | 29100 | 0.0313          | 0.8198    | 0.8407 | 0.8301 | 0.9872   |
| 0.019         | 2.67  | 29200 | 0.0306          | 0.8336    | 0.8430 | 0.8383 | 0.9875   |
| 0.0301        | 2.68  | 29300 | 0.0315          | 0.8211    | 0.8377 | 0.8293 | 0.9872   |
| 0.0294        | 2.69  | 29400 | 0.0308          | 0.8277    | 0.8407 | 0.8341 | 0.9875   |
| 0.0261        | 2.7   | 29500 | 0.0320          | 0.8234    | 0.8445 | 0.8338 | 0.9873   |
| 0.0373        | 2.71  | 29600 | 0.0295          | 0.8366    | 0.8542 | 0.8454 | 0.9879   |
| 0.0168        | 2.72  | 29700 | 0.0308          | 0.8284    | 0.8452 | 0.8367 | 0.9874   |
| 0.0316        | 2.73  | 29800 | 0.0319          | 0.8429    | 0.8505 | 0.8467 | 0.9876   |
| 0.0241        | 2.74  | 29900 | 0.0311          | 0.8208    | 0.8362 | 0.8284 | 0.9869   |
| 0.0237        | 2.74  | 30000 | 0.0302          | 0.8359    | 0.8497 | 0.8428 | 0.9880   |
| 0.0268        | 2.75  | 30100 | 0.0318          | 0.8310    | 0.8497 | 0.8403 | 0.9871   |
| 0.0206        | 2.76  | 30200 | 0.0325          | 0.8290    | 0.8452 | 0.8371 | 0.9869   |
| 0.022         | 2.77  | 30300 | 0.0329          | 0.8277    | 0.8407 | 0.8341 | 0.9872   |
| 0.0209        | 2.78  | 30400 | 0.0324          | 0.8174    | 0.8340 | 0.8256 | 0.9871   |
| 0.0241        | 2.79  | 30500 | 0.0313          | 0.8163    | 0.8347 | 0.8254 | 0.9870   |
| 0.0287        | 2.8   | 30600 | 0.0312          | 0.8217    | 0.8377 | 0.8296 | 0.9869   |
| 0.0208        | 2.81  | 30700 | 0.0316          | 0.8338    | 0.8482 | 0.8410 | 0.9873   |
| 0.0199        | 2.82  | 30800 | 0.0317          | 0.8231    | 0.8422 | 0.8325 | 0.9871   |
| 0.021         | 2.83  | 30900 | 0.0317          | 0.8266    | 0.8490 | 0.8377 | 0.9870   |
| 0.0206        | 2.84  | 31000 | 0.0311          | 0.8459    | 0.8618 | 0.8537 | 0.9884   |
| 0.0206        | 2.84  | 31100 | 0.0313          | 0.8298    | 0.8422 | 0.8359 | 0.9866   |
| 0.018         | 2.85  | 31200 | 0.0307          | 0.8332    | 0.8520 | 0.8425 | 0.9876   |
| 0.0221        | 2.86  | 31300 | 0.0322          | 0.8358    | 0.8452 | 0.8405 | 0.9873   |
| 0.0224        | 2.87  | 31400 | 0.0304          | 0.8353    | 0.8497 | 0.8425 | 0.9872   |
| 0.0251        | 2.88  | 31500 | 0.0295          | 0.8354    | 0.8505 | 0.8429 | 0.9877   |
| 0.0267        | 2.89  | 31600 | 0.0345          | 0.8167    | 0.8370 | 0.8267 | 0.9861   |
| 0.0212        | 2.9   | 31700 | 0.0306          | 0.8374    | 0.8550 | 0.8461 | 0.9876   |
| 0.0233        | 2.91  | 31800 | 0.0306          | 0.8401    | 0.8527 | 0.8464 | 0.9872   |
| 0.0133        | 2.92  | 31900 | 0.0295          | 0.8438    | 0.8565 | 0.8501 | 0.9880   |
| 0.0167        | 2.93  | 32000 | 0.0303          | 0.8292    | 0.8497 | 0.8393 | 0.9870   |
| 0.0229        | 2.94  | 32100 | 0.0294          | 0.8327    | 0.8565 | 0.8444 | 0.9876   |
| 0.0323        | 2.95  | 32200 | 0.0314          | 0.8379    | 0.8467 | 0.8423 | 0.9867   |
| 0.0206        | 2.95  | 32300 | 0.0306          | 0.8503    | 0.8580 | 0.8542 | 0.9883   |
| 0.0275        | 2.96  | 32400 | 0.0288          | 0.8498    | 0.8588 | 0.8543 | 0.9884   |
| 0.023         | 2.97  | 32500 | 0.0290          | 0.8383    | 0.8452 | 0.8418 | 0.9869   |
| 0.0215        | 2.98  | 32600 | 0.0300          | 0.8375    | 0.8482 | 0.8429 | 0.9874   |
| 0.0228        | 2.99  | 32700 | 0.0294          | 0.8407    | 0.8565 | 0.8485 | 0.9878   |
| 0.0257        | 3.0   | 32800 | 0.0293          | 0.8458    | 0.8573 | 0.8515 | 0.9881   |
| 0.0107        | 3.01  | 32900 | 0.0307          | 0.8474    | 0.8595 | 0.8534 | 0.9882   |
| 0.0112        | 3.02  | 33000 | 0.0314          | 0.8442    | 0.8550 | 0.8496 | 0.9879   |
| 0.0101        | 3.03  | 33100 | 0.0314          | 0.8513    | 0.8648 | 0.8580 | 0.9886   |
| 0.0187        | 3.04  | 33200 | 0.0314          | 0.8500    | 0.8603 | 0.8551 | 0.9881   |
| 0.0125        | 3.05  | 33300 | 0.0323          | 0.8534    | 0.8663 | 0.8598 | 0.9886   |
| 0.0183        | 3.06  | 33400 | 0.0324          | 0.8541    | 0.8618 | 0.8579 | 0.9884   |
| 0.0205        | 3.06  | 33500 | 0.0323          | 0.8275    | 0.8505 | 0.8388 | 0.9874   |
| 0.0118        | 3.07  | 33600 | 0.0320          | 0.8450    | 0.8557 | 0.8503 | 0.9880   |
| 0.0218        | 3.08  | 33700 | 0.0307          | 0.8463    | 0.8603 | 0.8532 | 0.9886   |
| 0.0133        | 3.09  | 33800 | 0.0331          | 0.8456    | 0.8603 | 0.8529 | 0.9883   |
| 0.008         | 3.1   | 33900 | 0.0330          | 0.8406    | 0.8557 | 0.8481 | 0.9879   |
| 0.0171        | 3.11  | 34000 | 0.0327          | 0.8344    | 0.8520 | 0.8431 | 0.9876   |
| 0.0196        | 3.12  | 34100 | 0.0346          | 0.8400    | 0.8557 | 0.8478 | 0.9873   |
| 0.0238        | 3.13  | 34200 | 0.0335          | 0.8438    | 0.8603 | 0.8519 | 0.9879   |
| 0.0144        | 3.14  | 34300 | 0.0323          | 0.8416    | 0.8580 | 0.8497 | 0.9880   |
| 0.013         | 3.15  | 34400 | 0.0326          | 0.8421    | 0.8573 | 0.8496 | 0.9884   |
| 0.0114        | 3.16  | 34500 | 0.0335          | 0.8399    | 0.8512 | 0.8455 | 0.9873   |
| 0.0156        | 3.17  | 34600 | 0.0318          | 0.8455    | 0.8550 | 0.8502 | 0.9880   |
| 0.0139        | 3.17  | 34700 | 0.0338          | 0.8341    | 0.8497 | 0.8418 | 0.9875   |
| 0.0165        | 3.18  | 34800 | 0.0326          | 0.8516    | 0.8625 | 0.8570 | 0.9885   |
| 0.0136        | 3.19  | 34900 | 0.0311          | 0.8468    | 0.8557 | 0.8513 | 0.9885   |
| 0.0158        | 3.2   | 35000 | 0.0323          | 0.8420    | 0.8527 | 0.8473 | 0.9876   |
| 0.0141        | 3.21  | 35100 | 0.0340          | 0.8360    | 0.8505 | 0.8432 | 0.9872   |
| 0.0112        | 3.22  | 35200 | 0.0333          | 0.8363    | 0.8520 | 0.8441 | 0.9872   |
| 0.007         | 3.23  | 35300 | 0.0337          | 0.8296    | 0.8452 | 0.8374 | 0.9868   |
| 0.0204        | 3.24  | 35400 | 0.0333          | 0.8278    | 0.8415 | 0.8346 | 0.9861   |
| 0.0097        | 3.25  | 35500 | 0.0348          | 0.8236    | 0.8385 | 0.8310 | 0.9861   |
| 0.0159        | 3.26  | 35600 | 0.0346          | 0.8271    | 0.8407 | 0.8338 | 0.9862   |
| 0.0134        | 3.27  | 35700 | 0.0348          | 0.8246    | 0.8407 | 0.8326 | 0.9862   |
| 0.0112        | 3.27  | 35800 | 0.0341          | 0.8362    | 0.8437 | 0.8399 | 0.9863   |
| 0.0238        | 3.28  | 35900 | 0.0333          | 0.8361    | 0.8430 | 0.8395 | 0.9867   |
| 0.014         | 3.29  | 36000 | 0.0371          | 0.8248    | 0.8347 | 0.8297 | 0.9858   |
| 0.021         | 3.3   | 36100 | 0.0341          | 0.8351    | 0.8445 | 0.8397 | 0.9870   |
| 0.0129        | 3.31  | 36200 | 0.0367          | 0.8377    | 0.8452 | 0.8414 | 0.9865   |
| 0.0228        | 3.32  | 36300 | 0.0349          | 0.8388    | 0.8482 | 0.8435 | 0.9873   |
| 0.0142        | 3.33  | 36400 | 0.0352          | 0.8295    | 0.8407 | 0.8351 | 0.9863   |
| 0.019         | 3.34  | 36500 | 0.0332          | 0.8423    | 0.8505 | 0.8464 | 0.9871   |
| 0.0199        | 3.35  | 36600 | 0.0338          | 0.8404    | 0.8467 | 0.8436 | 0.9873   |
| 0.0125        | 3.36  | 36700 | 0.0335          | 0.8407    | 0.8527 | 0.8467 | 0.9878   |
| 0.0169        | 3.37  | 36800 | 0.0344          | 0.8448    | 0.8505 | 0.8476 | 0.9872   |
| 0.0114        | 3.38  | 36900 | 0.0354          | 0.8437    | 0.8557 | 0.8497 | 0.9875   |
| 0.0149        | 3.38  | 37000 | 0.0350          | 0.8296    | 0.8415 | 0.8355 | 0.9863   |
| 0.013         | 3.39  | 37100 | 0.0334          | 0.8411    | 0.8550 | 0.8480 | 0.9873   |
| 0.0149        | 3.4   | 37200 | 0.0359          | 0.8380    | 0.8475 | 0.8427 | 0.9861   |
| 0.0103        | 3.41  | 37300 | 0.0335          | 0.8415    | 0.8497 | 0.8456 | 0.9868   |
| 0.016         | 3.42  | 37400 | 0.0333          | 0.8369    | 0.8520 | 0.8444 | 0.9876   |
| 0.0221        | 3.43  | 37500 | 0.0333          | 0.8251    | 0.8400 | 0.8325 | 0.9867   |
| 0.0191        | 3.44  | 37600 | 0.0328          | 0.8363    | 0.8482 | 0.8422 | 0.9871   |
| 0.0132        | 3.45  | 37700 | 0.0327          | 0.8384    | 0.8497 | 0.8440 | 0.9869   |
| 0.0154        | 3.46  | 37800 | 0.0335          | 0.8401    | 0.8490 | 0.8445 | 0.9869   |
| 0.0166        | 3.47  | 37900 | 0.0359          | 0.8382    | 0.8445 | 0.8413 | 0.9866   |
| 0.0149        | 3.48  | 38000 | 0.0336          | 0.8393    | 0.8595 | 0.8493 | 0.9875   |
| 0.014         | 3.49  | 38100 | 0.0330          | 0.8484    | 0.8580 | 0.8532 | 0.9879   |
| 0.0176        | 3.49  | 38200 | 0.0344          | 0.8441    | 0.8542 | 0.8491 | 0.9875   |
| 0.013         | 3.5   | 38300 | 0.0334          | 0.8513    | 0.8603 | 0.8558 | 0.9884   |
| 0.0137        | 3.51  | 38400 | 0.0328          | 0.8497    | 0.8580 | 0.8538 | 0.9882   |
| 0.0117        | 3.52  | 38500 | 0.0335          | 0.8539    | 0.8648 | 0.8593 | 0.9886   |
| 0.0161        | 3.53  | 38600 | 0.0324          | 0.8571    | 0.8655 | 0.8613 | 0.9886   |
| 0.0191        | 3.54  | 38700 | 0.0330          | 0.8483    | 0.8610 | 0.8546 | 0.9884   |
| 0.0188        | 3.55  | 38800 | 0.0325          | 0.8493    | 0.8595 | 0.8544 | 0.9882   |
| 0.0174        | 3.56  | 38900 | 0.0319          | 0.8576    | 0.8685 | 0.8630 | 0.9889   |
| 0.0171        | 3.57  | 39000 | 0.0313          | 0.8494    | 0.8603 | 0.8548 | 0.9885   |
| 0.0217        | 3.58  | 39100 | 0.0311          | 0.8507    | 0.8603 | 0.8554 | 0.9884   |
| 0.0166        | 3.59  | 39200 | 0.0317          | 0.8532    | 0.8648 | 0.8590 | 0.9886   |
| 0.0175        | 3.59  | 39300 | 0.0325          | 0.8490    | 0.8618 | 0.8553 | 0.9884   |
| 0.0182        | 3.6   | 39400 | 0.0330          | 0.8497    | 0.8580 | 0.8538 | 0.9882   |
| 0.0138        | 3.61  | 39500 | 0.0322          | 0.8387    | 0.8557 | 0.8472 | 0.9879   |
| 0.0128        | 3.62  | 39600 | 0.0325          | 0.8490    | 0.8573 | 0.8531 | 0.9879   |
| 0.0173        | 3.63  | 39700 | 0.0336          | 0.8427    | 0.8573 | 0.8499 | 0.9881   |
| 0.0154        | 3.64  | 39800 | 0.0342          | 0.8496    | 0.8618 | 0.8557 | 0.9882   |
| 0.0119        | 3.65  | 39900 | 0.0337          | 0.8448    | 0.8588 | 0.8517 | 0.9877   |
| 0.0145        | 3.66  | 40000 | 0.0355          | 0.8470    | 0.8565 | 0.8517 | 0.9876   |
| 0.0101        | 3.67  | 40100 | 0.0339          | 0.8505    | 0.8633 | 0.8568 | 0.9885   |
| 0.0159        | 3.68  | 40200 | 0.0352          | 0.8531    | 0.8640 | 0.8585 | 0.9881   |
| 0.0216        | 3.69  | 40300 | 0.0334          | 0.8485    | 0.8625 | 0.8554 | 0.9882   |
| 0.0108        | 3.7   | 40400 | 0.0325          | 0.8479    | 0.8625 | 0.8551 | 0.9880   |
| 0.0086        | 3.7   | 40500 | 0.0324          | 0.8467    | 0.8633 | 0.8549 | 0.9882   |
| 0.0161        | 3.71  | 40600 | 0.0334          | 0.8513    | 0.8603 | 0.8558 | 0.9879   |
| 0.0224        | 3.72  | 40700 | 0.0325          | 0.8536    | 0.8633 | 0.8584 | 0.9882   |
| 0.0139        | 3.73  | 40800 | 0.0321          | 0.8536    | 0.8670 | 0.8602 | 0.9884   |
| 0.0181        | 3.74  | 40900 | 0.0328          | 0.8510    | 0.8625 | 0.8567 | 0.9881   |
| 0.0161        | 3.75  | 41000 | 0.0326          | 0.8542    | 0.8670 | 0.8606 | 0.9883   |
| 0.0205        | 3.76  | 41100 | 0.0332          | 0.8504    | 0.8588 | 0.8546 | 0.9881   |
| 0.0093        | 3.77  | 41200 | 0.0338          | 0.8483    | 0.8610 | 0.8546 | 0.9880   |
| 0.0197        | 3.78  | 41300 | 0.0334          | 0.8535    | 0.8625 | 0.8580 | 0.9881   |
| 0.0183        | 3.79  | 41400 | 0.0332          | 0.8503    | 0.8618 | 0.8560 | 0.9881   |
| 0.0169        | 3.8   | 41500 | 0.0327          | 0.8469    | 0.8603 | 0.8535 | 0.9879   |
| 0.0141        | 3.81  | 41600 | 0.0344          | 0.8489    | 0.8610 | 0.8549 | 0.9879   |
| 0.0126        | 3.81  | 41700 | 0.0334          | 0.8483    | 0.8610 | 0.8546 | 0.9882   |
| 0.0181        | 3.82  | 41800 | 0.0333          | 0.8504    | 0.8625 | 0.8564 | 0.9884   |
| 0.0155        | 3.83  | 41900 | 0.0344          | 0.8506    | 0.8640 | 0.8572 | 0.9881   |
| 0.0111        | 3.84  | 42000 | 0.0333          | 0.8526    | 0.8648 | 0.8586 | 0.9881   |
| 0.0169        | 3.85  | 42100 | 0.0339          | 0.8555    | 0.8633 | 0.8594 | 0.9882   |
| 0.0133        | 3.86  | 42200 | 0.0345          | 0.8565    | 0.8655 | 0.8610 | 0.9881   |
| 0.0143        | 3.87  | 42300 | 0.0342          | 0.8545    | 0.8648 | 0.8596 | 0.9884   |
| 0.0144        | 3.88  | 42400 | 0.0323          | 0.8522    | 0.8663 | 0.8592 | 0.9886   |
| 0.0123        | 3.89  | 42500 | 0.0329          | 0.8532    | 0.8648 | 0.8590 | 0.9885   |
| 0.0146        | 3.9   | 42600 | 0.0324          | 0.8514    | 0.8655 | 0.8584 | 0.9888   |
| 0.0107        | 3.91  | 42700 | 0.0327          | 0.8517    | 0.8670 | 0.8593 | 0.9888   |
| 0.0165        | 3.92  | 42800 | 0.0328          | 0.8530    | 0.8633 | 0.8581 | 0.9887   |
| 0.0161        | 3.92  | 42900 | 0.0331          | 0.8470    | 0.8610 | 0.8539 | 0.9886   |
| 0.0089        | 3.93  | 43000 | 0.0330          | 0.8496    | 0.8618 | 0.8557 | 0.9886   |
| 0.0139        | 3.94  | 43100 | 0.0329          | 0.8438    | 0.8603 | 0.8519 | 0.9884   |
| 0.0091        | 3.95  | 43200 | 0.0322          | 0.8562    | 0.8678 | 0.8619 | 0.9888   |
| 0.0174        | 3.96  | 43300 | 0.0324          | 0.8576    | 0.8685 | 0.8630 | 0.9889   |
| 0.0142        | 3.97  | 43400 | 0.0324          | 0.8548    | 0.8670 | 0.8609 | 0.9889   |
| 0.0126        | 3.98  | 43500 | 0.0323          | 0.8541    | 0.8663 | 0.8601 | 0.9887   |
| 0.019         | 3.99  | 43600 | 0.0323          | 0.8541    | 0.8663 | 0.8601 | 0.9887   |
| 0.011         | 4.0   | 43700 | 0.0324          | 0.8534    | 0.8663 | 0.8598 | 0.9888   |


### Framework versions

- Transformers 4.38.1
- Pytorch 2.0.1+cu117
- Datasets 2.16.1
- Tokenizers 0.15.0