File size: 36,910 Bytes
c1ce6be
 
 
 
 
228c20b
 
c1ce6be
 
 
 
 
 
 
 
 
 
 
228c20b
c1ce6be
 
 
 
 
e7474a1
 
 
 
 
c1ce6be
e7474a1
 
c1ce6be
 
 
 
 
 
 
 
e7474a1
 
 
c1ce6be
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e7474a1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c1ce6be
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
---

library_name: transformers
license: apache-2.0
base_model: facebook/detr-resnet-50
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: detr-finetuned-cppe-5-10k-steps
  results: []
---


<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# detr-finetuned-cppe-5-10k-steps

This model is a fine-tuned version of [facebook/detr-resnet-50](https://huggingface.co/facebook/detr-resnet-50) on the cppe-5 dataset.
It achieves the following results on the evaluation set:
- Loss: 1.2564
- Map: 0.2948
- Map 50: 0.5884
- Map 75: 0.2425
- Map Coverall: 0.55
- Map Face Shield: 0.2939
- Map Gloves: 0.1976
- Map Goggles: 0.1503
- Map Mask: 0.282
- Map Large: 0.4679
- Map Medium: 0.2362
- Map Small: 0.0834
- Mar 1: 0.2966
- Mar 10: 0.4598
- Mar 100: 0.4716
- Mar 100 Coverall: 0.6766
- Mar 100 Face Shield: 0.4987
- Mar 100 Gloves: 0.3946
- Mar 100 Goggles: 0.3846
- Mar 100 Mask: 0.4036
- Mar Large: 0.6584
- Mar Medium: 0.4137
- Mar Small: 0.1785

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05

- train_batch_size: 8

- eval_batch_size: 8

- seed: 1337

- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08

- lr_scheduler_type: linear

- num_epochs: 100.0
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Map    | Map 50 | Map 75 | Map Coverall | Map Face Shield | Map Gloves | Map Goggles | Map Mask | Map Large | Map Medium | Map Small | Mar 1  | Mar 10 | Mar 100 | Mar 100 Coverall | Mar 100 Face Shield | Mar 100 Gloves | Mar 100 Goggles | Mar 100 Mask | Mar Large | Mar Medium | Mar Small |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:------------:|:---------------:|:----------:|:-----------:|:--------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:----------------:|:-------------------:|:--------------:|:---------------:|:------------:|:---------:|:----------:|:---------:|
| 2.8255        | 1.0   | 107   | 2.4646          | 0.0262 | 0.0647 | 0.0201 | 0.1126       | 0.0             | 0.0104     | 0.0         | 0.008    | 0.0299    | 0.0089     | 0.0038    | 0.0468 | 0.1244 | 0.1694  | 0.4752           | 0.0                 | 0.1433         | 0.0             | 0.2284       | 0.1707    | 0.1465     | 0.07      |
| 2.4162        | 2.0   | 214   | 2.6974          | 0.0172 | 0.0482 | 0.0105 | 0.0761       | 0.0             | 0.0034     | 0.0         | 0.0067   | 0.0193    | 0.0145     | 0.0013    | 0.0205 | 0.0976 | 0.1138  | 0.3514           | 0.0                 | 0.104          | 0.0             | 0.1138       | 0.1342    | 0.0852     | 0.0223    |
| 2.0883        | 3.0   | 321   | 2.4750          | 0.0312 | 0.0758 | 0.021  | 0.1376       | 0.0             | 0.0027     | 0.0         | 0.016    | 0.0392    | 0.0196     | 0.0043    | 0.0577 | 0.1028 | 0.1375  | 0.3113           | 0.0                 | 0.1281         | 0.0             | 0.248        | 0.1399    | 0.117      | 0.0809    |
| 1.8872        | 4.0   | 428   | 2.0300          | 0.0583 | 0.134  | 0.0452 | 0.2421       | 0.0             | 0.0135     | 0.0         | 0.0358   | 0.0702    | 0.0395     | 0.0109    | 0.0754 | 0.1726 | 0.1972  | 0.5689           | 0.0                 | 0.1969         | 0.0             | 0.22         | 0.2348    | 0.152      | 0.0608    |
| 1.8577        | 5.0   | 535   | 1.9218          | 0.0823 | 0.1798 | 0.0655 | 0.3197       | 0.0             | 0.0268     | 0.0         | 0.0649   | 0.0911    | 0.0576     | 0.017     | 0.0964 | 0.1911 | 0.2088  | 0.5581           | 0.0                 | 0.2188         | 0.0             | 0.2671       | 0.2491    | 0.1701     | 0.0718    |
| 1.7723        | 6.0   | 642   | 1.9397          | 0.0945 | 0.2072 | 0.0766 | 0.3258       | 0.0326          | 0.0212     | 0.0004      | 0.0926   | 0.1066    | 0.0808     | 0.0299    | 0.1046 | 0.2043 | 0.2177  | 0.5414           | 0.1304              | 0.1759         | 0.0046          | 0.236        | 0.2573    | 0.1748     | 0.0883    |
| 1.6972        | 7.0   | 749   | 1.8258          | 0.1137 | 0.2603 | 0.0836 | 0.3377       | 0.0521          | 0.0521     | 0.0109      | 0.1156   | 0.1299    | 0.1054     | 0.0324    | 0.1388 | 0.2648 | 0.2912  | 0.5842           | 0.243               | 0.2893         | 0.0538          | 0.2858       | 0.3473    | 0.2499     | 0.1498    |
| 1.6244        | 8.0   | 856   | 1.8033          | 0.1184 | 0.2566 | 0.0951 | 0.3741       | 0.0522          | 0.0363     | 0.0004      | 0.1289   | 0.1388    | 0.0968     | 0.0342    | 0.1355 | 0.2559 | 0.2776  | 0.5883           | 0.2304              | 0.2366         | 0.0108          | 0.3218       | 0.3421    | 0.2259     | 0.102     |
| 1.5748        | 9.0   | 963   | 1.7707          | 0.1186 | 0.2686 | 0.0942 | 0.3855       | 0.0505          | 0.0427     | 0.0005      | 0.1139   | 0.1413    | 0.0946     | 0.0284    | 0.1472 | 0.2763 | 0.2939  | 0.5977           | 0.3063              | 0.2237         | 0.0308          | 0.3111       | 0.369     | 0.2425     | 0.1111    |
| 1.5378        | 10.0  | 1070  | 1.7505          | 0.1306 | 0.294  | 0.0999 | 0.3696       | 0.0606          | 0.0411     | 0.0141      | 0.1677   | 0.1879    | 0.1128     | 0.0519    | 0.1592 | 0.3028 | 0.3333  | 0.577            | 0.3152              | 0.2759         | 0.1785          | 0.32         | 0.4145    | 0.2938     | 0.1471    |
| 1.5538        | 11.0  | 1177  | 1.6579          | 0.1405 | 0.3058 | 0.1111 | 0.4391       | 0.0565          | 0.058      | 0.0063      | 0.1424   | 0.199     | 0.1076     | 0.0452    | 0.1545 | 0.3171 | 0.3423  | 0.6523           | 0.338               | 0.2692         | 0.1646          | 0.2876       | 0.4596    | 0.2709     | 0.1385    |
| 1.509         | 12.0  | 1284  | 1.6763          | 0.1392 | 0.3021 | 0.105  | 0.4083       | 0.0671          | 0.0505     | 0.0255      | 0.1447   | 0.2012    | 0.1032     | 0.051     | 0.1685 | 0.3179 | 0.3409  | 0.5883           | 0.343               | 0.2848         | 0.1708          | 0.3173       | 0.4777    | 0.2687     | 0.1274    |
| 1.5149        | 13.0  | 1391  | 1.6443          | 0.1443 | 0.3208 | 0.116  | 0.4067       | 0.0772          | 0.0569     | 0.014       | 0.1668   | 0.2052    | 0.1248     | 0.0375    | 0.174  | 0.3313 | 0.3479  | 0.6135           | 0.338               | 0.2924         | 0.1815          | 0.3142       | 0.4748    | 0.2775     | 0.1601    |
| 1.4515        | 14.0  | 1498  | 1.7081          | 0.1427 | 0.3155 | 0.1082 | 0.4072       | 0.0551          | 0.0767     | 0.0155      | 0.1591   | 0.2035    | 0.1138     | 0.0403    | 0.1746 | 0.3404 | 0.3703  | 0.6063           | 0.3582              | 0.3027         | 0.2738          | 0.3107       | 0.485     | 0.3095     | 0.1499    |
| 1.5002        | 15.0  | 1605  | 1.6553          | 0.1419 | 0.3111 | 0.1024 | 0.4224       | 0.0675          | 0.0555     | 0.0077      | 0.1564   | 0.216     | 0.1112     | 0.0544    | 0.1705 | 0.3136 | 0.3353  | 0.6324           | 0.2709              | 0.2946         | 0.1969          | 0.2818       | 0.4421    | 0.2707     | 0.1414    |
| 1.4747        | 16.0  | 1712  | 1.5881          | 0.1518 | 0.33   | 0.1305 | 0.4355       | 0.0589          | 0.0634     | 0.0111      | 0.1904   | 0.221     | 0.1175     | 0.045     | 0.1797 | 0.3366 | 0.3583  | 0.6225           | 0.3405              | 0.2777         | 0.2231          | 0.3276       | 0.5102    | 0.2928     | 0.1459    |
| 1.4134        | 17.0  | 1819  | 1.6045          | 0.1546 | 0.3384 | 0.1261 | 0.4177       | 0.0606          | 0.068      | 0.0187      | 0.2083   | 0.2225    | 0.1172     | 0.0446    | 0.1911 | 0.3443 | 0.3644  | 0.6027           | 0.338               | 0.292          | 0.2523          | 0.3369       | 0.5104    | 0.3014     | 0.1206    |
| 1.4155        | 18.0  | 1926  | 1.6723          | 0.1538 | 0.3377 | 0.1249 | 0.4035       | 0.0626          | 0.076      | 0.0371      | 0.1896   | 0.2264    | 0.1194     | 0.0599    | 0.198  | 0.3546 | 0.3833  | 0.6014           | 0.3759              | 0.2799         | 0.34            | 0.3191       | 0.5551    | 0.3167     | 0.13      |
| 1.4372        | 19.0  | 2033  | 1.6629          | 0.1531 | 0.3303 | 0.1219 | 0.4185       | 0.0517          | 0.0692     | 0.0278      | 0.1984   | 0.2333    | 0.1221     | 0.0459    | 0.1854 | 0.3515 | 0.3839  | 0.6023           | 0.3873              | 0.275          | 0.3154          | 0.3396       | 0.5284    | 0.3285     | 0.1541    |
| 1.4156        | 20.0  | 2140  | 1.5876          | 0.1587 | 0.3393 | 0.137  | 0.4228       | 0.0659          | 0.0745     | 0.0258      | 0.2043   | 0.2403    | 0.1184     | 0.067     | 0.1917 | 0.3286 | 0.3542  | 0.5914           | 0.3089              | 0.3076         | 0.2215          | 0.3418       | 0.4914    | 0.2925     | 0.1423    |
| 1.3659        | 21.0  | 2247  | 1.6484          | 0.1497 | 0.3398 | 0.124  | 0.4217       | 0.0657          | 0.0644     | 0.019       | 0.1774   | 0.2263    | 0.1088     | 0.0359    | 0.186  | 0.3318 | 0.3466  | 0.6041           | 0.319               | 0.254          | 0.2646          | 0.2911       | 0.4984    | 0.2859     | 0.101     |
| 1.339         | 22.0  | 2354  | 1.5649          | 0.1655 | 0.3626 | 0.1294 | 0.4309       | 0.0856          | 0.0979     | 0.0208      | 0.1923   | 0.2475    | 0.1316     | 0.046     | 0.1937 | 0.3682 | 0.3943  | 0.6252           | 0.362               | 0.3321         | 0.3308          | 0.3213       | 0.5332    | 0.3458     | 0.1509    |
| 1.4317        | 23.0  | 2461  | 1.5822          | 0.162  | 0.3599 | 0.1265 | 0.4617       | 0.0562          | 0.0818     | 0.0144      | 0.1962   | 0.2323    | 0.122      | 0.055     | 0.1958 | 0.3482 | 0.3666  | 0.6514           | 0.3405              | 0.275          | 0.2646          | 0.3013       | 0.5214    | 0.3049     | 0.1204    |
| 1.3442        | 24.0  | 2568  | 1.5509          | 0.1758 | 0.3742 | 0.1367 | 0.4346       | 0.092           | 0.1071     | 0.0356      | 0.2099   | 0.2524    | 0.1523     | 0.0461    | 0.2152 | 0.3713 | 0.3953  | 0.6212           | 0.381               | 0.3375         | 0.3062          | 0.3307       | 0.5532    | 0.3408     | 0.1443    |
| 1.3088        | 25.0  | 2675  | 1.5144          | 0.1732 | 0.3703 | 0.1431 | 0.4627       | 0.0835          | 0.0882     | 0.0167      | 0.2149   | 0.255     | 0.138      | 0.0488    | 0.1954 | 0.3597 | 0.3789  | 0.655            | 0.3456              | 0.3143         | 0.2462          | 0.3338       | 0.5433    | 0.3152     | 0.1227    |
| 1.2841        | 26.0  | 2782  | 1.5131          | 0.1863 | 0.3861 | 0.1567 | 0.4666       | 0.1093          | 0.0956     | 0.0371      | 0.223    | 0.281     | 0.1384     | 0.0514    | 0.2129 | 0.3647 | 0.3846  | 0.6707           | 0.3506              | 0.3027         | 0.2338          | 0.3653       | 0.543     | 0.3154     | 0.1479    |
| 1.2947        | 27.0  | 2889  | 1.5201          | 0.1728 | 0.3797 | 0.1302 | 0.4428       | 0.1068          | 0.1116     | 0.0222      | 0.1807   | 0.2608    | 0.134      | 0.0476    | 0.1976 | 0.3634 | 0.3875  | 0.6239           | 0.3468              | 0.3598         | 0.2938          | 0.3129       | 0.5232    | 0.331      | 0.1466    |
| 1.252         | 28.0  | 2996  | 1.4757          | 0.1899 | 0.3907 | 0.1572 | 0.4615       | 0.1026          | 0.1288     | 0.0302      | 0.2262   | 0.295     | 0.1446     | 0.0665    | 0.2119 | 0.3774 | 0.3957  | 0.6477           | 0.3861              | 0.3402         | 0.2631          | 0.3413       | 0.5794    | 0.3256     | 0.1531    |
| 1.2745        | 29.0  | 3103  | 1.5029          | 0.1826 | 0.395  | 0.1331 | 0.4466       | 0.1041          | 0.113      | 0.0466      | 0.2026   | 0.2817    | 0.157      | 0.0457    | 0.2141 | 0.3623 | 0.3802  | 0.6446           | 0.3354              | 0.3464         | 0.2554          | 0.3191       | 0.4998    | 0.3378     | 0.1535    |
| 1.2365        | 30.0  | 3210  | 1.4733          | 0.1966 | 0.4269 | 0.1553 | 0.4552       | 0.1469          | 0.1287     | 0.035       | 0.217    | 0.2938    | 0.1694     | 0.0659    | 0.2247 | 0.388  | 0.3993  | 0.6284           | 0.3633              | 0.3536         | 0.3292          | 0.3222       | 0.5594    | 0.3502     | 0.1447    |
| 1.2055        | 31.0  | 3317  | 1.5310          | 0.1831 | 0.3896 | 0.1457 | 0.4614       | 0.1266          | 0.0936     | 0.0351      | 0.1988   | 0.2706    | 0.1474     | 0.0524    | 0.2158 | 0.3636 | 0.38    | 0.6225           | 0.3696              | 0.3174         | 0.2923          | 0.2982       | 0.5223    | 0.3278     | 0.1527    |
| 1.2181        | 32.0  | 3424  | 1.4300          | 0.206  | 0.4241 | 0.1698 | 0.4943       | 0.125           | 0.1308     | 0.0418      | 0.2381   | 0.3151    | 0.1464     | 0.0786    | 0.2372 | 0.3845 | 0.3965  | 0.6622           | 0.3608              | 0.3384         | 0.2815          | 0.3396       | 0.5687    | 0.3259     | 0.1504    |
| 1.1936        | 33.0  | 3531  | 1.3983          | 0.219  | 0.4472 | 0.1882 | 0.5025       | 0.161           | 0.1486     | 0.0388      | 0.2439   | 0.3481    | 0.1659     | 0.0532    | 0.2361 | 0.3955 | 0.4157  | 0.6477           | 0.3962              | 0.3768         | 0.2969          | 0.3609       | 0.5569    | 0.3681     | 0.1852    |
| 1.1766        | 34.0  | 3638  | 1.4252          | 0.2112 | 0.4429 | 0.186  | 0.4788       | 0.1525          | 0.1409     | 0.0413      | 0.2424   | 0.3333    | 0.1618     | 0.0649    | 0.2415 | 0.4032 | 0.4171  | 0.6333           | 0.4139              | 0.3723         | 0.3031          | 0.3627       | 0.5865    | 0.3613     | 0.1671    |
| 1.1881        | 35.0  | 3745  | 1.4474          | 0.2089 | 0.4392 | 0.1807 | 0.4701       | 0.1567          | 0.1537     | 0.0433      | 0.2206   | 0.3283    | 0.1735     | 0.0476    | 0.2301 | 0.3828 | 0.3938  | 0.6059           | 0.4                 | 0.3723         | 0.2523          | 0.3387       | 0.5522    | 0.3409     | 0.1313    |
| 1.1731        | 36.0  | 3852  | 1.4049          | 0.2193 | 0.4635 | 0.1851 | 0.5034       | 0.1324          | 0.1668     | 0.0523      | 0.2416   | 0.3293    | 0.1738     | 0.0544    | 0.2415 | 0.3998 | 0.4116  | 0.6459           | 0.3785              | 0.3737         | 0.3154          | 0.3444       | 0.5581    | 0.3617     | 0.1726    |
| 1.14          | 37.0  | 3959  | 1.4157          | 0.2097 | 0.4485 | 0.1698 | 0.4988       | 0.1456          | 0.1321     | 0.0615      | 0.2106   | 0.343     | 0.1592     | 0.061     | 0.2267 | 0.3779 | 0.3934  | 0.6297           | 0.3582              | 0.35           | 0.2892          | 0.34         | 0.5569    | 0.3352     | 0.1308    |
| 1.1286        | 38.0  | 4066  | 1.3872          | 0.2135 | 0.4475 | 0.1802 | 0.4968       | 0.1468          | 0.1432     | 0.0545      | 0.2264   | 0.3308    | 0.1695     | 0.0541    | 0.2388 | 0.4061 | 0.4215  | 0.6495           | 0.4228              | 0.3821         | 0.3138          | 0.3391       | 0.5656    | 0.3647     | 0.2025    |
| 1.1398        | 39.0  | 4173  | 1.4290          | 0.2131 | 0.4419 | 0.1668 | 0.4882       | 0.1032          | 0.1618     | 0.0638      | 0.2485   | 0.3403    | 0.1659     | 0.0482    | 0.2407 | 0.4155 | 0.4279  | 0.6405           | 0.4228              | 0.3661         | 0.3385          | 0.3716       | 0.6137    | 0.372      | 0.1347    |
| 1.1372        | 40.0  | 4280  | 1.3823          | 0.212  | 0.4684 | 0.1785 | 0.4819       | 0.1455          | 0.1478     | 0.05        | 0.235    | 0.3349    | 0.1684     | 0.0616    | 0.2547 | 0.4168 | 0.4355  | 0.6306           | 0.4304              | 0.3866         | 0.3523          | 0.3773       | 0.6017    | 0.3784     | 0.1724    |
| 1.1173        | 41.0  | 4387  | 1.4033          | 0.2191 | 0.4555 | 0.1875 | 0.5062       | 0.1254          | 0.1576     | 0.0658      | 0.2402   | 0.3384    | 0.1826     | 0.0538    | 0.2474 | 0.4157 | 0.4311  | 0.6437           | 0.4291              | 0.3879         | 0.3262          | 0.3684       | 0.6138    | 0.3651     | 0.1632    |
| 1.1065        | 42.0  | 4494  | 1.4276          | 0.2176 | 0.4688 | 0.1656 | 0.4854       | 0.1977          | 0.1425     | 0.0682      | 0.1943   | 0.3273    | 0.1838     | 0.069     | 0.2479 | 0.3991 | 0.4159  | 0.6405           | 0.4506              | 0.3482         | 0.3108          | 0.3293       | 0.5677    | 0.3603     | 0.1665    |
| 1.1245        | 43.0  | 4601  | 1.4040          | 0.2073 | 0.4466 | 0.1712 | 0.4941       | 0.1068          | 0.1453     | 0.0624      | 0.2281   | 0.3255    | 0.1618     | 0.0731    | 0.2357 | 0.402  | 0.4105  | 0.6176           | 0.3797              | 0.3536         | 0.3415          | 0.36         | 0.5864    | 0.3442     | 0.1519    |
| 1.1049        | 44.0  | 4708  | 1.3916          | 0.2169 | 0.4598 | 0.1835 | 0.4769       | 0.1651          | 0.154      | 0.0539      | 0.2347   | 0.3413    | 0.1707     | 0.0746    | 0.2535 | 0.406  | 0.422   | 0.6284           | 0.4025              | 0.3924         | 0.32            | 0.3667       | 0.5728    | 0.3657     | 0.1741    |
| 1.07          | 45.0  | 4815  | 1.3629          | 0.2307 | 0.479  | 0.1857 | 0.5024       | 0.1537          | 0.1864     | 0.075       | 0.2361   | 0.3512    | 0.1931     | 0.0677    | 0.258  | 0.4256 | 0.4405  | 0.6468           | 0.4228              | 0.379          | 0.3892          | 0.3644       | 0.6005    | 0.3921     | 0.1622    |
| 1.0862        | 46.0  | 4922  | 1.3544          | 0.2329 | 0.4875 | 0.1938 | 0.5099       | 0.1729          | 0.1743     | 0.0601      | 0.2472   | 0.3683    | 0.1849     | 0.069     | 0.2417 | 0.4062 | 0.4213  | 0.6671           | 0.3785              | 0.3884         | 0.3154          | 0.3569       | 0.5998    | 0.3649     | 0.1415    |
| 1.0606        | 47.0  | 5029  | 1.3490          | 0.2279 | 0.4671 | 0.1828 | 0.491        | 0.1715          | 0.1666     | 0.064       | 0.2465   | 0.3586    | 0.1748     | 0.0727    | 0.2603 | 0.4306 | 0.4434  | 0.6559           | 0.438               | 0.3848         | 0.3615          | 0.3769       | 0.6136    | 0.372      | 0.1867    |
| 1.0517        | 48.0  | 5136  | 1.3711          | 0.2323 | 0.4913 | 0.181  | 0.4912       | 0.2222          | 0.1615     | 0.0442      | 0.2426   | 0.3617    | 0.1758     | 0.0705    | 0.2434 | 0.4108 | 0.4233  | 0.627            | 0.4443              | 0.3683         | 0.3154          | 0.3613       | 0.5821    | 0.3642     | 0.1745    |
| 1.0691        | 49.0  | 5243  | 1.3260          | 0.2389 | 0.4867 | 0.199  | 0.5088       | 0.1961          | 0.1662     | 0.0433      | 0.28     | 0.3837    | 0.1806     | 0.0863    | 0.2603 | 0.4327 | 0.4406  | 0.6486           | 0.4544              | 0.371          | 0.3385          | 0.3907       | 0.6257    | 0.3787     | 0.167     |
| 1.0383        | 50.0  | 5350  | 1.3316          | 0.2444 | 0.4987 | 0.2146 | 0.5157       | 0.1974          | 0.1867     | 0.0746      | 0.2476   | 0.3849    | 0.19       | 0.0714    | 0.2569 | 0.425  | 0.4383  | 0.6608           | 0.4494              | 0.3987         | 0.3231          | 0.3596       | 0.6142    | 0.3792     | 0.1694    |
| 1.0445        | 51.0  | 5457  | 1.3406          | 0.2374 | 0.4855 | 0.1968 | 0.5008       | 0.1831          | 0.1698     | 0.0791      | 0.2545   | 0.3681    | 0.1947     | 0.0747    | 0.2525 | 0.4258 | 0.4403  | 0.6572           | 0.4468              | 0.3853         | 0.3431          | 0.3693       | 0.6079    | 0.3877     | 0.1859    |
| 1.0122        | 52.0  | 5564  | 1.3005          | 0.2477 | 0.5029 | 0.2034 | 0.5084       | 0.1895          | 0.1706     | 0.1017      | 0.268    | 0.3893    | 0.1935     | 0.0755    | 0.2747 | 0.4432 | 0.4526  | 0.6599           | 0.4608              | 0.392          | 0.3662          | 0.3844       | 0.6098    | 0.3925     | 0.2031    |
| 0.9938        | 53.0  | 5671  | 1.3286          | 0.2532 | 0.5169 | 0.2223 | 0.5146       | 0.1887          | 0.1815     | 0.1132      | 0.2682   | 0.3849    | 0.205      | 0.0745    | 0.2782 | 0.4453 | 0.4591  | 0.6743           | 0.4785              | 0.3772         | 0.3754          | 0.3902       | 0.626     | 0.396      | 0.1838    |
| 1.0204        | 54.0  | 5778  | 1.3251          | 0.2528 | 0.518  | 0.224  | 0.5171       | 0.2166          | 0.1915     | 0.0875      | 0.251    | 0.404     | 0.1964     | 0.0822    | 0.2674 | 0.4319 | 0.4424  | 0.6568           | 0.4519              | 0.3808         | 0.3354          | 0.3871       | 0.6108    | 0.3899     | 0.1771    |
| 0.9882        | 55.0  | 5885  | 1.3231          | 0.2495 | 0.5069 | 0.22   | 0.531        | 0.2113          | 0.1735     | 0.1058      | 0.2257   | 0.3987    | 0.2008     | 0.0674    | 0.2629 | 0.4312 | 0.4405  | 0.6784           | 0.4519              | 0.3804         | 0.3354          | 0.3564       | 0.6144    | 0.3806     | 0.1674    |
| 1.0046        | 56.0  | 5992  | 1.3377          | 0.2524 | 0.523  | 0.2186 | 0.5272       | 0.2091          | 0.1884     | 0.0904      | 0.2472   | 0.4021    | 0.201      | 0.0665    | 0.2729 | 0.4396 | 0.4498  | 0.6671           | 0.4646              | 0.3826         | 0.3692          | 0.3653       | 0.6219    | 0.3964     | 0.1789    |
| 1.0016        | 57.0  | 6099  | 1.3185          | 0.2503 | 0.5142 | 0.2258 | 0.5272       | 0.216           | 0.1628     | 0.0851      | 0.2606   | 0.3973    | 0.1923     | 0.0674    | 0.2689 | 0.4362 | 0.4497  | 0.6577           | 0.4747              | 0.3746         | 0.3631          | 0.3787       | 0.6336    | 0.3877     | 0.1685    |
| 0.9883        | 58.0  | 6206  | 1.3084          | 0.2568 | 0.5155 | 0.2298 | 0.5325       | 0.2181          | 0.1826     | 0.0855      | 0.2653   | 0.4028    | 0.2064     | 0.0776    | 0.2762 | 0.4401 | 0.4531  | 0.6671           | 0.4785              | 0.3804         | 0.3585          | 0.3809       | 0.636     | 0.3909     | 0.1667    |
| 0.9602        | 59.0  | 6313  | 1.2997          | 0.2547 | 0.5081 | 0.2266 | 0.5313       | 0.2093          | 0.1846     | 0.0738      | 0.2743   | 0.3964    | 0.1954     | 0.0712    | 0.2736 | 0.4402 | 0.4507  | 0.6559           | 0.4608              | 0.3893         | 0.3477          | 0.4          | 0.6033    | 0.394      | 0.1952    |
| 0.9773        | 60.0  | 6420  | 1.3113          | 0.2645 | 0.5457 | 0.2198 | 0.5352       | 0.238           | 0.188      | 0.1104      | 0.2508   | 0.417     | 0.207      | 0.066     | 0.2807 | 0.4395 | 0.4497  | 0.6563           | 0.4873              | 0.3643         | 0.3646          | 0.376        | 0.6122    | 0.3969     | 0.1644    |
| 0.9686        | 61.0  | 6527  | 1.3026          | 0.2559 | 0.5301 | 0.2045 | 0.5328       | 0.2314          | 0.1755     | 0.0815      | 0.2583   | 0.4018    | 0.2057     | 0.0625    | 0.2682 | 0.4381 | 0.4518  | 0.6766           | 0.4722              | 0.3723         | 0.3646          | 0.3733       | 0.6317    | 0.3969     | 0.1681    |
| 0.9567        | 62.0  | 6634  | 1.2796          | 0.2705 | 0.553  | 0.2302 | 0.5388       | 0.2515          | 0.1876     | 0.1091      | 0.2653   | 0.4179    | 0.2184     | 0.0828    | 0.2758 | 0.4523 | 0.4657  | 0.6806           | 0.4949              | 0.3808         | 0.3831          | 0.3889       | 0.6367    | 0.4141     | 0.1773    |
| 0.9708        | 63.0  | 6741  | 1.3059          | 0.2601 | 0.5508 | 0.2151 | 0.5379       | 0.2271          | 0.1795     | 0.1046      | 0.2514   | 0.4032    | 0.203      | 0.0794    | 0.266  | 0.4358 | 0.452   | 0.6698           | 0.4747              | 0.3705         | 0.38            | 0.3649       | 0.6006    | 0.4044     | 0.1817    |
| 0.952         | 64.0  | 6848  | 1.3013          | 0.2637 | 0.5312 | 0.228  | 0.5374       | 0.227           | 0.1805     | 0.0944      | 0.2791   | 0.4199    | 0.2113     | 0.0749    | 0.2824 | 0.4484 | 0.4629  | 0.6626           | 0.4937              | 0.3911         | 0.3677          | 0.3996       | 0.6251    | 0.4122     | 0.1934    |
| 0.9335        | 65.0  | 6955  | 1.3231          | 0.2644 | 0.5376 | 0.2208 | 0.5362       | 0.2564          | 0.1668     | 0.0945      | 0.2681   | 0.4075    | 0.2091     | 0.083     | 0.2741 | 0.4524 | 0.4649  | 0.6721           | 0.5089              | 0.3777         | 0.3892          | 0.3764       | 0.6225    | 0.4149     | 0.1879    |
| 0.9378        | 66.0  | 7062  | 1.2839          | 0.258  | 0.5316 | 0.2175 | 0.5311       | 0.2351          | 0.1747     | 0.0904      | 0.2586   | 0.4166    | 0.2101     | 0.0745    | 0.2793 | 0.4521 | 0.4661  | 0.6689           | 0.5025              | 0.3955         | 0.3785          | 0.3849       | 0.6323    | 0.4171     | 0.188     |
| 0.9359        | 67.0  | 7169  | 1.3037          | 0.2606 | 0.548  | 0.2147 | 0.5387       | 0.2334          | 0.1713     | 0.1064      | 0.2533   | 0.415     | 0.2146     | 0.0795    | 0.2728 | 0.4415 | 0.4559  | 0.6784           | 0.4835              | 0.3781         | 0.36            | 0.3796       | 0.6312    | 0.4075     | 0.1637    |
| 0.9218        | 68.0  | 7276  | 1.2800          | 0.269  | 0.5546 | 0.2302 | 0.5459       | 0.2507          | 0.1823     | 0.1058      | 0.2603   | 0.4256    | 0.2151     | 0.083     | 0.2706 | 0.4481 | 0.4597  | 0.6712           | 0.4696              | 0.3835         | 0.3846          | 0.3898       | 0.6186    | 0.4051     | 0.2107    |
| 0.9189        | 69.0  | 7383  | 1.2613          | 0.2724 | 0.5536 | 0.2313 | 0.5453       | 0.2606          | 0.1822     | 0.1036      | 0.27     | 0.4374    | 0.2123     | 0.0791    | 0.2795 | 0.4526 | 0.4663  | 0.6676           | 0.4987              | 0.3902         | 0.3723          | 0.4027       | 0.6376    | 0.4138     | 0.2006    |
| 0.9092        | 70.0  | 7490  | 1.2850          | 0.2628 | 0.5303 | 0.2188 | 0.5448       | 0.247           | 0.1701     | 0.0999      | 0.2524   | 0.4314    | 0.2052     | 0.0815    | 0.2755 | 0.4481 | 0.4618  | 0.668            | 0.4949              | 0.3848         | 0.3677          | 0.3938       | 0.645     | 0.4011     | 0.1933    |
| 0.9069        | 71.0  | 7597  | 1.2548          | 0.2751 | 0.5565 | 0.2414 | 0.5499       | 0.2558          | 0.1791     | 0.1248      | 0.2662   | 0.4429    | 0.2188     | 0.0703    | 0.2929 | 0.4524 | 0.4669  | 0.6775           | 0.4747              | 0.3938         | 0.3908          | 0.3978       | 0.6499    | 0.4108     | 0.1824    |
| 0.9118        | 72.0  | 7704  | 1.2529          | 0.2691 | 0.5525 | 0.2408 | 0.5462       | 0.2308          | 0.1804     | 0.1244      | 0.2638   | 0.4295    | 0.2146     | 0.0737    | 0.2817 | 0.4469 | 0.4569  | 0.6703           | 0.4481              | 0.3871         | 0.3877          | 0.3916       | 0.6281    | 0.4004     | 0.1912    |
| 0.8915        | 73.0  | 7811  | 1.2830          | 0.2778 | 0.5637 | 0.2352 | 0.5459       | 0.2499          | 0.1818     | 0.1303      | 0.2814   | 0.4376    | 0.2216     | 0.085     | 0.2877 | 0.454  | 0.4651  | 0.6644           | 0.4873              | 0.3777         | 0.3923          | 0.4036       | 0.6459    | 0.4085     | 0.1722    |
| 0.8906        | 74.0  | 7918  | 1.2621          | 0.2812 | 0.5762 | 0.2419 | 0.5442       | 0.274           | 0.1863     | 0.1225      | 0.2788   | 0.435     | 0.2297     | 0.0872    | 0.2833 | 0.4524 | 0.4695  | 0.6721           | 0.5038              | 0.3955         | 0.3677          | 0.4084       | 0.6412    | 0.4176     | 0.1956    |
| 0.8748        | 75.0  | 8025  | 1.2661          | 0.2813 | 0.5702 | 0.2334 | 0.5428       | 0.2763          | 0.1817     | 0.1276      | 0.2784   | 0.4281    | 0.232      | 0.0904    | 0.2843 | 0.4608 | 0.4733  | 0.6658           | 0.5051              | 0.3969         | 0.3923          | 0.4067       | 0.6409    | 0.4236     | 0.197     |
| 0.8745        | 76.0  | 8132  | 1.2626          | 0.2823 | 0.5652 | 0.2466 | 0.5456       | 0.2825          | 0.1917     | 0.1227      | 0.269    | 0.4304    | 0.2321     | 0.0955    | 0.2872 | 0.4495 | 0.4641  | 0.6658           | 0.4987              | 0.3848         | 0.3769          | 0.3942       | 0.6428    | 0.4117     | 0.1705    |
| 0.8898        | 77.0  | 8239  | 1.2889          | 0.2811 | 0.5707 | 0.2403 | 0.5353       | 0.2697          | 0.1868     | 0.1405      | 0.273    | 0.4344    | 0.2318     | 0.0737    | 0.2846 | 0.458  | 0.4696  | 0.6599           | 0.5165              | 0.3799         | 0.3877          | 0.404        | 0.6407    | 0.4147     | 0.2015    |
| 0.8799        | 78.0  | 8346  | 1.2816          | 0.2865 | 0.5721 | 0.2468 | 0.535        | 0.288           | 0.1895     | 0.1505      | 0.2696   | 0.4493    | 0.2353     | 0.0869    | 0.2873 | 0.4518 | 0.4688  | 0.6671           | 0.5038              | 0.4            | 0.3831          | 0.3898       | 0.6507    | 0.4175     | 0.1889    |
| 0.861         | 79.0  | 8453  | 1.2650          | 0.2894 | 0.5759 | 0.26   | 0.5441       | 0.2918          | 0.1965     | 0.1429      | 0.2718   | 0.4567    | 0.2339     | 0.0807    | 0.2924 | 0.4512 | 0.4629  | 0.6721           | 0.5089              | 0.3799         | 0.3631          | 0.3907       | 0.6506    | 0.404      | 0.1721    |
| 0.8627        | 80.0  | 8560  | 1.2548          | 0.2861 | 0.5717 | 0.2503 | 0.5476       | 0.2736          | 0.1949     | 0.1458      | 0.2687   | 0.4461    | 0.2372     | 0.0873    | 0.2868 | 0.4531 | 0.4677  | 0.6757           | 0.4949              | 0.3938         | 0.3738          | 0.4004       | 0.6411    | 0.4176     | 0.1916    |
| 0.8622        | 81.0  | 8667  | 1.2928          | 0.2847 | 0.5631 | 0.2481 | 0.5391       | 0.2657          | 0.1996     | 0.1288      | 0.2904   | 0.4474    | 0.2295     | 0.0797    | 0.2879 | 0.4585 | 0.4705  | 0.6644           | 0.5089              | 0.3781         | 0.38            | 0.4209       | 0.6554    | 0.4199     | 0.1616    |
| 0.8586        | 82.0  | 8774  | 1.2744          | 0.2801 | 0.5663 | 0.2436 | 0.5414       | 0.2653          | 0.1943     | 0.1235      | 0.2761   | 0.4351    | 0.2301     | 0.0846    | 0.2866 | 0.4532 | 0.4655  | 0.6703           | 0.481               | 0.3857         | 0.3938          | 0.3969       | 0.6363    | 0.4059     | 0.2026    |
| 0.8523        | 83.0  | 8881  | 1.2564          | 0.2885 | 0.5749 | 0.2494 | 0.548        | 0.2971          | 0.1862     | 0.1276      | 0.2838   | 0.4436    | 0.2355     | 0.0837    | 0.2887 | 0.4608 | 0.4761  | 0.6716           | 0.5215              | 0.3915         | 0.3908          | 0.4049       | 0.6465    | 0.4221     | 0.1964    |
| 0.8366        | 84.0  | 8988  | 1.2571          | 0.2953 | 0.5842 | 0.2646 | 0.5476       | 0.3256          | 0.1859     | 0.14        | 0.2772   | 0.4622    | 0.243      | 0.0893    | 0.3019 | 0.4561 | 0.47    | 0.6734           | 0.5127              | 0.3786         | 0.3769          | 0.4084       | 0.6532    | 0.4145     | 0.1874    |
| 0.8217        | 85.0  | 9095  | 1.2677          | 0.2967 | 0.5928 | 0.268  | 0.5481       | 0.3208          | 0.1918     | 0.1424      | 0.2805   | 0.4632    | 0.2397     | 0.087     | 0.2971 | 0.457  | 0.4695  | 0.6779           | 0.5152              | 0.3879         | 0.3569          | 0.4093       | 0.6515    | 0.4172     | 0.1938    |
| 0.8385        | 86.0  | 9202  | 1.2808          | 0.2903 | 0.583  | 0.2494 | 0.5434       | 0.3045          | 0.1934     | 0.141       | 0.2691   | 0.4654    | 0.2261     | 0.0893    | 0.2932 | 0.4558 | 0.4655  | 0.6649           | 0.5114              | 0.3879         | 0.3708          | 0.3924       | 0.655     | 0.401      | 0.1873    |
| 0.8304        | 87.0  | 9309  | 1.2956          | 0.2888 | 0.5773 | 0.2582 | 0.5437       | 0.2936          | 0.1877     | 0.1485      | 0.2707   | 0.4552    | 0.231      | 0.0846    | 0.2898 | 0.4587 | 0.4728  | 0.6671           | 0.519               | 0.3902         | 0.3985          | 0.3893       | 0.6544    | 0.4195     | 0.1903    |
| 0.8369        | 88.0  | 9416  | 1.2704          | 0.2884 | 0.5857 | 0.2531 | 0.5443       | 0.3007          | 0.1908     | 0.1325      | 0.2738   | 0.4529    | 0.2275     | 0.086     | 0.2853 | 0.4556 | 0.4681  | 0.6779           | 0.5025              | 0.3911         | 0.3708          | 0.3982       | 0.6439    | 0.4036     | 0.2107    |
| 0.8317        | 89.0  | 9523  | 1.2721          | 0.2837 | 0.5738 | 0.2341 | 0.5465       | 0.2812          | 0.1887     | 0.1291      | 0.2728   | 0.4506    | 0.2235     | 0.0871    | 0.286  | 0.4533 | 0.4638  | 0.6734           | 0.4873              | 0.3848         | 0.3846          | 0.3889       | 0.6381    | 0.4021     | 0.2009    |
| 0.8319        | 90.0  | 9630  | 1.2615          | 0.2838 | 0.573  | 0.2459 | 0.5477       | 0.2789          | 0.1854     | 0.1354      | 0.2716   | 0.4556    | 0.2219     | 0.0856    | 0.2887 | 0.4537 | 0.4641  | 0.6662           | 0.4797              | 0.396          | 0.3862          | 0.3924       | 0.6459    | 0.4055     | 0.1986    |
| 0.8259        | 91.0  | 9737  | 1.2576          | 0.2862 | 0.575  | 0.2422 | 0.5465       | 0.2978          | 0.1854     | 0.1336      | 0.2678   | 0.4559    | 0.2227     | 0.0904    | 0.2854 | 0.4596 | 0.4715  | 0.6761           | 0.5013              | 0.3964         | 0.3985          | 0.3853       | 0.6493    | 0.4163     | 0.2011    |
| 0.8261        | 92.0  | 9844  | 1.2630          | 0.2903 | 0.578  | 0.2561 | 0.5502       | 0.2979          | 0.191      | 0.133       | 0.2793   | 0.4549    | 0.2275     | 0.0854    | 0.2922 | 0.4582 | 0.4681  | 0.6707           | 0.4987              | 0.392          | 0.3862          | 0.3929       | 0.6396    | 0.4136     | 0.1935    |
| 0.8222        | 93.0  | 9951  | 1.2568          | 0.2926 | 0.5865 | 0.2522 | 0.5484       | 0.2989          | 0.1909     | 0.1454      | 0.2793   | 0.4598    | 0.2371     | 0.0844    | 0.2895 | 0.4604 | 0.473   | 0.6766           | 0.5                 | 0.3938         | 0.3969          | 0.3978       | 0.6476    | 0.425      | 0.1893    |
| 0.815         | 94.0  | 10058 | 1.2552          | 0.2918 | 0.5843 | 0.2481 | 0.548        | 0.2894          | 0.1927     | 0.1499      | 0.2788   | 0.4632    | 0.2349     | 0.0855    | 0.2906 | 0.4547 | 0.4687  | 0.6739           | 0.4987              | 0.3942         | 0.3785          | 0.3982       | 0.6562    | 0.4095     | 0.1851    |
| 0.8016        | 95.0  | 10165 | 1.2575          | 0.2899 | 0.5824 | 0.2444 | 0.5516       | 0.2855          | 0.1968     | 0.1366      | 0.2789   | 0.4661    | 0.2233     | 0.085     | 0.2875 | 0.4542 | 0.4672  | 0.6775           | 0.4962              | 0.3978         | 0.3723          | 0.3924       | 0.6563    | 0.4053     | 0.179     |
| 0.8191        | 96.0  | 10272 | 1.2532          | 0.294  | 0.5848 | 0.2411 | 0.5536       | 0.2938          | 0.1956     | 0.1438      | 0.2833   | 0.4694    | 0.225      | 0.0885    | 0.2972 | 0.4581 | 0.4707  | 0.677            | 0.4937              | 0.3978         | 0.3785          | 0.4067       | 0.6565    | 0.4116     | 0.1814    |
| 0.7974        | 97.0  | 10379 | 1.2629          | 0.2915 | 0.5849 | 0.236  | 0.5456       | 0.2891          | 0.1935     | 0.1465      | 0.2827   | 0.4674    | 0.2285     | 0.0838    | 0.2964 | 0.4575 | 0.4695  | 0.6721           | 0.4924              | 0.3897         | 0.3846          | 0.4089       | 0.6555    | 0.4113     | 0.1808    |
| 0.8021        | 98.0  | 10486 | 1.2549          | 0.2939 | 0.5839 | 0.2424 | 0.5491       | 0.2927          | 0.1977     | 0.1489      | 0.2811   | 0.464     | 0.2358     | 0.0839    | 0.2969 | 0.459  | 0.4717  | 0.6739           | 0.4975              | 0.3978         | 0.3846          | 0.4049       | 0.652     | 0.4136     | 0.193     |
| 0.8073        | 99.0  | 10593 | 1.2519          | 0.2945 | 0.5865 | 0.241  | 0.5512       | 0.2915          | 0.198      | 0.1521      | 0.2798   | 0.4662    | 0.2335     | 0.0834    | 0.297  | 0.46   | 0.4713  | 0.6761           | 0.4949              | 0.396          | 0.3846          | 0.4049       | 0.6554    | 0.4146     | 0.1775    |
| 0.8109        | 100.0 | 10700 | 1.2564          | 0.2948 | 0.5884 | 0.2425 | 0.55         | 0.2939          | 0.1976     | 0.1503      | 0.282    | 0.4679    | 0.2362     | 0.0834    | 0.2966 | 0.4598 | 0.4716  | 0.6766           | 0.4987              | 0.3946         | 0.3846          | 0.4036       | 0.6584    | 0.4137     | 0.1785    |


### Framework versions

- Transformers 4.45.0.dev0
- Pytorch 2.4.0+cu124
- Datasets 2.21.0
- Tokenizers 0.19.1