File size: 39,018 Bytes
4f4e485
 
 
 
 
449a070
 
4f4e485
 
 
 
 
 
 
 
 
 
 
449a070
4f4e485
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
---
library_name: transformers
license: apache-2.0
base_model: PekingU/rtdetr_r50vd
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: suas-2025-rtdetr-finetuned-e50-b16-lr1e-5
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# suas-2025-rtdetr-finetuned-e50-b16-lr1e-5

This model is a fine-tuned version of [PekingU/rtdetr_r50vd](https://huggingface.co/PekingU/rtdetr_r50vd) on the mfly-auton/suas-2025-synthetic-data dataset.
It achieves the following results on the evaluation set:
- Loss: 5.1922
- Map: 0.848
- Map 50: 0.9654
- Map 75: 0.9497
- Map Small: 0.7323
- Map Medium: 0.8702
- Map Large: 0.9603
- Mar 1: 0.7848
- Mar 10: 0.8983
- Mar 100: 0.9079
- Mar Small: 0.8094
- Mar Medium: 0.9289
- Mar Large: 0.9849
- Map Baseball-bat: 0.7866
- Mar 100 Baseball-bat: 0.906
- Map Basketball: 0.8183
- Mar 100 Basketball: 0.8576
- Map Car: -1.0
- Mar 100 Car: -1.0
- Map Football: 0.623
- Mar 100 Football: 0.7297
- Map Human: 0.9109
- Mar 100 Human: 0.9522
- Map Luggage: 0.826
- Mar 100 Luggage: 0.9096
- Map Mattress: 0.9878
- Mar 100 Mattress: 0.9977
- Map Motorcycle: 0.9319
- Mar 100 Motorcycle: 0.9564
- Map Skis: 0.9199
- Mar 100 Skis: 0.9703
- Map Snowboard: 0.9883
- Mar 100 Snowboard: 0.9951
- Map Soccer-ball: 0.7476
- Mar 100 Soccer-ball: 0.8144
- Map Stop-sign: 0.9339
- Mar 100 Stop-sign: 0.9612
- Map Tennis-racket: 0.7812
- Mar 100 Tennis-racket: 0.8845
- Map Umbrella: 0.9107
- Mar 100 Umbrella: 0.9553
- Map Volleyball: 0.7061
- Mar 100 Volleyball: 0.8208

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 16
- eval_batch_size: 32
- seed: 1337
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 50.0
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Map    | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1  | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Baseball-bat | Mar 100 Baseball-bat | Map Basketball | Mar 100 Basketball | Map Car | Mar 100 Car | Map Football | Mar 100 Football | Map Human | Mar 100 Human | Map Luggage | Mar 100 Luggage | Map Mattress | Mar 100 Mattress | Map Motorcycle | Mar 100 Motorcycle | Map Skis | Mar 100 Skis | Map Snowboard | Mar 100 Snowboard | Map Soccer-ball | Mar 100 Soccer-ball | Map Stop-sign | Mar 100 Stop-sign | Map Tennis-racket | Mar 100 Tennis-racket | Map Umbrella | Mar 100 Umbrella | Map Volleyball | Mar 100 Volleyball |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:----------------:|:--------------------:|:--------------:|:------------------:|:-------:|:-----------:|:------------:|:----------------:|:---------:|:-------------:|:-----------:|:---------------:|:------------:|:----------------:|:--------------:|:------------------:|:--------:|:------------:|:-------------:|:-----------------:|:---------------:|:-------------------:|:-------------:|:-----------------:|:-----------------:|:---------------------:|:------------:|:----------------:|:--------------:|:------------------:|
| 35.8209       | 1.0   | 438   | 15.8634         | 0.0876 | 0.1207 | 0.0954 | 0.0341    | 0.0699     | 0.1699    | 0.1692 | 0.3326 | 0.351   | 0.1466    | 0.3498     | 0.5102    | 0.008            | 0.2188               | 0.0904         | 0.4045             | -1.0    | -1.0        | 0.0035       | 0.173            | 0.2131    | 0.5707        | 0.0186      | 0.3735          | 0.5333       | 0.8459           | 0.1433         | 0.563              | 0.0      | 0.0          | 0.1018        | 0.6519            | 0.0005          | 0.0609              | 0.0231        | 0.4522            | 0.0001            | 0.0642                | 0.0902       | 0.5279           | 0.0            | 0.0076             |
| 18.2866       | 2.0   | 876   | 9.8698          | 0.5172 | 0.6033 | 0.5814 | 0.4216    | 0.4913     | 0.736     | 0.5753 | 0.7757 | 0.788   | 0.579     | 0.8343     | 0.9339    | 0.1171           | 0.7353               | 0.6            | 0.7434             | -1.0    | -1.0        | 0.3336       | 0.5407           | 0.7746    | 0.8705        | 0.7531      | 0.8718          | 0.9033       | 0.9978           | 0.7636         | 0.8722             | 0.0416   | 0.9446       | 0.9059        | 0.9818            | 0.2723          | 0.491               | 0.6344        | 0.8425            | 0.0891            | 0.6202                | 0.8002       | 0.9216           | 0.2522         | 0.5985             |
| 11.1872       | 3.0   | 1314  | 9.9933          | 0.7022 | 0.7977 | 0.7831 | 0.5061    | 0.7248     | 0.7949    | 0.6809 | 0.8179 | 0.8252  | 0.622     | 0.8734     | 0.9592    | 0.5039           | 0.8168               | 0.6697         | 0.7486             | -1.0    | -1.0        | 0.4155       | 0.5517           | 0.7932    | 0.8865        | 0.8129      | 0.9082          | 0.9436       | 0.9951           | 0.8345         | 0.919              | 0.8335   | 0.9658       | 0.9638        | 0.9864            | 0.4472          | 0.5874              | 0.795         | 0.931             | 0.4851            | 0.6689                | 0.8576       | 0.9445           | 0.4748         | 0.6424             |
| 9.4801        | 4.0   | 1752  | 9.8496          | 0.7498 | 0.8473 | 0.8302 | 0.5563    | 0.7902     | 0.9327    | 0.712  | 0.8431 | 0.8502  | 0.6738    | 0.8928     | 0.9778    | 0.6015           | 0.8549               | 0.7093         | 0.7945             | -1.0    | -1.0        | 0.4907       | 0.6149           | 0.8317    | 0.9066        | 0.8325      | 0.9251          | 0.9407       | 0.9977           | 0.8679         | 0.928              | 0.9228   | 0.9802       | 0.9647        | 0.9887            | 0.5159          | 0.6224              | 0.88          | 0.9525            | 0.5506            | 0.713                 | 0.8407       | 0.9433           | 0.5486         | 0.6809             |
| 8.6047        | 5.0   | 2190  | 9.9758          | 0.7961 | 0.8913 | 0.8761 | 0.6228    | 0.822      | 0.9407    | 0.7493 | 0.8766 | 0.8843  | 0.7328    | 0.9233     | 0.9855    | 0.6418           | 0.8738               | 0.7478         | 0.8289             | -1.0    | -1.0        | 0.5773       | 0.6964           | 0.8557    | 0.9283        | 0.8459      | 0.9353          | 0.9628       | 0.9994           | 0.9032         | 0.9506             | 0.9241   | 0.9866       | 0.9692        | 0.9869            | 0.6213          | 0.7185              | 0.9227        | 0.9701            | 0.6941            | 0.8145                | 0.8709       | 0.9505           | 0.6086         | 0.74               |
| 8.0733        | 6.0   | 2628  | 8.9735          | 0.8271 | 0.9212 | 0.9062 | 0.6807    | 0.8423     | 0.955     | 0.7723 | 0.8966 | 0.903   | 0.7891    | 0.9315     | 0.9876    | 0.7286           | 0.9073               | 0.7845         | 0.8616             | -1.0    | -1.0        | 0.6145       | 0.7379           | 0.8907    | 0.9397        | 0.8647      | 0.9403          | 0.9649       | 0.9984           | 0.911          | 0.9537             | 0.9595   | 0.9866       | 0.9689        | 0.9877            | 0.6932          | 0.7815              | 0.9222        | 0.9779            | 0.7176            | 0.8187                | 0.8996       | 0.9654           | 0.6592         | 0.7858             |
| 7.5839        | 7.0   | 3066  | 7.9987          | 0.8223 | 0.9186 | 0.9028 | 0.6633    | 0.8496     | 0.9498    | 0.7742 | 0.8987 | 0.9059  | 0.7739    | 0.9366     | 0.9893    | 0.7143           | 0.9003               | 0.7687         | 0.8564             | -1.0    | -1.0        | 0.6117       | 0.7344           | 0.8951    | 0.9527        | 0.8634      | 0.9432          | 0.9694       | 0.9992           | 0.9208         | 0.9569             | 0.9101   | 0.9782       | 0.9739        | 0.9943            | 0.661           | 0.7853              | 0.9409        | 0.9818            | 0.7701            | 0.8637                | 0.8874       | 0.9668           | 0.625          | 0.7696             |
| 7.1392        | 8.0   | 3504  | 7.1608          | 0.8355 | 0.9256 | 0.9125 | 0.6879    | 0.8766     | 0.9497    | 0.7827 | 0.9047 | 0.9115  | 0.8008    | 0.9413     | 0.9748    | 0.7849           | 0.9196               | 0.7918         | 0.8806             | -1.0    | -1.0        | 0.6121       | 0.745            | 0.8968    | 0.9497        | 0.8698      | 0.9442          | 0.9603       | 0.9963           | 0.9181         | 0.9547             | 0.9387   | 0.9861       | 0.9729        | 0.9893            | 0.664           | 0.7835              | 0.9507        | 0.9751            | 0.8094            | 0.8886                | 0.8947       | 0.9652           | 0.6334         | 0.7833             |
| 6.7601        | 9.0   | 3942  | 6.2561          | 0.8299 | 0.9249 | 0.9129 | 0.6819    | 0.8402     | 0.8921    | 0.774  | 0.8971 | 0.9048  | 0.7899    | 0.9314     | 0.9713    | 0.7324           | 0.917                | 0.7621         | 0.8533             | -1.0    | -1.0        | 0.6202       | 0.7347           | 0.8961    | 0.9481        | 0.8555      | 0.934           | 0.9717       | 0.9966           | 0.9125         | 0.9493             | 0.9039   | 0.9584       | 0.9783        | 0.9921            | 0.6866          | 0.7956              | 0.9331        | 0.9723            | 0.7984            | 0.8725                | 0.9043       | 0.9621           | 0.6631         | 0.7811             |
| 6.4006        | 10.0  | 4380  | 5.8412          | 0.8448 | 0.9414 | 0.9317 | 0.6998    | 0.8692     | 0.9526    | 0.7849 | 0.9029 | 0.9103  | 0.8009    | 0.9361     | 0.9735    | 0.7928           | 0.9195               | 0.7756         | 0.8569             | -1.0    | -1.0        | 0.6622       | 0.7649           | 0.8988    | 0.9478        | 0.8512      | 0.9228          | 0.9712       | 0.9956           | 0.9167         | 0.9501             | 0.9128   | 0.9713       | 0.9824        | 0.9922            | 0.6962          | 0.7799              | 0.9632        | 0.9885            | 0.806             | 0.8865                | 0.9035       | 0.9634           | 0.6953         | 0.8049             |
| 6.1178        | 11.0  | 4818  | 5.5940          | 0.845  | 0.9454 | 0.9347 | 0.71      | 0.8808     | 0.9531    | 0.7831 | 0.9049 | 0.9122  | 0.7997    | 0.9421     | 0.9756    | 0.7937           | 0.9242               | 0.7786         | 0.8569             | -1.0    | -1.0        | 0.6473       | 0.7514           | 0.9098    | 0.9538        | 0.8691      | 0.931           | 0.9736       | 0.9981           | 0.9145         | 0.9512             | 0.9076   | 0.9797       | 0.9805        | 0.9925            | 0.7181          | 0.8018              | 0.9571        | 0.9802            | 0.7853            | 0.8865                | 0.9027       | 0.9635           | 0.692          | 0.8                |
| 5.9386        | 12.0  | 5256  | 5.3809          | 0.8534 | 0.9525 | 0.9444 | 0.7349    | 0.8539     | 0.9484    | 0.7875 | 0.9079 | 0.9155  | 0.8192    | 0.9334     | 0.9716    | 0.8116           | 0.9208               | 0.8033         | 0.8765             | -1.0    | -1.0        | 0.6798       | 0.7668           | 0.9081    | 0.9556        | 0.8555      | 0.9195          | 0.9766       | 0.9977           | 0.9123         | 0.9477             | 0.8838   | 0.9708       | 0.9792        | 0.9911            | 0.7488          | 0.8257              | 0.9397        | 0.9718            | 0.8181            | 0.885                 | 0.9005       | 0.9612           | 0.7304         | 0.8267             |
| 5.8369        | 13.0  | 5694  | 5.3334          | 0.853  | 0.9537 | 0.9441 | 0.7272    | 0.875      | 0.9533    | 0.7879 | 0.906  | 0.9115  | 0.806     | 0.9409     | 0.9737    | 0.8282           | 0.9229               | 0.7937         | 0.86               | -1.0    | -1.0        | 0.6648       | 0.75             | 0.9043    | 0.9555        | 0.8547      | 0.9184          | 0.9863       | 0.9983           | 0.92           | 0.9466             | 0.8883   | 0.9782       | 0.9794        | 0.9917            | 0.7238          | 0.7933              | 0.9617        | 0.9737            | 0.8238            | 0.8984                | 0.8977       | 0.9577           | 0.7156         | 0.8159             |
| 5.7218        | 14.0  | 6132  | 5.4029          | 0.8396 | 0.9499 | 0.9341 | 0.6993    | 0.8734     | 0.9435    | 0.779  | 0.8927 | 0.9009  | 0.7897    | 0.9332     | 0.965     | 0.8068           | 0.9229               | 0.7721         | 0.8365             | -1.0    | -1.0        | 0.6141       | 0.722            | 0.8993    | 0.9558        | 0.8525      | 0.9165          | 0.9811       | 0.9978           | 0.9196         | 0.9482             | 0.9045   | 0.9431       | 0.9772        | 0.99              | 0.6888          | 0.7807              | 0.9418        | 0.967             | 0.8264            | 0.887                 | 0.8873       | 0.9569           | 0.6837         | 0.788              |
| 5.5868        | 15.0  | 6570  | 5.1404          | 0.8504 | 0.961  | 0.9514 | 0.7327    | 0.8765     | 0.9479    | 0.7852 | 0.8991 | 0.9073  | 0.8121    | 0.9349     | 0.9665    | 0.8254           | 0.9228               | 0.8061         | 0.8569             | -1.0    | -1.0        | 0.6472       | 0.7285           | 0.9169    | 0.9593        | 0.852       | 0.9188          | 0.978        | 0.9986           | 0.9107         | 0.946              | 0.9011   | 0.9515       | 0.978         | 0.9898            | 0.726           | 0.8134              | 0.9524        | 0.9723            | 0.7993            | 0.8829                | 0.8936       | 0.9491           | 0.7187         | 0.8125             |
| 5.5623        | 16.0  | 7008  | 5.4438          | 0.855  | 0.96   | 0.952  | 0.7403    | 0.8612     | 0.9556    | 0.7904 | 0.9026 | 0.9087  | 0.8117    | 0.9247     | 0.9737    | 0.8242           | 0.918                | 0.8126         | 0.8562             | -1.0    | -1.0        | 0.6598       | 0.7473           | 0.8932    | 0.95          | 0.8311      | 0.8984          | 0.9843       | 0.9969           | 0.9204         | 0.9477             | 0.9329   | 0.9822       | 0.9848        | 0.9953            | 0.7209          | 0.7913              | 0.95          | 0.9704            | 0.8114            | 0.8834                | 0.9004       | 0.9622           | 0.744          | 0.8225             |
| 5.4745        | 17.0  | 7446  | 5.1975          | 0.857  | 0.9606 | 0.9498 | 0.739     | 0.8749     | 0.8957    | 0.7922 | 0.9028 | 0.9088  | 0.8031    | 0.9328     | 0.9737    | 0.8173           | 0.905                | 0.8466         | 0.8839             | -1.0    | -1.0        | 0.6402       | 0.7255           | 0.9153    | 0.9556        | 0.8524      | 0.9213          | 0.9809       | 0.9976           | 0.9189         | 0.9504             | 0.9323   | 0.9723       | 0.9833        | 0.9937            | 0.735           | 0.8                 | 0.9525        | 0.9782            | 0.7967            | 0.8746                | 0.9147       | 0.9653           | 0.7123         | 0.8002             |
| 5.3515        | 18.0  | 7884  | 5.2381          | 0.8521 | 0.9594 | 0.9488 | 0.7312    | 0.88       | 0.9528    | 0.7895 | 0.901  | 0.9099  | 0.8097    | 0.9362     | 0.9698    | 0.7994           | 0.914                | 0.8113         | 0.8607             | -1.0    | -1.0        | 0.6394       | 0.7319           | 0.8967    | 0.9562        | 0.8352      | 0.9114          | 0.9828       | 0.9989           | 0.9102         | 0.9441             | 0.9371   | 0.9728       | 0.9781        | 0.9912            | 0.7338          | 0.8242              | 0.9528        | 0.9693            | 0.8038            | 0.8782                | 0.9258       | 0.9679           | 0.7228         | 0.8176             |
| 5.3462        | 19.0  | 8322  | 5.3286          | 0.851  | 0.9598 | 0.9462 | 0.7365    | 0.8681     | 0.9496    | 0.7866 | 0.9    | 0.9078  | 0.8059    | 0.9304     | 0.9705    | 0.799            | 0.907                | 0.8204         | 0.8604             | -1.0    | -1.0        | 0.6415       | 0.7333           | 0.9       | 0.9558        | 0.8441      | 0.9066          | 0.9684       | 0.9965           | 0.91           | 0.9469             | 0.9073   | 0.9663       | 0.9839        | 0.9947            | 0.7415          | 0.8149              | 0.9418        | 0.9673            | 0.8066            | 0.8793                | 0.9161       | 0.9706           | 0.7334         | 0.8091             |
| 5.2452        | 20.0  | 8760  | 5.0850          | 0.857  | 0.9632 | 0.9546 | 0.7492    | 0.8794     | 0.9493    | 0.7924 | 0.9039 | 0.9097  | 0.8145    | 0.933      | 0.9806    | 0.8174           | 0.909                | 0.8249         | 0.8685             | -1.0    | -1.0        | 0.6645       | 0.7505           | 0.9029    | 0.956         | 0.8472      | 0.9138          | 0.9749       | 0.9933           | 0.9102         | 0.9395             | 0.8949   | 0.9465       | 0.9772        | 0.9903            | 0.7612          | 0.8234              | 0.947         | 0.9763            | 0.8026            | 0.8741                | 0.9255       | 0.9682           | 0.7482         | 0.8265             |
| 5.1599        | 21.0  | 9198  | 5.0505          | 0.8568 | 0.9668 | 0.9558 | 0.7365    | 0.8822     | 0.9564    | 0.7918 | 0.9023 | 0.9105  | 0.8092    | 0.9342     | 0.9733    | 0.8247           | 0.9204               | 0.8211         | 0.8649             | -1.0    | -1.0        | 0.6429       | 0.7373           | 0.914     | 0.9571        | 0.8436      | 0.9058          | 0.986        | 0.9988           | 0.9268         | 0.9521             | 0.9171   | 0.9698       | 0.9846        | 0.995             | 0.7372          | 0.8054              | 0.9478        | 0.9751            | 0.7906            | 0.8751                | 0.9252       | 0.9684           | 0.733          | 0.8218             |
| 5.0265        | 22.0  | 9636  | 4.8772          | 0.8581 | 0.9631 | 0.9547 | 0.7454    | 0.87       | 0.9563    | 0.7918 | 0.9073 | 0.9153  | 0.8257    | 0.9336     | 0.973     | 0.8196           | 0.9196               | 0.8048         | 0.8519             | -1.0    | -1.0        | 0.66         | 0.7741           | 0.9118    | 0.9569        | 0.8538      | 0.9196          | 0.9842       | 0.9983           | 0.9285         | 0.9524             | 0.9115   | 0.9708       | 0.9812        | 0.9916            | 0.7524          | 0.8267              | 0.9298        | 0.9626            | 0.8163            | 0.8845                | 0.9245       | 0.9708           | 0.7354         | 0.8348             |
| 5.0769        | 23.0  | 10074 | 5.1876          | 0.8503 | 0.9642 | 0.9532 | 0.7342    | 0.8729     | 0.9541    | 0.7829 | 0.8973 | 0.9037  | 0.8034    | 0.9289     | 0.9696    | 0.8139           | 0.9096               | 0.8207         | 0.8628             | -1.0    | -1.0        | 0.6232       | 0.7274           | 0.9103    | 0.9549        | 0.8375      | 0.9062          | 0.9795       | 0.9978           | 0.925          | 0.9507             | 0.9009   | 0.951        | 0.9882        | 0.9959            | 0.7227          | 0.7841              | 0.9521        | 0.976             | 0.7892            | 0.8596                | 0.9103       | 0.9615           | 0.7304         | 0.8145             |
| 5.067         | 24.0  | 10512 | 5.0899          | 0.8576 | 0.9671 | 0.952  | 0.7386    | 0.8771     | 0.9618    | 0.793  | 0.9039 | 0.9131  | 0.8186    | 0.9318     | 0.9759    | 0.818            | 0.9098               | 0.8425         | 0.882              | -1.0    | -1.0        | 0.6195       | 0.7314           | 0.9078    | 0.9571        | 0.8446      | 0.9191          | 0.987        | 0.9974           | 0.9256         | 0.9491             | 0.9503   | 0.9812       | 0.9759        | 0.9895            | 0.7502          | 0.8265              | 0.9583        | 0.9835            | 0.8203            | 0.8829                | 0.9017       | 0.9588           | 0.705          | 0.8152             |
| 5.0013        | 25.0  | 10950 | 4.9919          | 0.859  | 0.9682 | 0.9561 | 0.7454    | 0.8821     | 0.9619    | 0.7938 | 0.9056 | 0.9151  | 0.823     | 0.9392     | 0.9863    | 0.8247           | 0.9175               | 0.8513         | 0.8848             | -1.0    | -1.0        | 0.646        | 0.7475           | 0.9076    | 0.9545        | 0.855       | 0.9236          | 0.9822       | 0.9971           | 0.9112         | 0.946              | 0.9303   | 0.9683       | 0.9836        | 0.9912            | 0.7401          | 0.8147              | 0.9592        | 0.9832            | 0.8187            | 0.9                   | 0.9109       | 0.9599           | 0.7058         | 0.8233             |
| 4.9435        | 26.0  | 11388 | 5.1065          | 0.8611 | 0.9673 | 0.9552 | 0.7485    | 0.8803     | 0.9616    | 0.7957 | 0.9072 | 0.9151  | 0.8231    | 0.9334     | 0.9765    | 0.821            | 0.9233               | 0.8611         | 0.8912             | -1.0    | -1.0        | 0.624        | 0.7335           | 0.9133    | 0.9618        | 0.8513      | 0.9212          | 0.982        | 0.9972           | 0.9217         | 0.9488             | 0.9462   | 0.9792       | 0.983         | 0.9906            | 0.7556          | 0.8165              | 0.9506        | 0.9821            | 0.8198            | 0.886                 | 0.9061       | 0.9588           | 0.7195         | 0.8216             |
| 4.9063        | 27.0  | 11826 | 5.0362          | 0.8585 | 0.9699 | 0.9562 | 0.739     | 0.8799     | 0.9644    | 0.7938 | 0.9055 | 0.9147  | 0.8204    | 0.9375     | 0.9875    | 0.8074           | 0.9175               | 0.8362         | 0.8709             | -1.0    | -1.0        | 0.6333       | 0.7354           | 0.9101    | 0.9594        | 0.8425      | 0.9206          | 0.9866       | 0.9971           | 0.9228         | 0.9513             | 0.9549   | 0.9807       | 0.9849        | 0.994             | 0.7379          | 0.8231              | 0.9532        | 0.9765            | 0.824             | 0.8891                | 0.9139       | 0.9626           | 0.7116         | 0.8279             |
| 4.8789        | 28.0  | 12264 | 5.0817          | 0.8545 | 0.9657 | 0.9503 | 0.734     | 0.8798     | 0.9582    | 0.7904 | 0.9021 | 0.9109  | 0.8139    | 0.9313     | 0.9728    | 0.7879           | 0.9033               | 0.8316         | 0.8709             | -1.0    | -1.0        | 0.6431       | 0.7484           | 0.917     | 0.9573        | 0.8387      | 0.9189          | 0.9877       | 0.9989           | 0.9271         | 0.9529             | 0.9354   | 0.9713       | 0.9763        | 0.9891            | 0.7376          | 0.8085              | 0.9447        | 0.9668            | 0.804             | 0.8741                | 0.9158       | 0.9634           | 0.7161         | 0.8289             |
| 4.9181        | 29.0  | 12702 | 5.0919          | 0.8488 | 0.9673 | 0.948  | 0.7178    | 0.873      | 0.9605    | 0.7847 | 0.8949 | 0.9034  | 0.7972    | 0.9323     | 0.9847    | 0.7899           | 0.8981               | 0.8159         | 0.8578             | -1.0    | -1.0        | 0.6114       | 0.7131           | 0.9059    | 0.9516        | 0.8471      | 0.9168          | 0.9877       | 0.9977           | 0.9204         | 0.948              | 0.9492   | 0.9723       | 0.9855        | 0.9953            | 0.7195          | 0.7884              | 0.95          | 0.976             | 0.7906            | 0.8679                | 0.9115       | 0.9573           | 0.6994         | 0.8069             |
| 4.8989        | 30.0  | 13140 | 5.1016          | 0.8507 | 0.9666 | 0.9511 | 0.7255    | 0.8813     | 0.9506    | 0.7864 | 0.8986 | 0.908   | 0.8065    | 0.9344     | 0.9873    | 0.7901           | 0.9063               | 0.8097         | 0.8536             | -1.0    | -1.0        | 0.6229       | 0.7297           | 0.9173    | 0.9586        | 0.8372      | 0.9172          | 0.9879       | 0.9983           | 0.9366         | 0.9561             | 0.9276   | 0.9723       | 0.984         | 0.9937            | 0.7253          | 0.7979              | 0.9454        | 0.9701            | 0.8037            | 0.8772                | 0.9131       | 0.9588           | 0.7095         | 0.8218             |
| 4.8752        | 31.0  | 13578 | 5.1597          | 0.8528 | 0.9665 | 0.951  | 0.7308    | 0.8796     | 0.9064    | 0.7889 | 0.9006 | 0.9094  | 0.8122    | 0.9348     | 0.9864    | 0.8109           | 0.9149               | 0.8143         | 0.8571             | -1.0    | -1.0        | 0.6165       | 0.7272           | 0.912     | 0.9566        | 0.8388      | 0.9117          | 0.988        | 0.9975           | 0.9322         | 0.9537             | 0.9131   | 0.9693       | 0.9795        | 0.9885            | 0.7523          | 0.8249              | 0.9591        | 0.9791            | 0.8016            | 0.8736                | 0.9114       | 0.9608           | 0.7094         | 0.8174             |
| 4.88          | 32.0  | 14016 | 5.1928          | 0.8506 | 0.9651 | 0.9484 | 0.7205    | 0.879      | 0.9698    | 0.787  | 0.8998 | 0.9082  | 0.802     | 0.9319     | 0.9859    | 0.8161           | 0.9115               | 0.7855         | 0.8301             | -1.0    | -1.0        | 0.6275       | 0.734            | 0.9035    | 0.9571        | 0.8431      | 0.9229          | 0.9863       | 0.9981           | 0.9287         | 0.9518             | 0.9446   | 0.9762       | 0.9857        | 0.9935            | 0.7377          | 0.8159              | 0.9426        | 0.974             | 0.8024            | 0.885                 | 0.9096       | 0.9579           | 0.6951         | 0.8066             |
| 4.8312        | 33.0  | 14454 | 5.1171          | 0.8519 | 0.9649 | 0.9485 | 0.7236    | 0.8715     | 0.9092    | 0.7882 | 0.9002 | 0.9094  | 0.8051    | 0.9355     | 0.9867    | 0.8064           | 0.915                | 0.8127         | 0.8545             | -1.0    | -1.0        | 0.6205       | 0.7302           | 0.916     | 0.9617        | 0.8272      | 0.9138          | 0.9875       | 0.9975           | 0.9385         | 0.964              | 0.93     | 0.9733       | 0.9806        | 0.9887            | 0.7479          | 0.8203              | 0.9445        | 0.9715            | 0.8113            | 0.886                 | 0.9069       | 0.9543           | 0.6967         | 0.8005             |
| 4.8807        | 34.0  | 14892 | 5.3542          | 0.8404 | 0.9617 | 0.943  | 0.707     | 0.8752     | 0.9566    | 0.7792 | 0.8921 | 0.9002  | 0.7871    | 0.9313     | 0.9836    | 0.7855           | 0.8946               | 0.7834         | 0.827              | -1.0    | -1.0        | 0.606        | 0.7162           | 0.911     | 0.9558        | 0.8249      | 0.9062          | 0.9872       | 0.9975           | 0.9283         | 0.9561             | 0.9189   | 0.9738       | 0.9808        | 0.9888            | 0.7295          | 0.8                 | 0.9428        | 0.9665            | 0.7857            | 0.8777                | 0.9002       | 0.9505           | 0.6814         | 0.7924             |
| 4.8605        | 35.0  | 15330 | 5.2119          | 0.8419 | 0.9631 | 0.9435 | 0.7118    | 0.8611     | 0.9584    | 0.7801 | 0.8937 | 0.9024  | 0.7951    | 0.9301     | 0.984     | 0.7704           | 0.899                | 0.7955         | 0.8391             | -1.0    | -1.0        | 0.6075       | 0.7112           | 0.9101    | 0.9542        | 0.8315      | 0.9119          | 0.9883       | 0.9978           | 0.927          | 0.9591             | 0.9161   | 0.9624       | 0.9831        | 0.9912            | 0.7368          | 0.8162              | 0.9422        | 0.969             | 0.7839            | 0.8715                | 0.912        | 0.957            | 0.6815         | 0.7939             |
| 4.8117        | 36.0  | 15768 | 5.1740          | 0.8494 | 0.966  | 0.9498 | 0.7291    | 0.8765     | 0.9572    | 0.7855 | 0.8996 | 0.9089  | 0.8108    | 0.9322     | 0.9845    | 0.8005           | 0.9149               | 0.805          | 0.8481             | -1.0    | -1.0        | 0.618        | 0.7256           | 0.9143    | 0.9551        | 0.8306      | 0.9109          | 0.9893       | 0.9992           | 0.9307         | 0.9599             | 0.9281   | 0.9713       | 0.9845        | 0.9938            | 0.7541          | 0.8267              | 0.9342        | 0.9603            | 0.7892            | 0.8793                | 0.9081       | 0.9577           | 0.7051         | 0.8216             |
| 4.7775        | 37.0  | 16206 | 5.1906          | 0.8508 | 0.9634 | 0.9476 | 0.7353    | 0.8685     | 0.9041    | 0.7879 | 0.9007 | 0.9088  | 0.8116    | 0.9269     | 0.9865    | 0.7837           | 0.9074               | 0.8018         | 0.8429             | -1.0    | -1.0        | 0.6357       | 0.7352           | 0.9186    | 0.958         | 0.8262      | 0.9122          | 0.9901       | 0.9993           | 0.9306         | 0.9545             | 0.9192   | 0.9683       | 0.9832        | 0.9934            | 0.7565          | 0.8262              | 0.9417        | 0.9687            | 0.7953            | 0.8777                | 0.9143       | 0.9634           | 0.7136         | 0.8162             |
| 4.7134        | 38.0  | 16644 | 5.1609          | 0.8506 | 0.9624 | 0.9466 | 0.7367    | 0.8744     | 0.9591    | 0.7873 | 0.9012 | 0.9094  | 0.8137    | 0.9309     | 0.986     | 0.7943           | 0.9079               | 0.8112         | 0.8538             | -1.0    | -1.0        | 0.6252       | 0.7275           | 0.9138    | 0.9549        | 0.8253      | 0.9112          | 0.9886       | 0.9982           | 0.9295         | 0.9547             | 0.911    | 0.9668       | 0.9846        | 0.9927            | 0.7582          | 0.8278              | 0.9478        | 0.9687            | 0.7875            | 0.8777                | 0.9159       | 0.9628           | 0.7157         | 0.8265             |
| 4.7257        | 39.0  | 17082 | 5.1242          | 0.8509 | 0.9641 | 0.9479 | 0.7398    | 0.8643     | 0.961     | 0.7861 | 0.8988 | 0.908   | 0.8145    | 0.9255     | 0.9822    | 0.7946           | 0.9008               | 0.8351         | 0.8694             | -1.0    | -1.0        | 0.6304       | 0.7366           | 0.919     | 0.9576        | 0.8292      | 0.9105          | 0.9872       | 0.9976           | 0.9327         | 0.9553             | 0.9121   | 0.9589       | 0.991         | 0.9964            | 0.7371          | 0.8134              | 0.938         | 0.9662            | 0.785             | 0.8751                | 0.9083       | 0.9523           | 0.713          | 0.8211             |
| 4.7352        | 40.0  | 17520 | 5.2189          | 0.8524 | 0.9633 | 0.949  | 0.7443    | 0.8621     | 0.9017    | 0.7895 | 0.9018 | 0.911   | 0.82      | 0.9222     | 0.9721    | 0.7816           | 0.9083               | 0.8336         | 0.8656             | -1.0    | -1.0        | 0.629        | 0.7379           | 0.9119    | 0.9545        | 0.8305      | 0.9089          | 0.9902       | 0.9993           | 0.9302         | 0.9569             | 0.9272   | 0.9619       | 0.9844        | 0.9938            | 0.7543          | 0.8301              | 0.9357        | 0.9637            | 0.7949            | 0.8917                | 0.914        | 0.959            | 0.7165         | 0.823              |
| 4.7245        | 41.0  | 17958 | 5.2015          | 0.8541 | 0.9663 | 0.9529 | 0.7408    | 0.8707     | 0.9638    | 0.7898 | 0.9023 | 0.9122  | 0.8165    | 0.9316     | 0.9863    | 0.8029           | 0.9049               | 0.8163         | 0.854              | -1.0    | -1.0        | 0.6416       | 0.748            | 0.9145    | 0.9586        | 0.8303      | 0.9136          | 0.9882       | 0.9977           | 0.9319         | 0.9564             | 0.9178   | 0.9713       | 0.9907        | 0.9956            | 0.7605          | 0.827               | 0.9392        | 0.9707            | 0.7957            | 0.8886                | 0.9085       | 0.9521           | 0.7191         | 0.8321             |
| 4.7187        | 42.0  | 18396 | 5.2757          | 0.8493 | 0.9614 | 0.9469 | 0.7365    | 0.8665     | 0.9033    | 0.7869 | 0.8994 | 0.9085  | 0.8121    | 0.9261     | 0.9846    | 0.7967           | 0.9073               | 0.8228         | 0.8555             | -1.0    | -1.0        | 0.6198       | 0.733            | 0.9133    | 0.9558        | 0.8187      | 0.9087          | 0.988        | 0.9978           | 0.933          | 0.9547             | 0.9032   | 0.9619       | 0.9842        | 0.9921            | 0.7558          | 0.8213              | 0.9339        | 0.9631            | 0.7886            | 0.8855                | 0.9112       | 0.9562           | 0.7203         | 0.826              |
| 4.7428        | 43.0  | 18834 | 5.2510          | 0.8499 | 0.964  | 0.9511 | 0.7396    | 0.8651     | 0.9026    | 0.788  | 0.9016 | 0.911   | 0.8192    | 0.9295     | 0.9837    | 0.7987           | 0.9076               | 0.8228         | 0.86               | -1.0    | -1.0        | 0.632        | 0.7421           | 0.9109    | 0.9533        | 0.8211      | 0.9086          | 0.9865       | 0.9974           | 0.9303         | 0.9536             | 0.9136   | 0.9743       | 0.984         | 0.9935            | 0.7499          | 0.8239              | 0.927         | 0.9575            | 0.7854            | 0.886                 | 0.9116       | 0.9582           | 0.7244         | 0.838              |
| 4.7277        | 44.0  | 19272 | 5.2467          | 0.8471 | 0.9653 | 0.9483 | 0.7293    | 0.8562     | 0.9586    | 0.7838 | 0.8977 | 0.9062  | 0.8063    | 0.9244     | 0.9847    | 0.7899           | 0.9018               | 0.8167         | 0.8566             | -1.0    | -1.0        | 0.6188       | 0.7297           | 0.9155    | 0.958         | 0.8224      | 0.9049          | 0.9868       | 0.9972           | 0.9337         | 0.9583             | 0.9203   | 0.9649       | 0.9842        | 0.9934            | 0.7376          | 0.808               | 0.928         | 0.9628            | 0.7852            | 0.8793                | 0.9106       | 0.9544           | 0.7091         | 0.8181             |
| 4.73          | 45.0  | 19710 | 5.2441          | 0.8506 | 0.9648 | 0.9507 | 0.7359    | 0.8696     | 0.9583    | 0.7871 | 0.9003 | 0.9095  | 0.8127    | 0.933      | 0.9818    | 0.8011           | 0.9055               | 0.8126         | 0.8543             | -1.0    | -1.0        | 0.635        | 0.7429           | 0.9139    | 0.9555        | 0.8192      | 0.9112          | 0.9862       | 0.997            | 0.9262         | 0.9499             | 0.9094   | 0.9639       | 0.9839        | 0.9932            | 0.7511          | 0.8188              | 0.9321        | 0.9654            | 0.8072            | 0.8907                | 0.9146       | 0.9606           | 0.7157         | 0.8238             |
| 4.736         | 46.0  | 20148 | 5.2361          | 0.8496 | 0.9639 | 0.9489 | 0.7344    | 0.8729     | 0.9005    | 0.7859 | 0.9    | 0.9087  | 0.8107    | 0.9323     | 0.9818    | 0.7925           | 0.9095               | 0.8179         | 0.8559             | -1.0    | -1.0        | 0.6265       | 0.7349           | 0.9139    | 0.9565        | 0.8268      | 0.9143          | 0.9882       | 0.9976           | 0.929          | 0.9499             | 0.9153   | 0.9678       | 0.9878        | 0.9947            | 0.7492          | 0.817               | 0.9266        | 0.9531            | 0.7903            | 0.8881                | 0.9167       | 0.9594           | 0.7142         | 0.8235             |
| 4.728         | 47.0  | 20586 | 5.1929          | 0.8511 | 0.9652 | 0.9517 | 0.7374    | 0.8757     | 0.9602    | 0.7876 | 0.8998 | 0.9096  | 0.813     | 0.9325     | 0.9822    | 0.7964           | 0.9063               | 0.8261         | 0.8626             | -1.0    | -1.0        | 0.6323       | 0.7376           | 0.9123    | 0.9571        | 0.827       | 0.9141          | 0.9889       | 0.999            | 0.9309         | 0.9547             | 0.9144   | 0.9629       | 0.9891        | 0.9956            | 0.7397          | 0.8085              | 0.9329        | 0.962             | 0.7905            | 0.8876                | 0.917        | 0.9569           | 0.7173         | 0.8294             |
| 4.711         | 48.0  | 21024 | 5.2107          | 0.8484 | 0.9642 | 0.9488 | 0.7342    | 0.8638     | 0.9613    | 0.787  | 0.8984 | 0.9081  | 0.8132    | 0.9274     | 0.9818    | 0.7948           | 0.9064               | 0.8215         | 0.8597             | -1.0    | -1.0        | 0.6242       | 0.7349           | 0.9094    | 0.9522        | 0.8193      | 0.9089          | 0.9885       | 0.999            | 0.9285         | 0.9491             | 0.9131   | 0.9604       | 0.9886        | 0.9953            | 0.7442          | 0.8149              | 0.932         | 0.9628            | 0.7869            | 0.8876                | 0.9117       | 0.9582           | 0.7148         | 0.8233             |
| 4.7041        | 49.0  | 21462 | 5.1916          | 0.8502 | 0.9651 | 0.9509 | 0.7392    | 0.8734     | 0.9006    | 0.7877 | 0.9004 | 0.9093  | 0.8174    | 0.9323     | 0.9817    | 0.7997           | 0.9038               | 0.8277         | 0.8645             | -1.0    | -1.0        | 0.6368       | 0.7456           | 0.9105    | 0.9549        | 0.8167      | 0.9114          | 0.987        | 0.9976           | 0.9316         | 0.9506             | 0.9186   | 0.9624       | 0.9849        | 0.9937            | 0.7454          | 0.8203              | 0.9342        | 0.9573            | 0.7834            | 0.8845                | 0.9118       | 0.9548           | 0.7152         | 0.8294             |
| 4.7133        | 50.0  | 21900 | 5.1922          | 0.848  | 0.9654 | 0.9497 | 0.7323    | 0.8702     | 0.9603    | 0.7848 | 0.8983 | 0.9079  | 0.8094    | 0.9289     | 0.9849    | 0.7866           | 0.906                | 0.8183         | 0.8576             | -1.0    | -1.0        | 0.623        | 0.7297           | 0.9109    | 0.9522        | 0.826       | 0.9096          | 0.9878       | 0.9977           | 0.9319         | 0.9564             | 0.9199   | 0.9703       | 0.9883        | 0.9951            | 0.7476          | 0.8144              | 0.9339        | 0.9612            | 0.7812            | 0.8845                | 0.9107       | 0.9553           | 0.7061         | 0.8208             |


### Framework versions

- Transformers 4.47.0
- Pytorch 2.5.1+cu124
- Datasets 3.1.0
- Tokenizers 0.21.0