File size: 25,646 Bytes
e75e8ff
5c95fb4
e75e8ff
 
 
 
 
 
 
 
 
 
 
 
 
 
425f466
 
 
 
e75e8ff
425f466
 
 
 
 
e75e8ff
425f466
 
 
 
 
 
e75e8ff
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5c95fb4
e75e8ff
 
 
 
5c95fb4
 
425f466
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e75e8ff
 
 
 
 
155f78e
e75e8ff
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
---

base_model: microsoft/conditional-detr-resnet-50
tags:
- generated_from_trainer
model-index:
- name: queue_detection
  results: []
---


<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# queue_detection



This model is a fine-tuned version of [microsoft/conditional-detr-resnet-50](https://huggingface.co/microsoft/conditional-detr-resnet-50) on the None dataset.

It achieves the following results on the evaluation set:

- Loss: 0.1272

- Map: 0.9568

- Map 50: 0.99

- Map 75: 0.9848

- Map Small: -1.0

- Map Medium: 0.3143

- Map Large: 0.9595

- Mar 1: 0.5045

- Mar 10: 0.9717

- Mar 100: 0.9726

- Mar Small: -1.0

- Mar Medium: 0.3385

- Mar Large: 0.9755

- Map Cashier: 0.9619

- Mar 100 Cashier: 0.9762

- Map Cx: 0.9517

- Mar 100 Cx: 0.9689



## Model description



More information needed



## Intended uses & limitations



More information needed



## Training and evaluation data



More information needed



## Training procedure



### Training hyperparameters



The following hyperparameters were used during training:

- learning_rate: 5e-05
- train_batch_size: 2
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- num_epochs: 100

- mixed_precision_training: Native AMP



### Training results



| Training Loss | Epoch | Step  | Validation Loss | Map    | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1  | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Cashier | Mar 100 Cashier | Map Cx | Mar 100 Cx |

|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:-----------:|:---------------:|:------:|:----------:|

| No log        | 1.0   | 218   | 1.5947          | 0.1037 | 0.2081 | 0.0994 | -1.0      | 0.0        | 0.1045    | 0.1112 | 0.4448 | 0.653   | -1.0      | 0.0        | 0.6572    | 0.1294      | 0.7485          | 0.0781 | 0.5574     |

| No log        | 2.0   | 436   | 1.0934          | 0.4778 | 0.7426 | 0.5557 | -1.0      | 0.0229     | 0.4814    | 0.3004 | 0.6849 | 0.7512  | -1.0      | 0.0321     | 0.7576    | 0.601       | 0.7972          | 0.3545 | 0.7051     |

| 3.1068        | 3.0   | 654   | 0.7608          | 0.6462 | 0.9281 | 0.7527 | -1.0      | 0.0299     | 0.6507    | 0.3721 | 0.7442 | 0.7711  | -1.0      | 0.135      | 0.775     | 0.6921      | 0.7955          | 0.6003 | 0.7467     |

| 3.1068        | 4.0   | 872   | 0.6540          | 0.6954 | 0.9464 | 0.8364 | -1.0      | 0.0542     | 0.7002    | 0.388  | 0.775  | 0.7902  | -1.0      | 0.0692     | 0.7955    | 0.7573      | 0.8344          | 0.6336 | 0.746      |

| 0.7588        | 5.0   | 1090  | 0.6223          | 0.7027 | 0.95   | 0.8391 | -1.0      | 0.0579     | 0.7069    | 0.3914 | 0.7837 | 0.7985  | -1.0      | 0.0909     | 0.8028    | 0.7656      | 0.8441          | 0.6397 | 0.7528     |

| 0.7588        | 6.0   | 1308  | 0.5348          | 0.7501 | 0.9656 | 0.8984 | 0.0       | 0.0968     | 0.7554    | 0.4118 | 0.8153 | 0.8279  | 0.0       | 0.1731     | 0.8324    | 0.806       | 0.8711          | 0.6942 | 0.7846     |

| 0.6174        | 7.0   | 1526  | 0.5323          | 0.7528 | 0.9746 | 0.886  | -1.0      | 0.0842     | 0.7577    | 0.4157 | 0.8095 | 0.8257  | -1.0      | 0.1886     | 0.8304    | 0.8005      | 0.8658          | 0.7051 | 0.7856     |

| 0.6174        | 8.0   | 1744  | 0.5789          | 0.737  | 0.9678 | 0.887  | -1.0      | 0.0531     | 0.7425    | 0.4079 | 0.7946 | 0.8054  | -1.0      | 0.125      | 0.8104    | 0.7745      | 0.8372          | 0.6995 | 0.7737     |

| 0.6174        | 9.0   | 1962  | 0.5023          | 0.7836 | 0.9714 | 0.9179 | -1.0      | 0.0266     | 0.7896    | 0.4282 | 0.8393 | 0.8508  | -1.0      | 0.0846     | 0.8564    | 0.8213      | 0.8846          | 0.7459 | 0.817      |

| 0.5475        | 10.0  | 2180  | 0.5080          | 0.7568 | 0.981  | 0.9186 | 0.0       | 0.0688     | 0.7606    | 0.4136 | 0.8076 | 0.8229  | 0.0       | 0.1833     | 0.8263    | 0.7922      | 0.8499          | 0.7214 | 0.796      |

| 0.5475        | 11.0  | 2398  | 0.4572          | 0.7963 | 0.9776 | 0.9388 | 0.0       | 0.0675     | 0.8052    | 0.4392 | 0.8446 | 0.8527  | 0.0       | 0.1029     | 0.8618    | 0.821       | 0.8758          | 0.7717 | 0.8297     |

| 0.496         | 12.0  | 2616  | 0.4583          | 0.7857 | 0.982  | 0.9407 | 0.0       | 0.0544     | 0.7915    | 0.4294 | 0.8359 | 0.847   | 0.0       | 0.1458     | 0.8519    | 0.8104      | 0.8715          | 0.761  | 0.8225     |

| 0.496         | 13.0  | 2834  | 0.4713          | 0.7798 | 0.9842 | 0.9263 | -1.0      | 0.0345     | 0.7841    | 0.4252 | 0.8336 | 0.8471  | -1.0      | 0.15       | 0.8509    | 0.809       | 0.8666          | 0.7506 | 0.8276     |

| 0.4736        | 14.0  | 3052  | 0.4737          | 0.7981 | 0.9755 | 0.9349 | -1.0      | 0.0411     | 0.8053    | 0.4378 | 0.8461 | 0.8529  | -1.0      | 0.0969     | 0.8595    | 0.8479      | 0.8891          | 0.7483 | 0.8167     |

| 0.4736        | 15.0  | 3270  | 0.4283          | 0.8069 | 0.9795 | 0.9315 | 0.0       | 0.0677     | 0.8154    | 0.4431 | 0.8546 | 0.864   | 0.0       | 0.1222     | 0.872     | 0.8486      | 0.9028          | 0.7651 | 0.8252     |

| 0.4736        | 16.0  | 3488  | 0.3926          | 0.8155 | 0.9871 | 0.9422 | -1.0      | 0.2416     | 0.8196    | 0.4471 | 0.8586 | 0.8695  | -1.0      | 0.4643     | 0.8726    | 0.8548      | 0.8985          | 0.7762 | 0.8404     |

| 0.4422        | 17.0  | 3706  | 0.3744          | 0.831  | 0.9837 | 0.9552 | -1.0      | 0.102      | 0.836     | 0.4535 | 0.872  | 0.8778  | -1.0      | 0.2192     | 0.8816    | 0.8738      | 0.9129          | 0.7882 | 0.8428     |

| 0.4422        | 18.0  | 3924  | 0.3688          | 0.8199 | 0.9879 | 0.9515 | -1.0      | 0.0956     | 0.8244    | 0.4481 | 0.8655 | 0.8716  | -1.0      | 0.2444     | 0.8742    | 0.8532      | 0.8972          | 0.7866 | 0.8461     |

| 0.3889        | 19.0  | 4142  | 0.3579          | 0.8291 | 0.9881 | 0.9546 | -1.0      | 0.1279     | 0.8348    | 0.4546 | 0.8706 | 0.8758  | -1.0      | 0.3321     | 0.8806    | 0.8664      | 0.9081          | 0.7918 | 0.8435     |

| 0.3889        | 20.0  | 4360  | 0.3596          | 0.8268 | 0.9879 | 0.9539 | -1.0      | 0.0657     | 0.8319    | 0.452  | 0.8688 | 0.8757  | -1.0      | 0.1958     | 0.8796    | 0.8594      | 0.9077          | 0.7942 | 0.8437     |

| 0.3854        | 21.0  | 4578  | 0.3641          | 0.8164 | 0.9883 | 0.957  | -1.0      | 0.1198     | 0.8209    | 0.4489 | 0.8648 | 0.87    | -1.0      | 0.25       | 0.8728    | 0.855       | 0.9016          | 0.7778 | 0.8384     |

| 0.3854        | 22.0  | 4796  | 0.3602          | 0.8292 | 0.9825 | 0.9497 | 0.0       | 0.0718     | 0.8384    | 0.4579 | 0.8728 | 0.8773  | 0.0       | 0.1353     | 0.8865    | 0.8728      | 0.9142          | 0.7856 | 0.8404     |

| 0.3614        | 23.0  | 5014  | 0.3371          | 0.8395 | 0.9884 | 0.9646 | -1.0      | 0.167      | 0.8439    | 0.4605 | 0.8805 | 0.8854  | -1.0      | 0.2571     | 0.8889    | 0.8739      | 0.9128          | 0.8052 | 0.8579     |

| 0.3614        | 24.0  | 5232  | 0.3107          | 0.8562 | 0.9885 | 0.9709 | -1.0      | 0.1207     | 0.8597    | 0.4687 | 0.8921 | 0.8939  | -1.0      | 0.1864     | 0.8978    | 0.8872      | 0.9186          | 0.8252 | 0.8693     |

| 0.3614        | 25.0  | 5450  | 0.3396          | 0.8385 | 0.9871 | 0.9637 | -1.0      | 0.1427     | 0.8446    | 0.4585 | 0.8829 | 0.8865  | -1.0      | 0.1929     | 0.8911    | 0.8617      | 0.9106          | 0.8154 | 0.8624     |

| 0.3569        | 26.0  | 5668  | 0.3009          | 0.8623 | 0.9891 | 0.9698 | 0.0       | 0.2157     | 0.8663    | 0.4701 | 0.8983 | 0.9013  | 0.0       | 0.405      | 0.9044    | 0.884       | 0.923           | 0.8406 | 0.8795     |

| 0.3569        | 27.0  | 5886  | 0.3325          | 0.8475 | 0.9884 | 0.9618 | -1.0      | 0.1365     | 0.8521    | 0.461  | 0.8847 | 0.8892  | -1.0      | 0.2        | 0.8941    | 0.874       | 0.9114          | 0.821  | 0.867      |

| 0.3422        | 28.0  | 6104  | 0.3232          | 0.8492 | 0.9882 | 0.9698 | -1.0      | 0.1485     | 0.8529    | 0.4626 | 0.8872 | 0.8898  | -1.0      | 0.2167     | 0.8935    | 0.8748      | 0.9142          | 0.8235 | 0.8653     |

| 0.3422        | 29.0  | 6322  | 0.2917          | 0.8636 | 0.9896 | 0.9683 | -1.0      | 0.1558     | 0.8685    | 0.4713 | 0.9005 | 0.9019  | -1.0      | 0.205      | 0.9053    | 0.8887      | 0.9265          | 0.8384 | 0.8773     |

| 0.3347        | 30.0  | 6540  | 0.3121          | 0.8589 | 0.987  | 0.9639 | -1.0      | 0.1297     | 0.8645    | 0.4665 | 0.8955 | 0.9005  | -1.0      | 0.2077     | 0.9047    | 0.8978      | 0.9336          | 0.8201 | 0.8674     |

| 0.3347        | 31.0  | 6758  | 0.2942          | 0.8659 | 0.9891 | 0.9767 | 0.0       | 0.1245     | 0.873     | 0.4677 | 0.8992 | 0.901   | 0.0       | 0.1942     | 0.9069    | 0.8982      | 0.9316          | 0.8336 | 0.8704     |

| 0.3347        | 32.0  | 6976  | 0.3047          | 0.8557 | 0.9894 | 0.9691 | -1.0      | 0.1579     | 0.8609    | 0.465  | 0.8922 | 0.8946  | -1.0      | 0.2179     | 0.8995    | 0.8783      | 0.9157          | 0.8332 | 0.8736     |

| 0.3228        | 33.0  | 7194  | 0.2833          | 0.8686 | 0.9897 | 0.9727 | -1.0      | 0.1756     | 0.8727    | 0.4723 | 0.9    | 0.9026  | -1.0      | 0.2545     | 0.9057    | 0.9023      | 0.934           | 0.8348 | 0.8712     |

| 0.3228        | 34.0  | 7412  | 0.2995          | 0.8595 | 0.9887 | 0.9688 | -1.0      | 0.1737     | 0.8654    | 0.4676 | 0.8958 | 0.898   | -1.0      | 0.2357     | 0.902     | 0.89        | 0.9253          | 0.829  | 0.8708     |

| 0.3032        | 35.0  | 7630  | 0.2869          | 0.8683 | 0.9881 | 0.9651 | -1.0      | 0.1214     | 0.8753    | 0.4693 | 0.9027 | 0.9053  | -1.0      | 0.1444     | 0.9123    | 0.9096      | 0.9398          | 0.8271 | 0.8708     |

| 0.3032        | 36.0  | 7848  | 0.2804          | 0.8665 | 0.9894 | 0.9706 | -1.0      | 0.1528     | 0.8698    | 0.4694 | 0.9031 | 0.9062  | -1.0      | 0.1955     | 0.91      | 0.8954      | 0.9294          | 0.8377 | 0.8829     |

| 0.3           | 37.0  | 8066  | 0.2992          | 0.866  | 0.9896 | 0.9782 | 0.0       | 0.1333     | 0.8738    | 0.4698 | 0.9035 | 0.9052  | 0.0       | 0.24       | 0.9112    | 0.8973      | 0.9305          | 0.8347 | 0.88       |

| 0.3           | 38.0  | 8284  | 0.2562          | 0.8803 | 0.9898 | 0.9797 | -1.0      | 0.2173     | 0.8837    | 0.478  | 0.9142 | 0.9155  | -1.0      | 0.3056     | 0.9176    | 0.8977      | 0.9315          | 0.8629 | 0.8994     |

| 0.2893        | 39.0  | 8502  | 0.2709          | 0.8733 | 0.9898 | 0.9719 | -1.0      | 0.1718     | 0.8776    | 0.4732 | 0.9073 | 0.9095  | -1.0      | 0.2567     | 0.9136    | 0.8913      | 0.927           | 0.8552 | 0.892      |

| 0.2893        | 40.0  | 8720  | 0.2424          | 0.892  | 0.9897 | 0.979  | -1.0      | 0.1628     | 0.8979    | 0.4806 | 0.9225 | 0.9252  | -1.0      | 0.2469     | 0.9298    | 0.9231      | 0.9501          | 0.8608 | 0.9002     |

| 0.2893        | 41.0  | 8938  | 0.2508          | 0.883  | 0.9898 | 0.9749 | -1.0      | 0.1155     | 0.889     | 0.4788 | 0.9133 | 0.9159  | -1.0      | 0.2188     | 0.9209    | 0.9115      | 0.9404          | 0.8545 | 0.8914     |

| 0.2777        | 42.0  | 9156  | 0.2580          | 0.8793 | 0.9896 | 0.9776 | -1.0      | 0.3268     | 0.8838    | 0.4754 | 0.912  | 0.9133  | -1.0      | 0.3462     | 0.9181    | 0.9021      | 0.9334          | 0.8565 | 0.8932     |

| 0.2777        | 43.0  | 9374  | 0.2493          | 0.8902 | 0.9898 | 0.9774 | -1.0      | 0.1308     | 0.8954    | 0.4786 | 0.9214 | 0.9236  | -1.0      | 0.2038     | 0.9281    | 0.9166      | 0.9459          | 0.8637 | 0.9013     |

| 0.2668        | 44.0  | 9592  | 0.2427          | 0.8852 | 0.9896 | 0.9778 | -1.0      | 0.1606     | 0.8902    | 0.4796 | 0.9195 | 0.921   | -1.0      | 0.25       | 0.9243    | 0.9118      | 0.9421          | 0.8586 | 0.9        |

| 0.2668        | 45.0  | 9810  | 0.2497          | 0.8915 | 0.9896 | 0.978  | 0.0       | 0.3372     | 0.8975    | 0.4804 | 0.9246 | 0.9265  | 0.0       | 0.4042     | 0.9314    | 0.9149      | 0.9473          | 0.8681 | 0.9058     |

| 0.2583        | 46.0  | 10028 | 0.2478          | 0.885  | 0.9894 | 0.9717 | 0.0       | 0.175      | 0.8912    | 0.4832 | 0.92   | 0.9217  | 0.0       | 0.2192     | 0.9265    | 0.9051      | 0.942           | 0.8648 | 0.9014     |

| 0.2583        | 47.0  | 10246 | 0.2415          | 0.8906 | 0.9897 | 0.977  | 0.0       | 0.2103     | 0.8947    | 0.4802 | 0.9215 | 0.9239  | 0.0       | 0.2917     | 0.9273    | 0.9163      | 0.948           | 0.8649 | 0.8998     |

| 0.2583        | 48.0  | 10464 | 0.2188          | 0.9019 | 0.99   | 0.9842 | -1.0      | 0.2088     | 0.9075    | 0.4849 | 0.9323 | 0.9335  | -1.0      | 0.2318     | 0.9371    | 0.9253      | 0.9557          | 0.8784 | 0.9114     |

| 0.2526        | 49.0  | 10682 | 0.2549          | 0.8903 | 0.9898 | 0.9762 | 0.0       | 0.3876     | 0.8955    | 0.4791 | 0.9225 | 0.9237  | 0.0       | 0.4367     | 0.9294    | 0.9192      | 0.9485          | 0.8614 | 0.8989     |

| 0.2526        | 50.0  | 10900 | 0.2444          | 0.8909 | 0.9893 | 0.9728 | -1.0      | 0.1661     | 0.8968    | 0.4779 | 0.9229 | 0.9247  | -1.0      | 0.3313     | 0.9303    | 0.9109      | 0.9438          | 0.871  | 0.9056     |

| 0.242         | 51.0  | 11118 | 0.2061          | 0.9086 | 0.9899 | 0.9841 | -1.0      | 0.2645     | 0.9143    | 0.4892 | 0.9393 | 0.9403  | -1.0      | 0.2944     | 0.9427    | 0.9296      | 0.9586          | 0.8875 | 0.9219     |

| 0.242         | 52.0  | 11336 | 0.2277          | 0.9027 | 0.9899 | 0.977  | -1.0      | 0.2558     | 0.9091    | 0.4853 | 0.9342 | 0.9364  | -1.0      | 0.3218     | 0.9415    | 0.9225      | 0.9541          | 0.883  | 0.9188     |

| 0.2273        | 53.0  | 11554 | 0.2193          | 0.9003 | 0.9899 | 0.9786 | -1.0      | 0.1985     | 0.9089    | 0.4863 | 0.9331 | 0.9336  | -1.0      | 0.2275     | 0.9399    | 0.9176      | 0.9497          | 0.883  | 0.9175     |

| 0.2273        | 54.0  | 11772 | 0.2055          | 0.9067 | 0.99   | 0.9843 | -1.0      | 0.2164     | 0.9123    | 0.4885 | 0.9383 | 0.9395  | -1.0      | 0.25       | 0.9434    | 0.9294      | 0.9582          | 0.884  | 0.9208     |

| 0.2273        | 55.0  | 11990 | 0.2014          | 0.9134 | 0.99   | 0.9861 | -1.0      | 0.3274     | 0.9161    | 0.4902 | 0.9436 | 0.9449  | -1.0      | 0.35       | 0.9468    | 0.9284      | 0.9572          | 0.8985 | 0.9327     |

| 0.234         | 56.0  | 12208 | 0.1938          | 0.9136 | 0.9894 | 0.9798 | 0.0       | 0.1319     | 0.9192    | 0.4944 | 0.9414 | 0.9432  | 0.0       | 0.15       | 0.9488    | 0.9362      | 0.9618          | 0.891  | 0.9245     |

| 0.234         | 57.0  | 12426 | 0.2148          | 0.9022 | 0.9899 | 0.9807 | -1.0      | 0.2163     | 0.9063    | 0.4852 | 0.934  | 0.9362  | -1.0      | 0.2269     | 0.9405    | 0.9152      | 0.9477          | 0.8891 | 0.9246     |

| 0.2155        | 58.0  | 12644 | 0.2112          | 0.9039 | 0.99   | 0.9846 | -1.0      | 0.1787     | 0.909     | 0.4887 | 0.9346 | 0.9357  | -1.0      | 0.2038     | 0.9402    | 0.9321      | 0.9596          | 0.8756 | 0.9117     |

| 0.2155        | 59.0  | 12862 | 0.1872          | 0.9218 | 0.99   | 0.9802 | 0.0       | 0.2209     | 0.9276    | 0.4941 | 0.9469 | 0.9484  | 0.0       | 0.255      | 0.9527    | 0.9366      | 0.9606          | 0.907  | 0.9362     |

| 0.2083        | 60.0  | 13080 | 0.1816          | 0.9239 | 0.9898 | 0.9836 | -1.0      | 0.2794     | 0.9255    | 0.4935 | 0.9506 | 0.9512  | -1.0      | 0.3        | 0.9539    | 0.9487      | 0.9701          | 0.899  | 0.9324     |

| 0.2083        | 61.0  | 13298 | 0.1873          | 0.9195 | 0.9899 | 0.9812 | -1.0      | 0.2767     | 0.9244    | 0.4946 | 0.9463 | 0.9476  | -1.0      | 0.3333     | 0.9506    | 0.9407      | 0.9636          | 0.8982 | 0.9316     |

| 0.2119        | 62.0  | 13516 | 0.1796          | 0.9246 | 0.9897 | 0.9834 | 0.0       | 0.1997     | 0.9286    | 0.4955 | 0.9509 | 0.952   | 0.0       | 0.2458     | 0.957     | 0.9383      | 0.9645          | 0.9109 | 0.9395     |

| 0.2119        | 63.0  | 13734 | 0.1725          | 0.9309 | 0.99   | 0.9843 | -1.0      | 0.2467     | 0.9362    | 0.4976 | 0.9557 | 0.9558  | -1.0      | 0.265      | 0.9589    | 0.9452      | 0.9678          | 0.9166 | 0.9438     |

| 0.2119        | 64.0  | 13952 | 0.1780          | 0.9334 | 0.99   | 0.9848 | 0.0       | 0.2257     | 0.9383    | 0.4992 | 0.9562 | 0.9569  | 0.0       | 0.2708     | 0.9616    | 0.9515      | 0.9701          | 0.9153 | 0.9438     |

| 0.1945        | 65.0  | 14170 | 0.1732          | 0.9324 | 0.99   | 0.9864 | -1.0      | 0.2813     | 0.9385    | 0.4984 | 0.9577 | 0.9582  | -1.0      | 0.3136     | 0.961     | 0.9476      | 0.9703          | 0.9173 | 0.9461     |

| 0.1945        | 66.0  | 14388 | 0.1703          | 0.9388 | 0.99   | 0.9866 | 0.0       | 0.3105     | 0.944     | 0.5006 | 0.9618 | 0.9623  | 0.0       | 0.3222     | 0.9664    | 0.9518      | 0.9729          | 0.9258 | 0.9517     |

| 0.1911        | 67.0  | 14606 | 0.1773          | 0.9314 | 0.9899 | 0.9791 | 0.0       | 0.2407     | 0.9368    | 0.4968 | 0.9523 | 0.9541  | 0.0       | 0.3385     | 0.958     | 0.9479      | 0.9673          | 0.9149 | 0.941      |

| 0.1911        | 68.0  | 14824 | 0.1742          | 0.9309 | 0.99   | 0.9831 | 0.0       | 0.213      | 0.9385    | 0.4981 | 0.9554 | 0.9561  | 0.0       | 0.2767     | 0.9608    | 0.9422      | 0.9657          | 0.9195 | 0.9464     |

| 0.1827        | 69.0  | 15042 | 0.1525          | 0.9428 | 0.99   | 0.9894 | -1.0      | 0.2571     | 0.9482    | 0.5015 | 0.9645 | 0.965   | -1.0      | 0.3        | 0.9687    | 0.9544      | 0.9751          | 0.9312 | 0.9549     |

| 0.1827        | 70.0  | 15260 | 0.1644          | 0.9357 | 0.9899 | 0.9848 | -1.0      | 0.2394     | 0.9413    | 0.4985 | 0.9558 | 0.9574  | -1.0      | 0.2536     | 0.9617    | 0.9511      | 0.9709          | 0.9202 | 0.9439     |

| 0.1827        | 71.0  | 15478 | 0.1531          | 0.9415 | 0.99   | 0.9845 | -1.0      | 0.2432     | 0.9481    | 0.503  | 0.9627 | 0.9636  | -1.0      | 0.3393     | 0.9679    | 0.9562      | 0.9749          | 0.9268 | 0.9524     |

| 0.1777        | 72.0  | 15696 | 0.1636          | 0.9426 | 0.99   | 0.987  | -1.0      | 0.2772     | 0.9439    | 0.4987 | 0.9623 | 0.9631  | -1.0      | 0.2923     | 0.9667    | 0.9579      | 0.9732          | 0.9274 | 0.953      |

| 0.1777        | 73.0  | 15914 | 0.1516          | 0.9423 | 0.99   | 0.9846 | 0.0       | 0.2665     | 0.9485    | 0.5022 | 0.9621 | 0.9627  | 0.0       | 0.29       | 0.9673    | 0.956       | 0.9731          | 0.9285 | 0.9523     |

| 0.1838        | 74.0  | 16132 | 0.1448          | 0.9465 | 0.995  | 0.9846 | -1.0      | 0.5659     | 0.9492    | 0.503  | 0.9665 | 0.9668  | -1.0      | 0.6182     | 0.969     | 0.9629      | 0.9776          | 0.9301 | 0.956      |

| 0.1838        | 75.0  | 16350 | 0.1681          | 0.9385 | 0.9897 | 0.9827 | -1.0      | 0.2587     | 0.9407    | 0.5007 | 0.9609 | 0.9617  | -1.0      | 0.4722     | 0.9642    | 0.9564      | 0.9743          | 0.9205 | 0.949      |

| 0.1775        | 76.0  | 16568 | 0.1469          | 0.9461 | 0.9899 | 0.9817 | -1.0      | 0.1993     | 0.9536    | 0.5029 | 0.9631 | 0.9643  | -1.0      | 0.2706     | 0.9692    | 0.956       | 0.9722          | 0.9362 | 0.9564     |

| 0.1775        | 77.0  | 16786 | 0.1396          | 0.953  | 0.99   | 0.9819 | -1.0      | 0.213      | 0.9618    | 0.5051 | 0.9699 | 0.971   | -1.0      | 0.2735     | 0.9759    | 0.9674      | 0.9805          | 0.9385 | 0.9615     |

| 0.171         | 78.0  | 17004 | 0.1364          | 0.9536 | 0.9901 | 0.9896 | 0.0       | 0.3345     | 0.9582    | 0.5062 | 0.972  | 0.9723  | 0.0       | 0.3722     | 0.9747    | 0.9615      | 0.9783          | 0.9457 | 0.9663     |

| 0.171         | 79.0  | 17222 | 0.1586          | 0.9394 | 0.9947 | 0.9835 | -1.0      | 0.5025     | 0.943     | 0.5013 | 0.9608 | 0.9623  | -1.0      | 0.5875     | 0.9658    | 0.9554      | 0.9731          | 0.9233 | 0.9515     |

| 0.171         | 80.0  | 17440 | 0.1417          | 0.9494 | 0.9901 | 0.9805 | -1.0      | 0.2141     | 0.9565    | 0.5041 | 0.9656 | 0.9671  | -1.0      | 0.2429     | 0.9718    | 0.9601      | 0.9762          | 0.9386 | 0.9581     |

| 0.1642        | 81.0  | 17658 | 0.1303          | 0.9573 | 0.9901 | 0.9847 | -1.0      | 0.2475     | 0.963     | 0.5064 | 0.9724 | 0.9729  | -1.0      | 0.2875     | 0.977     | 0.9656      | 0.9787          | 0.949  | 0.9671     |

| 0.1642        | 82.0  | 17876 | 0.1348          | 0.9499 | 0.9901 | 0.9849 | -1.0      | 0.2481     | 0.9571    | 0.5046 | 0.9701 | 0.9702  | -1.0      | 0.2679     | 0.9745    | 0.9607      | 0.9787          | 0.9391 | 0.9618     |

| 0.1573        | 83.0  | 18094 | 0.1325          | 0.9511 | 0.9901 | 0.9838 | -1.0      | 0.2714     | 0.9552    | 0.504  | 0.97   | 0.9705  | -1.0      | 0.3167     | 0.9735    | 0.9609      | 0.9786          | 0.9413 | 0.9623     |

| 0.1573        | 84.0  | 18312 | 0.1255          | 0.9585 | 0.99   | 0.9849 | 0.0       | 0.2656     | 0.9656    | 0.5069 | 0.9733 | 0.9738  | 0.0       | 0.2929     | 0.9783    | 0.9668      | 0.9807          | 0.9502 | 0.9669     |

| 0.1437        | 85.0  | 18530 | 0.1481          | 0.9479 | 0.99   | 0.9848 | -1.0      | 0.2646     | 0.9525    | 0.5027 | 0.9653 | 0.9663  | -1.0      | 0.2692     | 0.9702    | 0.9578      | 0.9738          | 0.938  | 0.9587     |

| 0.1437        | 86.0  | 18748 | 0.1236          | 0.9539 | 0.99   | 0.985  | -1.0      | 0.3818     | 0.959     | 0.507  | 0.9717 | 0.9723  | -1.0      | 0.3955     | 0.9741    | 0.9652      | 0.9803          | 0.9425 | 0.9643     |

| 0.1437        | 87.0  | 18966 | 0.1293          | 0.9595 | 0.99   | 0.9848 | 0.0       | 0.3046     | 0.9663    | 0.5059 | 0.9736 | 0.9745  | 0.0       | 0.43       | 0.9797    | 0.9698      | 0.9815          | 0.9492 | 0.9676     |

| 0.1532        | 88.0  | 19184 | 0.1295          | 0.9525 | 0.9901 | 0.9891 | 0.0       | 0.3118     | 0.9579    | 0.5054 | 0.9727 | 0.9727  | 0.0       | 0.3385     | 0.9762    | 0.9591      | 0.9785          | 0.9458 | 0.9669     |

| 0.1532        | 89.0  | 19402 | 0.1317          | 0.9556 | 0.99   | 0.9844 | -1.0      | 0.2569     | 0.9589    | 0.5052 | 0.9708 | 0.9714  | -1.0      | 0.2792     | 0.975     | 0.9644      | 0.9779          | 0.9468 | 0.965      |

| 0.1465        | 90.0  | 19620 | 0.1216          | 0.9555 | 0.99   | 0.9855 | -1.0      | 0.4916     | 0.9614    | 0.5068 | 0.9751 | 0.9756  | -1.0      | 0.5125     | 0.9777    | 0.9625      | 0.9799          | 0.9484 | 0.9713     |

| 0.1465        | 91.0  | 19838 | 0.1357          | 0.953  | 0.9901 | 0.985  | 0.0       | 0.3426     | 0.956     | 0.503  | 0.9694 | 0.9705  | 0.0       | 0.42       | 0.9738    | 0.9611      | 0.9757          | 0.945  | 0.9653     |

| 0.145         | 92.0  | 20056 | 0.1242          | 0.9582 | 0.9901 | 0.9898 | -1.0      | 0.2929     | 0.9627    | 0.5062 | 0.9742 | 0.9751  | -1.0      | 0.3583     | 0.9776    | 0.9652      | 0.9783          | 0.9511 | 0.9718     |

| 0.145         | 93.0  | 20274 | 0.1320          | 0.956  | 0.99   | 0.9843 | -1.0      | 0.2826     | 0.9601    | 0.505  | 0.9713 | 0.9724  | -1.0      | 0.3273     | 0.9751    | 0.9664      | 0.9801          | 0.9455 | 0.9647     |

| 0.145         | 94.0  | 20492 | 0.1276          | 0.9608 | 0.9898 | 0.9819 | -1.0      | 0.3052     | 0.966     | 0.5045 | 0.9746 | 0.9759  | -1.0      | 0.3583     | 0.9784    | 0.9672      | 0.9805          | 0.9544 | 0.9713     |

| 0.1454        | 95.0  | 20710 | 0.1237          | 0.957  | 0.99   | 0.9845 | 0.0       | 0.2527     | 0.9641    | 0.5058 | 0.9743 | 0.9744  | 0.0       | 0.275      | 0.9787    | 0.9628      | 0.9799          | 0.9512 | 0.9689     |

| 0.1454        | 96.0  | 20928 | 0.1234          | 0.9622 | 0.99   | 0.9858 | 0.0       | 0.3156     | 0.9678    | 0.5072 | 0.977  | 0.9775  | 0.0       | 0.3318     | 0.9808    | 0.9721      | 0.984           | 0.9523 | 0.9709     |

| 0.1517        | 97.0  | 21146 | 0.1255          | 0.9527 | 0.9901 | 0.9846 | -1.0      | 0.295      | 0.9576    | 0.505  | 0.9714 | 0.972   | -1.0      | 0.3036     | 0.9756    | 0.9634      | 0.9797          | 0.942  | 0.9643     |

| 0.1517        | 98.0  | 21364 | 0.1348          | 0.9501 | 0.9897 | 0.9805 | 0.0       | 0.2548     | 0.9558    | 0.5031 | 0.9665 | 0.9677  | 0.0       | 0.3833     | 0.9716    | 0.9594      | 0.9753          | 0.9408 | 0.9601     |

| 0.1435        | 99.0  | 21582 | 0.1255          | 0.9609 | 0.99   | 0.9855 | -1.0      | 0.3144     | 0.9644    | 0.5077 | 0.9749 | 0.9761  | -1.0      | 0.4125     | 0.9794    | 0.9688      | 0.9818          | 0.953  | 0.9705     |

| 0.1435        | 100.0 | 21800 | 0.1272          | 0.9568 | 0.99   | 0.9848 | -1.0      | 0.3143     | 0.9595    | 0.5045 | 0.9717 | 0.9726  | -1.0      | 0.3385     | 0.9755    | 0.9619      | 0.9762          | 0.9517 | 0.9689     |





### Framework versions



- Transformers 4.42.3

- Pytorch 2.3.1+cu121

- Datasets 2.20.0

- Tokenizers 0.19.1