File size: 24,558 Bytes
75542dd
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
fc1e342
 
 
 
75542dd
fc1e342
 
 
 
 
75542dd
fc1e342
 
75542dd
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
fc1e342
75542dd
 
 
9ab14c5
 
fc1e342
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
75542dd
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
---
license: apache-2.0
base_model: microsoft/conditional-detr-resnet-50
tags:
- generated_from_trainer
datasets:
- imagefolder
model-index:
- name: ms_detr_finetuned_diana
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ms_detr_finetuned_diana

This model is a fine-tuned version of [microsoft/conditional-detr-resnet-50](https://huggingface.co/microsoft/conditional-detr-resnet-50) on the imagefolder dataset.
It achieves the following results on the evaluation set:
- Loss: 0.3617
- Map: 0.6874
- Map 50: 0.789
- Map 75: 0.7871
- Map Small: -1.0
- Map Medium: 0.7147
- Map Large: 0.6892
- Mar 1: 0.0969
- Mar 10: 0.7163
- Mar 100: 0.7819
- Mar Small: -1.0
- Mar Medium: 0.75
- Mar Large: 0.7947
- Map Per Class: -1.0
- Mar 100 Per Class: -1.0
- Classes: 0

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- num_epochs: 100

### Training results

| Training Loss | Epoch | Step | Validation Loss | Map    | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1  | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Per Class | Mar 100 Per Class | Classes |
|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:-------------:|:-----------------:|:-------:|
| 2.892         | 1.0   | 10   | 2.2713          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 1.717         | 2.0   | 20   | 1.6999          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 1.5162        | 3.0   | 30   | 1.4320          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 1.3622        | 4.0   | 40   | 1.2202          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 1.1926        | 5.0   | 50   | 1.1617          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 1.2362        | 6.0   | 60   | 1.1772          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 1.3114        | 7.0   | 70   | 1.0437          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 1.1188        | 8.0   | 80   | 0.9656          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 0.9169        | 9.0   | 90   | 0.8787          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 0.7998        | 10.0  | 100  | 0.7928          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 0.7385        | 11.0  | 110  | 0.6800          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 0.6697        | 12.0  | 120  | 0.6025          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 0.4984        | 13.0  | 130  | 0.5722          | 0.0    | 0.0    | 0.0    | -1.0      | 0.0        | 0.0       | 0.0    | 0.0    | 0.0     | -1.0      | 0.0        | 0.0       | -1.0          | -1.0              | 0       |
| 0.5245        | 14.0  | 140  | 0.5460          | 0.0079 | 0.0099 | 0.0099 | -1.0      | 0.0238     | 0.0       | 0.005  | 0.005  | 0.005   | -1.0      | 0.0174     | 0.0       | -1.0          | -1.0              | 0       |
| 0.3993        | 15.0  | 150  | 0.5030          | 0.0168 | 0.0198 | 0.0198 | -1.0      | 0.0267     | 0.0079    | 0.0106 | 0.0106 | 0.0106  | -1.0      | 0.0196     | 0.007     | -1.0          | -1.0              | 0       |
| 0.4789        | 16.0  | 160  | 0.4662          | 0.2283 | 0.2665 | 0.2665 | -1.0      | 0.1539     | 0.2598    | 0.0794 | 0.2438 | 0.2438  | -1.0      | 0.1543     | 0.2798    | -1.0          | -1.0              | 0       |
| 0.5485        | 17.0  | 170  | 0.4586          | 0.2041 | 0.2369 | 0.2369 | -1.0      | 0.1679     | 0.2202    | 0.0731 | 0.2175 | 0.2175  | -1.0      | 0.1717     | 0.236     | -1.0          | -1.0              | 0       |
| 0.3419        | 18.0  | 180  | 0.4637          | 0.3674 | 0.4292 | 0.4292 | -1.0      | 0.2666     | 0.4049    | 0.0856 | 0.3994 | 0.3994  | -1.0      | 0.2696     | 0.4518    | -1.0          | -1.0              | 0       |
| 0.4885        | 19.0  | 190  | 0.5509          | 0.4468 | 0.5407 | 0.5314 | -1.0      | 0.354      | 0.4898    | 0.0925 | 0.5156 | 0.5156  | -1.0      | 0.3761     | 0.5719    | -1.0          | -1.0              | 0       |
| 0.3336        | 20.0  | 200  | 0.5122          | 0.1809 | 0.2149 | 0.2149 | -1.0      | 0.0802     | 0.2257    | 0.0763 | 0.195  | 0.195   | -1.0      | 0.0783     | 0.2421    | -1.0          | -1.0              | 0       |
| 0.3471        | 21.0  | 210  | 0.4619          | 0.4291 | 0.519  | 0.519  | -1.0      | 0.3115     | 0.4787    | 0.0906 | 0.465  | 0.4706  | -1.0      | 0.3174     | 0.5325    | -1.0          | -1.0              | 0       |
| 0.3953        | 22.0  | 220  | 0.4313          | 0.4938 | 0.5927 | 0.581  | -1.0      | 0.3728     | 0.5476    | 0.0887 | 0.5319 | 0.5437  | -1.0      | 0.3891     | 0.6061    | -1.0          | -1.0              | 0       |
| 0.5373        | 23.0  | 230  | 0.4308          | 0.5264 | 0.6339 | 0.623  | -1.0      | 0.4223     | 0.5733    | 0.0938 | 0.5744 | 0.5894  | -1.0      | 0.4391     | 0.65      | -1.0          | -1.0              | 0       |
| 0.3092        | 24.0  | 240  | 0.4193          | 0.5561 | 0.6661 | 0.6571 | -1.0      | 0.4775     | 0.5927    | 0.0944 | 0.5844 | 0.6169  | -1.0      | 0.5022     | 0.6632    | -1.0          | -1.0              | 0       |
| 0.477         | 25.0  | 250  | 0.4125          | 0.41   | 0.4769 | 0.4769 | -1.0      | 0.3283     | 0.4467    | 0.1006 | 0.4387 | 0.4487  | -1.0      | 0.3348     | 0.4947    | -1.0          | -1.0              | 0       |
| 0.3867        | 26.0  | 260  | 0.4114          | 0.6146 | 0.743  | 0.7168 | -1.0      | 0.6036     | 0.6294    | 0.0938 | 0.6381 | 0.6981  | -1.0      | 0.6304     | 0.7254    | -1.0          | -1.0              | 0       |
| 0.3658        | 27.0  | 270  | 0.4001          | 0.6643 | 0.7856 | 0.7727 | -1.0      | 0.6505     | 0.6817    | 0.1    | 0.6787 | 0.7456  | -1.0      | 0.6935     | 0.7667    | -1.0          | -1.0              | 0       |
| 0.3053        | 28.0  | 280  | 0.4282          | 0.5218 | 0.6326 | 0.6201 | -1.0      | 0.4163     | 0.5676    | 0.095  | 0.5631 | 0.5844  | -1.0      | 0.4261     | 0.6482    | -1.0          | -1.0              | 0       |
| 0.3105        | 29.0  | 290  | 0.4398          | 0.6187 | 0.7567 | 0.7331 | -1.0      | 0.6045     | 0.6336    | 0.0919 | 0.6413 | 0.6944  | -1.0      | 0.6478     | 0.7132    | -1.0          | -1.0              | 0       |
| 0.3713        | 30.0  | 300  | 0.4202          | 0.5643 | 0.6683 | 0.6673 | -1.0      | 0.4959     | 0.5996    | 0.0931 | 0.5969 | 0.6306  | -1.0      | 0.5348     | 0.6693    | -1.0          | -1.0              | 0       |
| 0.2874        | 31.0  | 310  | 0.4018          | 0.6327 | 0.7547 | 0.7357 | -1.0      | 0.5647     | 0.6713    | 0.0981 | 0.6575 | 0.715   | -1.0      | 0.5957     | 0.7632    | -1.0          | -1.0              | 0       |
| 0.2809        | 32.0  | 320  | 0.4007          | 0.6444 | 0.7618 | 0.7412 | -1.0      | 0.6189     | 0.667     | 0.1013 | 0.6694 | 0.7381  | -1.0      | 0.6587     | 0.7702    | -1.0          | -1.0              | 0       |
| 0.2801        | 33.0  | 330  | 0.4528          | 0.6125 | 0.7386 | 0.727  | -1.0      | 0.5399     | 0.6519    | 0.0938 | 0.6338 | 0.6994  | -1.0      | 0.5739     | 0.75      | -1.0          | -1.0              | 0       |
| 0.3484        | 34.0  | 340  | 0.4233          | 0.6226 | 0.7505 | 0.7381 | -1.0      | 0.6268     | 0.642     | 0.0988 | 0.64   | 0.7194  | -1.0      | 0.6543     | 0.7456    | -1.0          | -1.0              | 0       |
| 0.3591        | 35.0  | 350  | 0.4156          | 0.6475 | 0.759  | 0.7576 | -1.0      | 0.6733     | 0.6536    | 0.095  | 0.6712 | 0.74    | -1.0      | 0.7065     | 0.7535    | -1.0          | -1.0              | 0       |
| 0.2204        | 36.0  | 360  | 0.4363          | 0.5723 | 0.6577 | 0.6577 | -1.0      | 0.548      | 0.5962    | 0.0956 | 0.6112 | 0.6456  | -1.0      | 0.5717     | 0.6754    | -1.0          | -1.0              | 0       |
| 0.3912        | 37.0  | 370  | 0.4261          | 0.6855 | 0.8128 | 0.8032 | -1.0      | 0.6777     | 0.7012    | 0.1006 | 0.7063 | 0.7806  | -1.0      | 0.7217     | 0.8044    | -1.0          | -1.0              | 0       |
| 0.3377        | 38.0  | 380  | 0.4260          | 0.6743 | 0.7969 | 0.7847 | -1.0      | 0.6147     | 0.7086    | 0.1025 | 0.69   | 0.7444  | -1.0      | 0.6413     | 0.786     | -1.0          | -1.0              | 0       |
| 0.3047        | 39.0  | 390  | 0.4211          | 0.6519 | 0.7793 | 0.7647 | -1.0      | 0.6241     | 0.6742    | 0.1006 | 0.6681 | 0.7175  | -1.0      | 0.6457     | 0.7465    | -1.0          | -1.0              | 0       |
| 0.2563        | 40.0  | 400  | 0.4313          | 0.6441 | 0.769  | 0.769  | -1.0      | 0.724      | 0.6211    | 0.1006 | 0.6669 | 0.7275  | -1.0      | 0.7543     | 0.7167    | -1.0          | -1.0              | 0       |
| 0.3127        | 41.0  | 410  | 0.4297          | 0.5739 | 0.6679 | 0.6593 | -1.0      | 0.5456     | 0.5969    | 0.0975 | 0.5987 | 0.6438  | -1.0      | 0.563      | 0.6763    | -1.0          | -1.0              | 0       |
| 0.2782        | 42.0  | 420  | 0.4133          | 0.6234 | 0.7267 | 0.7179 | -1.0      | 0.6279     | 0.6346    | 0.0962 | 0.6394 | 0.7019  | -1.0      | 0.6457     | 0.7246    | -1.0          | -1.0              | 0       |
| 0.2965        | 43.0  | 430  | 0.4304          | 0.5708 | 0.684  | 0.664  | -1.0      | 0.5152     | 0.6021    | 0.0938 | 0.6225 | 0.6538  | -1.0      | 0.5326     | 0.7026    | -1.0          | -1.0              | 0       |
| 0.2599        | 44.0  | 440  | 0.4240          | 0.6451 | 0.7575 | 0.7445 | -1.0      | 0.67       | 0.6528    | 0.0975 | 0.6762 | 0.7506  | -1.0      | 0.6978     | 0.7719    | -1.0          | -1.0              | 0       |
| 0.2821        | 45.0  | 450  | 0.4361          | 0.695  | 0.8218 | 0.796  | -1.0      | 0.7193     | 0.6945    | 0.0969 | 0.7287 | 0.79    | -1.0      | 0.7587     | 0.8026    | -1.0          | -1.0              | 0       |
| 0.3117        | 46.0  | 460  | 0.4164          | 0.7032 | 0.8334 | 0.8051 | -1.0      | 0.7114     | 0.7094    | 0.1019 | 0.7331 | 0.7925  | -1.0      | 0.7391     | 0.814     | -1.0          | -1.0              | 0       |
| 0.2484        | 47.0  | 470  | 0.4007          | 0.6757 | 0.7805 | 0.7805 | -1.0      | 0.7268     | 0.6714    | 0.1037 | 0.7088 | 0.7656  | -1.0      | 0.7543     | 0.7702    | -1.0          | -1.0              | 0       |
| 0.3059        | 48.0  | 480  | 0.4269          | 0.651  | 0.7539 | 0.7496 | -1.0      | 0.599      | 0.6866    | 0.0956 | 0.6819 | 0.7294  | -1.0      | 0.6174     | 0.7746    | -1.0          | -1.0              | 0       |
| 0.2492        | 49.0  | 490  | 0.3877          | 0.6452 | 0.7506 | 0.7277 | -1.0      | 0.6343     | 0.6624    | 0.09   | 0.6794 | 0.7244  | -1.0      | 0.6565     | 0.7518    | -1.0          | -1.0              | 0       |
| 0.3828        | 50.0  | 500  | 0.4237          | 0.6721 | 0.7953 | 0.7744 | -1.0      | 0.7174     | 0.6672    | 0.0887 | 0.7056 | 0.7606  | -1.0      | 0.75       | 0.7649    | -1.0          | -1.0              | 0       |
| 0.2737        | 51.0  | 510  | 0.3713          | 0.6619 | 0.7594 | 0.7453 | -1.0      | 0.6988     | 0.6615    | 0.0925 | 0.6919 | 0.7419  | -1.0      | 0.7283     | 0.7474    | -1.0          | -1.0              | 0       |
| 0.3283        | 52.0  | 520  | 0.3737          | 0.6298 | 0.7286 | 0.7254 | -1.0      | 0.6199     | 0.6431    | 0.0894 | 0.6575 | 0.7019  | -1.0      | 0.6478     | 0.7237    | -1.0          | -1.0              | 0       |
| 0.2819        | 53.0  | 530  | 0.4077          | 0.6919 | 0.8094 | 0.8004 | -1.0      | 0.7656     | 0.6797    | 0.0894 | 0.7106 | 0.7831  | -1.0      | 0.7978     | 0.7772    | -1.0          | -1.0              | 0       |
| 0.2533        | 54.0  | 540  | 0.4056          | 0.7032 | 0.8249 | 0.8045 | -1.0      | 0.724      | 0.7105    | 0.0962 | 0.7381 | 0.7962  | -1.0      | 0.7522     | 0.814     | -1.0          | -1.0              | 0       |
| 0.3408        | 55.0  | 550  | 0.3916          | 0.667  | 0.771  | 0.7591 | -1.0      | 0.6257     | 0.6997    | 0.0969 | 0.6913 | 0.7356  | -1.0      | 0.65       | 0.7702    | -1.0          | -1.0              | 0       |
| 0.2069        | 56.0  | 560  | 0.3931          | 0.7054 | 0.8197 | 0.7998 | -1.0      | 0.7399     | 0.7061    | 0.0962 | 0.7188 | 0.785   | -1.0      | 0.7652     | 0.793     | -1.0          | -1.0              | 0       |
| 0.2572        | 57.0  | 570  | 0.4012          | 0.6993 | 0.8117 | 0.7932 | -1.0      | 0.729      | 0.699     | 0.1025 | 0.7275 | 0.7862  | -1.0      | 0.7609     | 0.7965    | -1.0          | -1.0              | 0       |
| 0.1786        | 58.0  | 580  | 0.3830          | 0.7114 | 0.8231 | 0.8047 | -1.0      | 0.7666     | 0.7065    | 0.0975 | 0.7325 | 0.8056  | -1.0      | 0.7935     | 0.8105    | -1.0          | -1.0              | 0       |
| 0.2185        | 59.0  | 590  | 0.3609          | 0.705  | 0.8153 | 0.806  | -1.0      | 0.7388     | 0.6997    | 0.0919 | 0.7194 | 0.7912  | -1.0      | 0.7783     | 0.7965    | -1.0          | -1.0              | 0       |
| 0.2219        | 60.0  | 600  | 0.3783          | 0.7086 | 0.8241 | 0.8092 | -1.0      | 0.7106     | 0.7192    | 0.0969 | 0.74   | 0.805   | -1.0      | 0.7391     | 0.8316    | -1.0          | -1.0              | 0       |
| 0.3003        | 61.0  | 610  | 0.4098          | 0.7118 | 0.8178 | 0.8085 | -1.0      | 0.7534     | 0.7084    | 0.0919 | 0.7394 | 0.8138  | -1.0      | 0.7891     | 0.8237    | -1.0          | -1.0              | 0       |
| 0.3144        | 62.0  | 620  | 0.4339          | 0.6867 | 0.7967 | 0.7794 | -1.0      | 0.7074     | 0.6913    | 0.0894 | 0.7294 | 0.7875  | -1.0      | 0.7435     | 0.8053    | -1.0          | -1.0              | 0       |
| 0.2323        | 63.0  | 630  | 0.4086          | 0.6733 | 0.7901 | 0.7787 | -1.0      | 0.692      | 0.6792    | 0.0944 | 0.715  | 0.7719  | -1.0      | 0.7239     | 0.7912    | -1.0          | -1.0              | 0       |
| 0.3114        | 64.0  | 640  | 0.3946          | 0.6801 | 0.7905 | 0.7658 | -1.0      | 0.6803     | 0.6931    | 0.0981 | 0.7188 | 0.7713  | -1.0      | 0.7043     | 0.7982    | -1.0          | -1.0              | 0       |
| 0.2579        | 65.0  | 650  | 0.3899          | 0.6658 | 0.7882 | 0.7637 | -1.0      | 0.6463     | 0.6861    | 0.0988 | 0.7013 | 0.7613  | -1.0      | 0.6739     | 0.7965    | -1.0          | -1.0              | 0       |
| 0.2312        | 66.0  | 660  | 0.3816          | 0.6567 | 0.7604 | 0.7548 | -1.0      | 0.6226     | 0.6793    | 0.0969 | 0.6919 | 0.7506  | -1.0      | 0.6478     | 0.7921    | -1.0          | -1.0              | 0       |
| 0.209         | 67.0  | 670  | 0.3967          | 0.699  | 0.8281 | 0.7953 | -1.0      | 0.7061     | 0.7074    | 0.0906 | 0.7394 | 0.7994  | -1.0      | 0.7348     | 0.8254    | -1.0          | -1.0              | 0       |
| 0.3113        | 68.0  | 680  | 0.4126          | 0.6991 | 0.8308 | 0.7838 | -1.0      | 0.7222     | 0.6999    | 0.0962 | 0.7337 | 0.7994  | -1.0      | 0.7522     | 0.8184    | -1.0          | -1.0              | 0       |
| 0.2045        | 69.0  | 690  | 0.4276          | 0.703  | 0.8227 | 0.7956 | -1.0      | 0.7344     | 0.7016    | 0.0838 | 0.735  | 0.8006  | -1.0      | 0.7652     | 0.8149    | -1.0          | -1.0              | 0       |
| 0.2002        | 70.0  | 700  | 0.4094          | 0.6843 | 0.7886 | 0.7836 | -1.0      | 0.6975     | 0.6908    | 0.0919 | 0.7175 | 0.7788  | -1.0      | 0.7239     | 0.8009    | -1.0          | -1.0              | 0       |
| 0.2065        | 71.0  | 710  | 0.4052          | 0.7065 | 0.8196 | 0.8056 | -1.0      | 0.7149     | 0.7146    | 0.0981 | 0.7337 | 0.8     | -1.0      | 0.7457     | 0.8219    | -1.0          | -1.0              | 0       |
| 0.2716        | 72.0  | 720  | 0.4000          | 0.7039 | 0.8294 | 0.8059 | -1.0      | 0.7229     | 0.7079    | 0.0956 | 0.7344 | 0.7987  | -1.0      | 0.7522     | 0.8175    | -1.0          | -1.0              | 0       |
| 0.2935        | 73.0  | 730  | 0.3905          | 0.652  | 0.7532 | 0.7475 | -1.0      | 0.6084     | 0.6786    | 0.0906 | 0.7038 | 0.7525  | -1.0      | 0.6326     | 0.8009    | -1.0          | -1.0              | 0       |
| 0.2137        | 74.0  | 740  | 0.3959          | 0.627  | 0.7307 | 0.725  | -1.0      | 0.6212     | 0.6476    | 0.0906 | 0.6794 | 0.7312  | -1.0      | 0.6522     | 0.7632    | -1.0          | -1.0              | 0       |
| 0.2075        | 75.0  | 750  | 0.3786          | 0.6542 | 0.769  | 0.7535 | -1.0      | 0.659      | 0.6667    | 0.0906 | 0.71   | 0.7619  | -1.0      | 0.6913     | 0.7904    | -1.0          | -1.0              | 0       |
| 0.1713        | 76.0  | 760  | 0.3836          | 0.6695 | 0.7851 | 0.7703 | -1.0      | 0.6683     | 0.6859    | 0.0906 | 0.7138 | 0.7781  | -1.0      | 0.7065     | 0.807     | -1.0          | -1.0              | 0       |
| 0.2233        | 77.0  | 770  | 0.3947          | 0.6659 | 0.775  | 0.7694 | -1.0      | 0.714      | 0.6616    | 0.0913 | 0.705  | 0.7763  | -1.0      | 0.7543     | 0.7851    | -1.0          | -1.0              | 0       |
| 0.2398        | 78.0  | 780  | 0.3835          | 0.6854 | 0.7997 | 0.7883 | -1.0      | 0.7067     | 0.6903    | 0.0906 | 0.7212 | 0.785   | -1.0      | 0.7391     | 0.8035    | -1.0          | -1.0              | 0       |
| 0.1906        | 79.0  | 790  | 0.3811          | 0.6901 | 0.8028 | 0.7974 | -1.0      | 0.7128     | 0.6948    | 0.0956 | 0.7231 | 0.7931  | -1.0      | 0.7478     | 0.8114    | -1.0          | -1.0              | 0       |
| 0.1823        | 80.0  | 800  | 0.3831          | 0.6721 | 0.7821 | 0.7709 | -1.0      | 0.7005     | 0.6764    | 0.0906 | 0.7094 | 0.775   | -1.0      | 0.737      | 0.7904    | -1.0          | -1.0              | 0       |
| 0.2266        | 81.0  | 810  | 0.3831          | 0.6973 | 0.8131 | 0.8007 | -1.0      | 0.6966     | 0.7103    | 0.0969 | 0.7319 | 0.7969  | -1.0      | 0.7326     | 0.8228    | -1.0          | -1.0              | 0       |
| 0.1812        | 82.0  | 820  | 0.3809          | 0.6934 | 0.8057 | 0.7933 | -1.0      | 0.6984     | 0.707     | 0.0962 | 0.7262 | 0.7919  | -1.0      | 0.7348     | 0.8149    | -1.0          | -1.0              | 0       |
| 0.1811        | 83.0  | 830  | 0.3820          | 0.6836 | 0.7953 | 0.7829 | -1.0      | 0.6797     | 0.7021    | 0.0969 | 0.7156 | 0.7819  | -1.0      | 0.7087     | 0.8114    | -1.0          | -1.0              | 0       |
| 0.1677        | 84.0  | 840  | 0.3851          | 0.6809 | 0.7891 | 0.7759 | -1.0      | 0.6854     | 0.6942    | 0.0962 | 0.7163 | 0.7763  | -1.0      | 0.7109     | 0.8026    | -1.0          | -1.0              | 0       |
| 0.159         | 85.0  | 850  | 0.3791          | 0.6802 | 0.7889 | 0.7765 | -1.0      | 0.6799     | 0.6954    | 0.0962 | 0.715  | 0.775   | -1.0      | 0.7087     | 0.8018    | -1.0          | -1.0              | 0       |
| 0.1646        | 86.0  | 860  | 0.3712          | 0.6856 | 0.7903 | 0.7785 | -1.0      | 0.6683     | 0.7073    | 0.0975 | 0.7212 | 0.7788  | -1.0      | 0.6978     | 0.8114    | -1.0          | -1.0              | 0       |
| 0.1618        | 87.0  | 870  | 0.3736          | 0.6817 | 0.7861 | 0.7753 | -1.0      | 0.7037     | 0.6883    | 0.0969 | 0.72   | 0.7781  | -1.0      | 0.7326     | 0.7965    | -1.0          | -1.0              | 0       |
| 0.144         | 88.0  | 880  | 0.3724          | 0.6804 | 0.7917 | 0.7688 | -1.0      | 0.7067     | 0.6832    | 0.0962 | 0.7138 | 0.7719  | -1.0      | 0.7304     | 0.7886    | -1.0          | -1.0              | 0       |
| 0.2508        | 89.0  | 890  | 0.3643          | 0.6792 | 0.7823 | 0.7692 | -1.0      | 0.7062     | 0.6828    | 0.0969 | 0.7125 | 0.7706  | -1.0      | 0.7283     | 0.7877    | -1.0          | -1.0              | 0       |
| 0.1579        | 90.0  | 900  | 0.3623          | 0.6996 | 0.8094 | 0.7962 | -1.0      | 0.7204     | 0.7044    | 0.0962 | 0.7256 | 0.7937  | -1.0      | 0.7522     | 0.8105    | -1.0          | -1.0              | 0       |
| 0.1625        | 91.0  | 910  | 0.3630          | 0.6985 | 0.8083 | 0.7959 | -1.0      | 0.718      | 0.7034    | 0.0962 | 0.7256 | 0.7937  | -1.0      | 0.7522     | 0.8105    | -1.0          | -1.0              | 0       |
| 0.1734        | 92.0  | 920  | 0.3626          | 0.6876 | 0.7894 | 0.787  | -1.0      | 0.7165     | 0.6891    | 0.0969 | 0.7169 | 0.7819  | -1.0      | 0.75       | 0.7947    | -1.0          | -1.0              | 0       |
| 0.1452        | 93.0  | 930  | 0.3619          | 0.6838 | 0.7887 | 0.7781 | -1.0      | 0.7163     | 0.684     | 0.0969 | 0.7119 | 0.7769  | -1.0      | 0.7522     | 0.7868    | -1.0          | -1.0              | 0       |
| 0.1764        | 94.0  | 940  | 0.3633          | 0.6833 | 0.7888 | 0.7782 | -1.0      | 0.7162     | 0.6831    | 0.0969 | 0.7113 | 0.7763  | -1.0      | 0.7522     | 0.786     | -1.0          | -1.0              | 0       |
| 0.1862        | 95.0  | 950  | 0.3633          | 0.6825 | 0.7889 | 0.7781 | -1.0      | 0.7153     | 0.6826    | 0.0969 | 0.71   | 0.7756  | -1.0      | 0.75       | 0.786     | -1.0          | -1.0              | 0       |
| 0.1855        | 96.0  | 960  | 0.3622          | 0.6878 | 0.7891 | 0.7873 | -1.0      | 0.7147     | 0.6899    | 0.0969 | 0.7163 | 0.7819  | -1.0      | 0.75       | 0.7947    | -1.0          | -1.0              | 0       |
| 0.2982        | 97.0  | 970  | 0.3622          | 0.6877 | 0.789  | 0.7873 | -1.0      | 0.7147     | 0.6896    | 0.0969 | 0.7163 | 0.7819  | -1.0      | 0.75       | 0.7947    | -1.0          | -1.0              | 0       |
| 0.1764        | 98.0  | 980  | 0.3620          | 0.6877 | 0.789  | 0.7873 | -1.0      | 0.7147     | 0.6896    | 0.0969 | 0.7163 | 0.7819  | -1.0      | 0.75       | 0.7947    | -1.0          | -1.0              | 0       |
| 0.2245        | 99.0  | 990  | 0.3618          | 0.6874 | 0.789  | 0.7871 | -1.0      | 0.7147     | 0.6892    | 0.0969 | 0.7163 | 0.7819  | -1.0      | 0.75       | 0.7947    | -1.0          | -1.0              | 0       |
| 0.1775        | 100.0 | 1000 | 0.3617          | 0.6874 | 0.789  | 0.7871 | -1.0      | 0.7147     | 0.6892    | 0.0969 | 0.7163 | 0.7819  | -1.0      | 0.75       | 0.7947    | -1.0          | -1.0              | 0       |


### Framework versions

- Transformers 4.41.1
- Pytorch 2.2.1+cu121
- Datasets 2.19.1
- Tokenizers 0.19.1