File size: 37,261 Bytes
21b576c 122a29e 21b576c 13a4757 21b576c 122a29e 21b576c 13a4757 21b576c 122a29e 21b576c 13a4757 21b576c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 |
---
license: apache-2.0
base_model: SenseTime/deformable-detr
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: sensetime-deformable-detr-finetuned-10k-cppe5-auto-pad
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/qubvel-hf-co/transformers-detection-model-finetuning-cppe5/runs/jf9me88v)
# sensetime-deformable-detr-finetuned-10k-cppe5-auto-pad
This model is a fine-tuned version of [SenseTime/deformable-detr](https://huggingface.co/SenseTime/deformable-detr) on the cppe-5 dataset.
It achieves the following results on the evaluation set:
- Loss: 1.1077
- Map: 0.2966
- Map 50: 0.5533
- Map 75: 0.2796
- Map Coverall: 0.542
- Map Face Shield: 0.2897
- Map Gloves: 0.1962
- Map Goggles: 0.1636
- Map Mask: 0.2918
- Map Large: 0.4613
- Map Medium: 0.2376
- Map Small: 0.1574
- Mar 1: 0.2796
- Mar 10: 0.4669
- Mar 100: 0.5019
- Mar 100 Coverall: 0.673
- Mar 100 Face Shield: 0.5063
- Mar 100 Gloves: 0.4442
- Mar 100 Goggles: 0.4262
- Mar 100 Mask: 0.46
- Mar Large: 0.701
- Mar Medium: 0.4538
- Mar Small: 0.2991
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 4
- eval_batch_size: 1
- seed: 1337
- gradient_accumulation_steps: 2
- total_train_batch_size: 8
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0
- mixed_precision_training: Native AMP
### Training results
| Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Coverall | Map Face Shield | Map Gloves | Map Goggles | Map Mask | Map Large | Map Medium | Map Small | Mar 1 | Mar 10 | Mar 100 | Mar 100 Coverall | Mar 100 Face Shield | Mar 100 Gloves | Mar 100 Goggles | Mar 100 Mask | Mar Large | Mar Medium | Mar Small |
|:-------------:|:-------:|:-----:|:---------------:|:------:|:------:|:------:|:------------:|:---------------:|:----------:|:-----------:|:--------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:----------------:|:-------------------:|:--------------:|:---------------:|:------------:|:---------:|:----------:|:---------:|
| 10.0477 | 0.9953 | 106 | 2.5128 | 0.0027 | 0.0109 | 0.0009 | 0.0132 | 0.0 | 0.0001 | 0.0 | 0.0001 | 0.0035 | 0.0002 | 0.0002 | 0.0027 | 0.0311 | 0.0461 | 0.1806 | 0.0038 | 0.0201 | 0.0062 | 0.02 | 0.0502 | 0.0159 | 0.0011 |
| 2.3433 | 2.0 | 213 | 2.3063 | 0.0061 | 0.0187 | 0.0026 | 0.0294 | 0.0 | 0.0 | 0.0 | 0.0011 | 0.0064 | 0.0003 | 0.0006 | 0.0111 | 0.0521 | 0.0836 | 0.3405 | 0.0 | 0.0071 | 0.0 | 0.0702 | 0.0766 | 0.0284 | 0.0051 |
| 2.1506 | 2.9953 | 319 | 2.1827 | 0.0092 | 0.0302 | 0.0037 | 0.0447 | 0.0 | 0.0001 | 0.0 | 0.0014 | 0.0102 | 0.0005 | 0.0003 | 0.0191 | 0.0654 | 0.0998 | 0.386 | 0.0 | 0.0188 | 0.0 | 0.0942 | 0.1271 | 0.0399 | 0.0032 |
| 2.0476 | 4.0 | 426 | 2.0585 | 0.0142 | 0.0391 | 0.0067 | 0.0674 | 0.0 | 0.0002 | 0.0001 | 0.0036 | 0.0156 | 0.0013 | 0.0008 | 0.0292 | 0.0858 | 0.1269 | 0.4495 | 0.0 | 0.0379 | 0.0046 | 0.1422 | 0.1525 | 0.0597 | 0.0088 |
| 2.0025 | 4.9953 | 532 | 2.0999 | 0.0101 | 0.0323 | 0.0038 | 0.0426 | 0.0003 | 0.0001 | 0.0022 | 0.0052 | 0.0116 | 0.0028 | 0.0013 | 0.0269 | 0.0872 | 0.1226 | 0.432 | 0.0114 | 0.0143 | 0.0154 | 0.14 | 0.1488 | 0.0599 | 0.013 |
| 1.9659 | 6.0 | 639 | 2.0234 | 0.0117 | 0.0323 | 0.0068 | 0.0522 | 0.0009 | 0.0 | 0.0002 | 0.005 | 0.0127 | 0.0016 | 0.0016 | 0.0304 | 0.0956 | 0.1321 | 0.4288 | 0.0316 | 0.0147 | 0.0092 | 0.176 | 0.166 | 0.0677 | 0.0206 |
| 1.9164 | 6.9953 | 745 | 1.9570 | 0.0156 | 0.0459 | 0.0074 | 0.0603 | 0.0062 | 0.0001 | 0.0004 | 0.0107 | 0.014 | 0.0046 | 0.0094 | 0.0371 | 0.1115 | 0.1536 | 0.4635 | 0.0835 | 0.033 | 0.0092 | 0.1787 | 0.1659 | 0.0935 | 0.049 |
| 1.8481 | 8.0 | 852 | 1.9306 | 0.017 | 0.0657 | 0.0057 | 0.0631 | 0.0134 | 0.0002 | 0.0008 | 0.0075 | 0.0203 | 0.0061 | 0.004 | 0.0345 | 0.1365 | 0.1722 | 0.418 | 0.1633 | 0.0299 | 0.0415 | 0.208 | 0.195 | 0.1211 | 0.0482 |
| 1.8043 | 8.9953 | 958 | 1.8479 | 0.023 | 0.0637 | 0.0097 | 0.0935 | 0.0017 | 0.0004 | 0.0011 | 0.0182 | 0.0245 | 0.007 | 0.0078 | 0.0376 | 0.1227 | 0.1672 | 0.5 | 0.0519 | 0.0518 | 0.0308 | 0.2013 | 0.2035 | 0.0904 | 0.0291 |
| 1.7716 | 10.0 | 1065 | 1.8188 | 0.0315 | 0.0834 | 0.0227 | 0.1123 | 0.0204 | 0.0005 | 0.0029 | 0.0212 | 0.0308 | 0.0163 | 0.01 | 0.0632 | 0.1622 | 0.193 | 0.4518 | 0.1443 | 0.0576 | 0.0831 | 0.228 | 0.2283 | 0.138 | 0.0709 |
| 1.7773 | 10.9953 | 1171 | 1.7724 | 0.0324 | 0.0813 | 0.021 | 0.1104 | 0.0231 | 0.0009 | 0.0048 | 0.0228 | 0.0328 | 0.016 | 0.0055 | 0.0641 | 0.1746 | 0.2172 | 0.5014 | 0.1418 | 0.0625 | 0.1477 | 0.2324 | 0.2879 | 0.1403 | 0.054 |
| 1.6963 | 12.0 | 1278 | 1.7517 | 0.0334 | 0.0862 | 0.0219 | 0.111 | 0.0224 | 0.002 | 0.0036 | 0.0283 | 0.0349 | 0.0168 | 0.0089 | 0.0667 | 0.1874 | 0.2248 | 0.5023 | 0.1911 | 0.0719 | 0.1462 | 0.2124 | 0.3091 | 0.1505 | 0.0391 |
| 1.655 | 12.9953 | 1384 | 1.6734 | 0.0393 | 0.0976 | 0.0266 | 0.1296 | 0.0313 | 0.003 | 0.0043 | 0.0283 | 0.0465 | 0.0197 | 0.0064 | 0.0877 | 0.2136 | 0.2586 | 0.5306 | 0.2342 | 0.1027 | 0.1646 | 0.2609 | 0.3927 | 0.1702 | 0.0556 |
| 1.6066 | 14.0 | 1491 | 1.6708 | 0.0408 | 0.1027 | 0.0292 | 0.1404 | 0.0201 | 0.0045 | 0.0044 | 0.0347 | 0.0522 | 0.015 | 0.0126 | 0.084 | 0.2219 | 0.2668 | 0.5036 | 0.2494 | 0.1134 | 0.1785 | 0.2893 | 0.3711 | 0.2047 | 0.0549 |
| 1.5742 | 14.9953 | 1597 | 1.6115 | 0.0517 | 0.1244 | 0.0325 | 0.1675 | 0.0372 | 0.0052 | 0.0101 | 0.0383 | 0.0734 | 0.0228 | 0.021 | 0.1067 | 0.2416 | 0.2872 | 0.5126 | 0.2873 | 0.1214 | 0.2046 | 0.3098 | 0.409 | 0.1938 | 0.1275 |
| 1.5227 | 16.0 | 1704 | 1.6284 | 0.0572 | 0.1348 | 0.046 | 0.188 | 0.0281 | 0.004 | 0.0135 | 0.0522 | 0.0701 | 0.0299 | 0.0236 | 0.1001 | 0.2369 | 0.2776 | 0.559 | 0.2291 | 0.1268 | 0.1738 | 0.2991 | 0.3532 | 0.1865 | 0.1272 |
| 1.5002 | 16.9953 | 1810 | 1.5620 | 0.0509 | 0.1276 | 0.0346 | 0.1526 | 0.0356 | 0.0082 | 0.0111 | 0.0469 | 0.071 | 0.0364 | 0.0154 | 0.1068 | 0.2571 | 0.2995 | 0.573 | 0.2684 | 0.1312 | 0.2308 | 0.2942 | 0.4152 | 0.2003 | 0.1444 |
| 1.438 | 18.0 | 1917 | 1.5405 | 0.0702 | 0.1574 | 0.0623 | 0.231 | 0.0446 | 0.0111 | 0.0056 | 0.0586 | 0.0919 | 0.0341 | 0.0263 | 0.1142 | 0.2662 | 0.3091 | 0.5712 | 0.2924 | 0.1835 | 0.2 | 0.2987 | 0.4645 | 0.2259 | 0.1058 |
| 1.4241 | 18.9953 | 2023 | 1.4930 | 0.0614 | 0.1403 | 0.0488 | 0.1809 | 0.0337 | 0.0215 | 0.0138 | 0.0571 | 0.0769 | 0.0441 | 0.0278 | 0.1351 | 0.2765 | 0.3213 | 0.573 | 0.2658 | 0.2272 | 0.2262 | 0.3142 | 0.4541 | 0.2361 | 0.1464 |
| 1.3846 | 20.0 | 2130 | 1.4798 | 0.071 | 0.1611 | 0.0583 | 0.2 | 0.0367 | 0.0106 | 0.0134 | 0.0941 | 0.1 | 0.0424 | 0.0173 | 0.1376 | 0.2777 | 0.3234 | 0.5959 | 0.2684 | 0.1937 | 0.2062 | 0.3529 | 0.5112 | 0.2188 | 0.1098 |
| 1.3628 | 20.9953 | 2236 | 1.5376 | 0.0592 | 0.1278 | 0.0473 | 0.1838 | 0.0402 | 0.0103 | 0.0127 | 0.0487 | 0.0834 | 0.0363 | 0.0211 | 0.133 | 0.2772 | 0.3124 | 0.5734 | 0.3038 | 0.1473 | 0.2569 | 0.2804 | 0.4647 | 0.2099 | 0.1562 |
| 1.3488 | 22.0 | 2343 | 1.4411 | 0.0803 | 0.177 | 0.0657 | 0.2337 | 0.0469 | 0.02 | 0.0253 | 0.0757 | 0.1325 | 0.0492 | 0.0275 | 0.1577 | 0.3206 | 0.3584 | 0.5892 | 0.3557 | 0.2045 | 0.2877 | 0.3551 | 0.5519 | 0.255 | 0.1652 |
| 1.3166 | 22.9953 | 2449 | 1.4362 | 0.0729 | 0.1604 | 0.0657 | 0.251 | 0.0234 | 0.0185 | 0.0057 | 0.0659 | 0.1229 | 0.045 | 0.0209 | 0.14 | 0.302 | 0.3455 | 0.6279 | 0.3152 | 0.2241 | 0.2062 | 0.3542 | 0.5454 | 0.2502 | 0.1567 |
| 1.2865 | 24.0 | 2556 | 1.3867 | 0.0902 | 0.1875 | 0.0841 | 0.2712 | 0.0456 | 0.0195 | 0.0237 | 0.0907 | 0.1604 | 0.0688 | 0.027 | 0.1697 | 0.3342 | 0.3756 | 0.6077 | 0.3696 | 0.2304 | 0.3015 | 0.3689 | 0.5675 | 0.2829 | 0.2001 |
| 1.2624 | 24.9953 | 2662 | 1.4721 | 0.0934 | 0.1987 | 0.0753 | 0.2486 | 0.0635 | 0.0215 | 0.0483 | 0.0854 | 0.125 | 0.0616 | 0.0394 | 0.143 | 0.2983 | 0.3347 | 0.5811 | 0.2797 | 0.2183 | 0.2785 | 0.316 | 0.4576 | 0.2551 | 0.1597 |
| 1.2466 | 26.0 | 2769 | 1.4136 | 0.0942 | 0.2117 | 0.0817 | 0.2644 | 0.063 | 0.019 | 0.0213 | 0.1032 | 0.1854 | 0.0629 | 0.0275 | 0.1689 | 0.3242 | 0.372 | 0.6018 | 0.381 | 0.2308 | 0.2769 | 0.3693 | 0.5916 | 0.271 | 0.1923 |
| 1.2372 | 26.9953 | 2875 | 1.3647 | 0.1103 | 0.2324 | 0.0903 | 0.2986 | 0.0755 | 0.0378 | 0.0429 | 0.0965 | 0.1878 | 0.0764 | 0.0418 | 0.1841 | 0.3483 | 0.3859 | 0.6081 | 0.3949 | 0.2558 | 0.3031 | 0.3676 | 0.5874 | 0.2887 | 0.2028 |
| 1.2073 | 28.0 | 2982 | 1.3405 | 0.1167 | 0.2593 | 0.0991 | 0.3082 | 0.0749 | 0.0521 | 0.0231 | 0.1252 | 0.2114 | 0.0788 | 0.0443 | 0.1739 | 0.3455 | 0.3782 | 0.6338 | 0.3646 | 0.2866 | 0.2431 | 0.3631 | 0.5862 | 0.2857 | 0.1829 |
| 1.1943 | 28.9953 | 3088 | 1.3405 | 0.1271 | 0.2631 | 0.1111 | 0.3179 | 0.0858 | 0.0617 | 0.0413 | 0.1289 | 0.2214 | 0.0903 | 0.0481 | 0.1957 | 0.3653 | 0.401 | 0.6275 | 0.4089 | 0.2915 | 0.3046 | 0.3724 | 0.6171 | 0.305 | 0.1971 |
| 1.1687 | 30.0 | 3195 | 1.3810 | 0.1132 | 0.2429 | 0.0891 | 0.3091 | 0.0804 | 0.0365 | 0.0436 | 0.0963 | 0.2138 | 0.0709 | 0.0344 | 0.1642 | 0.3467 | 0.3839 | 0.6 | 0.3848 | 0.2853 | 0.3108 | 0.3387 | 0.5847 | 0.294 | 0.173 |
| 1.1531 | 30.9953 | 3301 | 1.3370 | 0.1367 | 0.2973 | 0.1112 | 0.3244 | 0.1038 | 0.0602 | 0.0477 | 0.1476 | 0.2315 | 0.0981 | 0.0459 | 0.1887 | 0.3559 | 0.3964 | 0.6266 | 0.4076 | 0.2929 | 0.2846 | 0.3702 | 0.606 | 0.3151 | 0.1626 |
| 1.1301 | 32.0 | 3408 | 1.2887 | 0.144 | 0.2864 | 0.1333 | 0.3802 | 0.0974 | 0.064 | 0.0382 | 0.1403 | 0.2966 | 0.0928 | 0.0502 | 0.2055 | 0.3766 | 0.4186 | 0.6473 | 0.4114 | 0.3246 | 0.3123 | 0.3973 | 0.6359 | 0.3158 | 0.2568 |
| 1.1229 | 32.9953 | 3514 | 1.3336 | 0.1301 | 0.2696 | 0.1122 | 0.3447 | 0.0833 | 0.0518 | 0.0668 | 0.1039 | 0.2332 | 0.0843 | 0.039 | 0.1855 | 0.3552 | 0.3953 | 0.6284 | 0.3291 | 0.3071 | 0.3262 | 0.3858 | 0.611 | 0.2991 | 0.1965 |
| 1.1093 | 34.0 | 3621 | 1.2993 | 0.1422 | 0.2995 | 0.1288 | 0.3681 | 0.1187 | 0.0528 | 0.0447 | 0.1267 | 0.2652 | 0.0855 | 0.0484 | 0.1908 | 0.3689 | 0.4112 | 0.6306 | 0.3696 | 0.3272 | 0.3508 | 0.3778 | 0.6093 | 0.3231 | 0.2262 |
| 1.1174 | 34.9953 | 3727 | 1.2780 | 0.1541 | 0.3185 | 0.1351 | 0.3778 | 0.1302 | 0.0634 | 0.0444 | 0.1545 | 0.2822 | 0.1073 | 0.0383 | 0.2046 | 0.3817 | 0.4162 | 0.6509 | 0.3962 | 0.3366 | 0.3015 | 0.396 | 0.6266 | 0.3259 | 0.213 |
| 1.074 | 36.0 | 3834 | 1.2588 | 0.1721 | 0.3425 | 0.1495 | 0.3996 | 0.1239 | 0.0843 | 0.07 | 0.1829 | 0.2959 | 0.1155 | 0.053 | 0.21 | 0.3858 | 0.4263 | 0.6649 | 0.381 | 0.3406 | 0.3492 | 0.396 | 0.6476 | 0.3288 | 0.2107 |
| 1.0848 | 36.9953 | 3940 | 1.2655 | 0.1673 | 0.3358 | 0.1488 | 0.3841 | 0.1226 | 0.0857 | 0.0691 | 0.1749 | 0.2956 | 0.1129 | 0.0706 | 0.2094 | 0.3941 | 0.427 | 0.6581 | 0.3949 | 0.358 | 0.3385 | 0.3853 | 0.6508 | 0.3269 | 0.2033 |
| 1.0491 | 38.0 | 4047 | 1.2471 | 0.173 | 0.357 | 0.1502 | 0.4014 | 0.1301 | 0.0849 | 0.0618 | 0.1867 | 0.328 | 0.1162 | 0.0509 | 0.2131 | 0.3915 | 0.4309 | 0.6626 | 0.4177 | 0.3371 | 0.3431 | 0.3942 | 0.6625 | 0.34 | 0.2176 |
| 1.0643 | 38.9953 | 4153 | 1.2567 | 0.1751 | 0.3549 | 0.1488 | 0.4105 | 0.1154 | 0.075 | 0.0645 | 0.2102 | 0.2898 | 0.1302 | 0.0569 | 0.2191 | 0.3917 | 0.4305 | 0.6441 | 0.4139 | 0.3375 | 0.3323 | 0.4244 | 0.6259 | 0.3413 | 0.2557 |
| 1.0237 | 40.0 | 4260 | 1.2347 | 0.188 | 0.3776 | 0.159 | 0.4281 | 0.1385 | 0.0995 | 0.098 | 0.1761 | 0.3287 | 0.1209 | 0.0663 | 0.2256 | 0.4055 | 0.4403 | 0.6495 | 0.419 | 0.3732 | 0.3508 | 0.4089 | 0.6745 | 0.3486 | 0.2067 |
| 1.03 | 40.9953 | 4366 | 1.2090 | 0.2067 | 0.4037 | 0.1885 | 0.452 | 0.1416 | 0.1112 | 0.1111 | 0.2172 | 0.3703 | 0.143 | 0.0695 | 0.235 | 0.4194 | 0.4497 | 0.6626 | 0.4215 | 0.3804 | 0.3738 | 0.4102 | 0.6648 | 0.3644 | 0.242 |
| 1.004 | 42.0 | 4473 | 1.2156 | 0.2067 | 0.4123 | 0.1918 | 0.4667 | 0.1537 | 0.1041 | 0.102 | 0.2067 | 0.3846 | 0.1379 | 0.0642 | 0.2331 | 0.4122 | 0.4479 | 0.664 | 0.4646 | 0.3576 | 0.3477 | 0.4058 | 0.6692 | 0.3732 | 0.2393 |
| 0.9955 | 42.9953 | 4579 | 1.2231 | 0.2039 | 0.4021 | 0.1818 | 0.4594 | 0.1581 | 0.0848 | 0.0949 | 0.2225 | 0.3506 | 0.1452 | 0.0684 | 0.2289 | 0.4212 | 0.4547 | 0.6455 | 0.4709 | 0.3554 | 0.3615 | 0.4404 | 0.681 | 0.3715 | 0.2831 |
| 0.9851 | 44.0 | 4686 | 1.2082 | 0.2062 | 0.4166 | 0.1758 | 0.4775 | 0.1476 | 0.0885 | 0.1086 | 0.2091 | 0.3647 | 0.1321 | 0.0769 | 0.2319 | 0.4159 | 0.4547 | 0.6721 | 0.4608 | 0.3558 | 0.3569 | 0.428 | 0.6767 | 0.3839 | 0.2569 |
| 0.977 | 44.9953 | 4792 | 1.2175 | 0.2134 | 0.4164 | 0.1914 | 0.4744 | 0.1698 | 0.0832 | 0.1156 | 0.2239 | 0.3522 | 0.1511 | 0.0785 | 0.2282 | 0.4194 | 0.456 | 0.6572 | 0.4481 | 0.3594 | 0.4031 | 0.4124 | 0.6561 | 0.3727 | 0.2811 |
| 0.9651 | 46.0 | 4899 | 1.2119 | 0.2107 | 0.4228 | 0.1806 | 0.4802 | 0.1585 | 0.0907 | 0.109 | 0.2154 | 0.3586 | 0.151 | 0.0633 | 0.2298 | 0.4229 | 0.4615 | 0.6541 | 0.462 | 0.3754 | 0.3908 | 0.4253 | 0.6802 | 0.3833 | 0.2644 |
| 0.9539 | 46.9953 | 5005 | 1.1956 | 0.2234 | 0.4392 | 0.2023 | 0.4818 | 0.1767 | 0.1182 | 0.1012 | 0.2391 | 0.3883 | 0.1633 | 0.0751 | 0.2511 | 0.42 | 0.4587 | 0.6514 | 0.4646 | 0.3719 | 0.36 | 0.4458 | 0.6879 | 0.3876 | 0.2633 |
| 0.9306 | 48.0 | 5112 | 1.1735 | 0.2389 | 0.4474 | 0.2127 | 0.4919 | 0.197 | 0.1323 | 0.1092 | 0.2639 | 0.4057 | 0.1725 | 0.0878 | 0.2541 | 0.4331 | 0.4709 | 0.6631 | 0.4608 | 0.3835 | 0.3938 | 0.4533 | 0.712 | 0.394 | 0.2699 |
| 0.9477 | 48.9953 | 5218 | 1.1838 | 0.2293 | 0.4519 | 0.2062 | 0.4914 | 0.1957 | 0.1107 | 0.1119 | 0.2365 | 0.3849 | 0.1634 | 0.0803 | 0.2456 | 0.4256 | 0.4656 | 0.6613 | 0.462 | 0.3857 | 0.3769 | 0.4422 | 0.683 | 0.3931 | 0.2756 |
| 0.916 | 50.0 | 5325 | 1.1783 | 0.2307 | 0.4467 | 0.2154 | 0.4981 | 0.1967 | 0.1368 | 0.0786 | 0.2435 | 0.3915 | 0.1667 | 0.0715 | 0.2511 | 0.4276 | 0.4693 | 0.6698 | 0.4532 | 0.3982 | 0.3723 | 0.4529 | 0.6908 | 0.3967 | 0.2557 |
| 0.9194 | 50.9953 | 5431 | 1.1737 | 0.2365 | 0.4598 | 0.2042 | 0.5003 | 0.1931 | 0.1466 | 0.1114 | 0.2308 | 0.4017 | 0.1708 | 0.0658 | 0.249 | 0.4302 | 0.4685 | 0.6716 | 0.4443 | 0.4116 | 0.3831 | 0.432 | 0.6951 | 0.3954 | 0.2526 |
| 0.8958 | 52.0 | 5538 | 1.1606 | 0.2528 | 0.4752 | 0.241 | 0.4978 | 0.2043 | 0.1544 | 0.1368 | 0.2706 | 0.4481 | 0.183 | 0.0902 | 0.2561 | 0.4339 | 0.4646 | 0.6599 | 0.4747 | 0.4004 | 0.3538 | 0.4342 | 0.7031 | 0.387 | 0.235 |
| 0.892 | 52.9953 | 5644 | 1.1739 | 0.2499 | 0.4692 | 0.2276 | 0.5169 | 0.2026 | 0.1388 | 0.1182 | 0.2729 | 0.4241 | 0.1813 | 0.0917 | 0.2525 | 0.4283 | 0.4633 | 0.6721 | 0.443 | 0.4062 | 0.3585 | 0.4364 | 0.6919 | 0.3886 | 0.245 |
| 0.9046 | 54.0 | 5751 | 1.1386 | 0.2515 | 0.4764 | 0.2372 | 0.5086 | 0.2015 | 0.1512 | 0.1197 | 0.2765 | 0.4195 | 0.1862 | 0.0898 | 0.2606 | 0.4451 | 0.4809 | 0.6694 | 0.4734 | 0.4183 | 0.3862 | 0.4573 | 0.7078 | 0.4097 | 0.2792 |
| 0.8886 | 54.9953 | 5857 | 1.1662 | 0.2459 | 0.4698 | 0.2278 | 0.4937 | 0.1995 | 0.1386 | 0.1179 | 0.28 | 0.4134 | 0.1765 | 0.0989 | 0.2609 | 0.4382 | 0.4752 | 0.6532 | 0.4772 | 0.3987 | 0.3923 | 0.4547 | 0.6965 | 0.3972 | 0.2888 |
| 0.8666 | 56.0 | 5964 | 1.1711 | 0.2414 | 0.4668 | 0.2273 | 0.4817 | 0.1952 | 0.1462 | 0.123 | 0.2609 | 0.4192 | 0.1846 | 0.0918 | 0.2569 | 0.441 | 0.4739 | 0.6464 | 0.5038 | 0.3871 | 0.4031 | 0.4293 | 0.6904 | 0.4112 | 0.2598 |
| 0.8705 | 56.9953 | 6070 | 1.1494 | 0.2509 | 0.4813 | 0.2336 | 0.5023 | 0.1868 | 0.1654 | 0.1372 | 0.2628 | 0.4357 | 0.1766 | 0.0893 | 0.2586 | 0.4466 | 0.4777 | 0.6595 | 0.4899 | 0.4165 | 0.3892 | 0.4333 | 0.7116 | 0.4098 | 0.2656 |
| 0.851 | 58.0 | 6177 | 1.1208 | 0.2646 | 0.4957 | 0.2536 | 0.5274 | 0.1956 | 0.1723 | 0.1512 | 0.2762 | 0.4543 | 0.1847 | 0.0982 | 0.2671 | 0.4632 | 0.4985 | 0.6802 | 0.4747 | 0.4375 | 0.4262 | 0.4742 | 0.7184 | 0.433 | 0.286 |
| 0.8417 | 58.9953 | 6283 | 1.1331 | 0.2682 | 0.5063 | 0.2649 | 0.5355 | 0.2165 | 0.1609 | 0.1628 | 0.2652 | 0.4367 | 0.2089 | 0.0909 | 0.2677 | 0.4626 | 0.4977 | 0.6905 | 0.5127 | 0.4254 | 0.4231 | 0.4369 | 0.6996 | 0.448 | 0.2842 |
| 0.8314 | 60.0 | 6390 | 1.1365 | 0.2559 | 0.4945 | 0.2372 | 0.5221 | 0.2024 | 0.1372 | 0.1593 | 0.2583 | 0.4627 | 0.1733 | 0.0739 | 0.2637 | 0.4472 | 0.48 | 0.6662 | 0.4684 | 0.4027 | 0.4138 | 0.4489 | 0.7006 | 0.413 | 0.2794 |
| 0.8421 | 60.9953 | 6496 | 1.1490 | 0.2543 | 0.483 | 0.2366 | 0.5176 | 0.1929 | 0.1476 | 0.1475 | 0.266 | 0.4531 | 0.1853 | 0.0702 | 0.2604 | 0.4426 | 0.4843 | 0.6757 | 0.4823 | 0.4134 | 0.4062 | 0.444 | 0.7028 | 0.4168 | 0.2829 |
| 0.8245 | 62.0 | 6603 | 1.1943 | 0.234 | 0.4822 | 0.2022 | 0.4946 | 0.1991 | 0.1213 | 0.1367 | 0.2182 | 0.4299 | 0.1598 | 0.0596 | 0.2419 | 0.4333 | 0.4693 | 0.6545 | 0.481 | 0.3973 | 0.3892 | 0.4244 | 0.6837 | 0.4024 | 0.2387 |
| 0.8277 | 62.9953 | 6709 | 1.1240 | 0.2671 | 0.5093 | 0.2466 | 0.5279 | 0.2098 | 0.1702 | 0.1407 | 0.2867 | 0.4614 | 0.1958 | 0.0933 | 0.272 | 0.4541 | 0.4889 | 0.6694 | 0.4835 | 0.429 | 0.4108 | 0.4516 | 0.6959 | 0.4443 | 0.2787 |
| 0.7944 | 64.0 | 6816 | 1.1299 | 0.2684 | 0.5126 | 0.2395 | 0.5312 | 0.2257 | 0.1644 | 0.1514 | 0.2694 | 0.4394 | 0.2028 | 0.1117 | 0.2666 | 0.4539 | 0.4907 | 0.6815 | 0.4975 | 0.4138 | 0.4015 | 0.4591 | 0.7064 | 0.4449 | 0.2694 |
| 0.8011 | 64.9953 | 6922 | 1.1410 | 0.2691 | 0.5116 | 0.239 | 0.526 | 0.2351 | 0.1662 | 0.1492 | 0.2691 | 0.4501 | 0.199 | 0.0895 | 0.2675 | 0.4543 | 0.4903 | 0.6676 | 0.4949 | 0.4415 | 0.4046 | 0.4427 | 0.7081 | 0.4385 | 0.2681 |
| 0.802 | 66.0 | 7029 | 1.1518 | 0.2608 | 0.5054 | 0.2476 | 0.5186 | 0.2291 | 0.1512 | 0.1539 | 0.2513 | 0.4396 | 0.1975 | 0.0923 | 0.2612 | 0.45 | 0.4851 | 0.664 | 0.5038 | 0.4174 | 0.4108 | 0.4298 | 0.6925 | 0.4383 | 0.2698 |
| 0.787 | 66.9953 | 7135 | 1.1123 | 0.2753 | 0.5125 | 0.2623 | 0.5229 | 0.2367 | 0.178 | 0.1469 | 0.2923 | 0.441 | 0.2106 | 0.1204 | 0.277 | 0.4649 | 0.5014 | 0.6743 | 0.5114 | 0.4379 | 0.4169 | 0.4662 | 0.692 | 0.4447 | 0.3117 |
| 0.793 | 68.0 | 7242 | 1.1302 | 0.2778 | 0.5185 | 0.2651 | 0.5329 | 0.239 | 0.1847 | 0.1492 | 0.2833 | 0.4519 | 0.2138 | 0.1243 | 0.2741 | 0.4655 | 0.4984 | 0.6725 | 0.4962 | 0.4388 | 0.4262 | 0.4582 | 0.7106 | 0.451 | 0.2874 |
| 0.7816 | 68.9953 | 7348 | 1.1195 | 0.2804 | 0.5213 | 0.2606 | 0.5321 | 0.2537 | 0.185 | 0.1523 | 0.2788 | 0.4606 | 0.2083 | 0.1154 | 0.2777 | 0.4629 | 0.4975 | 0.6766 | 0.5063 | 0.4348 | 0.4092 | 0.4604 | 0.6903 | 0.4544 | 0.3043 |
| 0.7586 | 70.0 | 7455 | 1.1257 | 0.2707 | 0.5136 | 0.2537 | 0.5318 | 0.2253 | 0.1829 | 0.1327 | 0.2807 | 0.4311 | 0.2133 | 0.0961 | 0.2694 | 0.4559 | 0.4959 | 0.6757 | 0.5013 | 0.4411 | 0.4062 | 0.4556 | 0.7071 | 0.449 | 0.2676 |
| 0.7775 | 70.9953 | 7561 | 1.1426 | 0.2619 | 0.5122 | 0.2307 | 0.515 | 0.2441 | 0.1626 | 0.1244 | 0.2634 | 0.4269 | 0.2018 | 0.0912 | 0.2694 | 0.4483 | 0.4807 | 0.6536 | 0.4886 | 0.4165 | 0.4108 | 0.4338 | 0.6895 | 0.4319 | 0.2653 |
| 0.7549 | 72.0 | 7668 | 1.1118 | 0.2797 | 0.5244 | 0.2659 | 0.5382 | 0.2388 | 0.1868 | 0.1345 | 0.3002 | 0.4503 | 0.2096 | 0.1156 | 0.2753 | 0.4564 | 0.4915 | 0.6689 | 0.5038 | 0.4281 | 0.3892 | 0.4676 | 0.6951 | 0.4335 | 0.294 |
| 0.7532 | 72.9953 | 7774 | 1.1367 | 0.2608 | 0.5095 | 0.2298 | 0.5223 | 0.2347 | 0.1613 | 0.1206 | 0.265 | 0.4309 | 0.2013 | 0.0949 | 0.2605 | 0.445 | 0.4817 | 0.6707 | 0.4797 | 0.4187 | 0.3954 | 0.444 | 0.6839 | 0.4387 | 0.2629 |
| 0.7476 | 74.0 | 7881 | 1.1276 | 0.2728 | 0.5189 | 0.255 | 0.5235 | 0.2291 | 0.1903 | 0.1475 | 0.2738 | 0.4466 | 0.209 | 0.1297 | 0.2714 | 0.4523 | 0.4864 | 0.6667 | 0.4975 | 0.4362 | 0.3862 | 0.4458 | 0.702 | 0.4357 | 0.2723 |
| 0.7521 | 74.9953 | 7987 | 1.1411 | 0.2675 | 0.5126 | 0.2469 | 0.5361 | 0.2319 | 0.1579 | 0.1462 | 0.2655 | 0.4447 | 0.2074 | 0.1 | 0.2654 | 0.4458 | 0.4873 | 0.673 | 0.4937 | 0.4112 | 0.4108 | 0.448 | 0.6901 | 0.4435 | 0.2718 |
| 0.7237 | 76.0 | 8094 | 1.1161 | 0.2805 | 0.5326 | 0.2599 | 0.5308 | 0.2471 | 0.1816 | 0.1575 | 0.2857 | 0.4523 | 0.2143 | 0.1101 | 0.2723 | 0.4545 | 0.4887 | 0.6667 | 0.5013 | 0.4304 | 0.3923 | 0.4529 | 0.7101 | 0.4299 | 0.2886 |
| 0.7333 | 76.9953 | 8200 | 1.1175 | 0.2735 | 0.5149 | 0.2552 | 0.5303 | 0.2435 | 0.1855 | 0.1409 | 0.2676 | 0.4287 | 0.2137 | 0.1094 | 0.2711 | 0.4568 | 0.4956 | 0.673 | 0.5203 | 0.4272 | 0.4077 | 0.4498 | 0.6983 | 0.4448 | 0.3011 |
| 0.7211 | 78.0 | 8307 | 1.1296 | 0.2751 | 0.5247 | 0.2522 | 0.5416 | 0.2569 | 0.1605 | 0.1488 | 0.2675 | 0.4312 | 0.2158 | 0.1041 | 0.2695 | 0.4512 | 0.4883 | 0.6766 | 0.5089 | 0.4036 | 0.4138 | 0.4387 | 0.6939 | 0.4449 | 0.2741 |
| 0.7167 | 78.9953 | 8413 | 1.1061 | 0.282 | 0.5294 | 0.2578 | 0.5406 | 0.2432 | 0.1983 | 0.1453 | 0.2828 | 0.4409 | 0.2189 | 0.1386 | 0.2747 | 0.4574 | 0.4914 | 0.6815 | 0.5013 | 0.4362 | 0.3877 | 0.4502 | 0.695 | 0.4434 | 0.2888 |
| 0.7038 | 80.0 | 8520 | 1.0913 | 0.2882 | 0.5315 | 0.2747 | 0.5473 | 0.2527 | 0.196 | 0.1519 | 0.293 | 0.4469 | 0.2303 | 0.1232 | 0.2804 | 0.4685 | 0.5024 | 0.6811 | 0.5152 | 0.4335 | 0.4154 | 0.4671 | 0.7043 | 0.4571 | 0.293 |
| 0.7218 | 80.9953 | 8626 | 1.1100 | 0.2859 | 0.5302 | 0.2797 | 0.5433 | 0.2469 | 0.1842 | 0.1712 | 0.284 | 0.4482 | 0.2278 | 0.1336 | 0.2758 | 0.4619 | 0.4963 | 0.6721 | 0.4937 | 0.433 | 0.4308 | 0.452 | 0.6925 | 0.4545 | 0.2852 |
| 0.7102 | 82.0 | 8733 | 1.0959 | 0.2876 | 0.5309 | 0.2733 | 0.5402 | 0.2475 | 0.1886 | 0.1689 | 0.2929 | 0.4638 | 0.222 | 0.12 | 0.2805 | 0.4621 | 0.4956 | 0.6725 | 0.5038 | 0.4326 | 0.4123 | 0.4569 | 0.7015 | 0.4456 | 0.2877 |
| 0.7123 | 82.9953 | 8839 | 1.1015 | 0.2907 | 0.5418 | 0.2694 | 0.5391 | 0.2619 | 0.1972 | 0.162 | 0.2934 | 0.4633 | 0.2235 | 0.1326 | 0.2818 | 0.4614 | 0.4983 | 0.6721 | 0.5013 | 0.4348 | 0.4246 | 0.4587 | 0.7047 | 0.4456 | 0.3046 |
| 0.6986 | 84.0 | 8946 | 1.1074 | 0.2862 | 0.5377 | 0.2752 | 0.5375 | 0.2656 | 0.192 | 0.1565 | 0.2794 | 0.4625 | 0.2192 | 0.1365 | 0.2722 | 0.465 | 0.4981 | 0.673 | 0.5038 | 0.4429 | 0.4092 | 0.4618 | 0.6946 | 0.4494 | 0.304 |
| 0.6876 | 84.9953 | 9052 | 1.1251 | 0.2822 | 0.5311 | 0.2577 | 0.5439 | 0.2601 | 0.1769 | 0.1578 | 0.2722 | 0.4526 | 0.2214 | 0.1174 | 0.2711 | 0.4532 | 0.4887 | 0.6766 | 0.4899 | 0.4286 | 0.4015 | 0.4471 | 0.6843 | 0.4462 | 0.2796 |
| 0.6854 | 86.0 | 9159 | 1.1250 | 0.2815 | 0.535 | 0.2583 | 0.5311 | 0.2598 | 0.1815 | 0.1598 | 0.2752 | 0.4619 | 0.2161 | 0.1269 | 0.2729 | 0.4557 | 0.4919 | 0.6658 | 0.4962 | 0.446 | 0.4031 | 0.4484 | 0.6925 | 0.4389 | 0.2868 |
| 0.6924 | 86.9953 | 9265 | 1.1035 | 0.2867 | 0.5352 | 0.2678 | 0.5405 | 0.259 | 0.1907 | 0.152 | 0.2913 | 0.4589 | 0.2216 | 0.1514 | 0.277 | 0.463 | 0.4966 | 0.664 | 0.5 | 0.4513 | 0.4062 | 0.4613 | 0.6815 | 0.4452 | 0.3031 |
| 0.6819 | 88.0 | 9372 | 1.1092 | 0.2935 | 0.5469 | 0.2722 | 0.546 | 0.2844 | 0.1946 | 0.1593 | 0.2834 | 0.4626 | 0.2309 | 0.1554 | 0.2824 | 0.4621 | 0.4961 | 0.6779 | 0.5 | 0.4397 | 0.4154 | 0.4476 | 0.6873 | 0.457 | 0.2882 |
| 0.6824 | 88.9953 | 9478 | 1.1083 | 0.2951 | 0.5452 | 0.2751 | 0.5389 | 0.2849 | 0.1939 | 0.1685 | 0.2893 | 0.4788 | 0.2243 | 0.155 | 0.2833 | 0.461 | 0.4921 | 0.6694 | 0.5 | 0.4366 | 0.4062 | 0.4484 | 0.6998 | 0.4416 | 0.2912 |
| 0.6675 | 90.0 | 9585 | 1.1220 | 0.2886 | 0.5417 | 0.2746 | 0.5335 | 0.2797 | 0.1853 | 0.1703 | 0.2743 | 0.4617 | 0.2232 | 0.1483 | 0.2784 | 0.4602 | 0.4916 | 0.664 | 0.5038 | 0.4397 | 0.4031 | 0.4476 | 0.684 | 0.4485 | 0.2927 |
| 0.6671 | 90.9953 | 9691 | 1.1083 | 0.2916 | 0.548 | 0.2732 | 0.5366 | 0.2825 | 0.1941 | 0.1638 | 0.2813 | 0.4604 | 0.2304 | 0.1503 | 0.2815 | 0.4638 | 0.4982 | 0.6658 | 0.5101 | 0.45 | 0.4154 | 0.4498 | 0.697 | 0.4516 | 0.2922 |
| 0.6671 | 92.0 | 9798 | 1.1228 | 0.2883 | 0.5421 | 0.265 | 0.5394 | 0.2895 | 0.1805 | 0.1597 | 0.2726 | 0.4685 | 0.2281 | 0.1447 | 0.2807 | 0.4592 | 0.4932 | 0.6653 | 0.5089 | 0.4384 | 0.4092 | 0.444 | 0.6996 | 0.4473 | 0.2816 |
| 0.681 | 92.9953 | 9904 | 1.1238 | 0.288 | 0.5487 | 0.269 | 0.5385 | 0.2889 | 0.1856 | 0.1593 | 0.2678 | 0.4616 | 0.2266 | 0.1488 | 0.2768 | 0.4564 | 0.4884 | 0.6644 | 0.4937 | 0.4379 | 0.4031 | 0.4431 | 0.691 | 0.4435 | 0.2814 |
| 0.6663 | 94.0 | 10011 | 1.1296 | 0.2864 | 0.5491 | 0.271 | 0.5364 | 0.289 | 0.1736 | 0.1555 | 0.2774 | 0.4553 | 0.2318 | 0.1463 | 0.274 | 0.4556 | 0.4885 | 0.6667 | 0.4937 | 0.425 | 0.4092 | 0.448 | 0.6887 | 0.4445 | 0.2799 |
| 0.6642 | 94.9953 | 10117 | 1.1092 | 0.2947 | 0.5536 | 0.2751 | 0.5384 | 0.2927 | 0.1942 | 0.1598 | 0.2884 | 0.4595 | 0.2381 | 0.159 | 0.2855 | 0.4661 | 0.4985 | 0.6653 | 0.5089 | 0.4411 | 0.4215 | 0.4556 | 0.7009 | 0.452 | 0.2984 |
| 0.663 | 96.0 | 10224 | 1.1143 | 0.2941 | 0.5519 | 0.277 | 0.538 | 0.2844 | 0.1936 | 0.164 | 0.2905 | 0.4613 | 0.2353 | 0.1564 | 0.2771 | 0.4649 | 0.4956 | 0.6662 | 0.4987 | 0.4371 | 0.4215 | 0.4547 | 0.6953 | 0.4493 | 0.2928 |
| 0.6687 | 96.9953 | 10330 | 1.1208 | 0.2889 | 0.5528 | 0.2717 | 0.5379 | 0.2832 | 0.1861 | 0.1585 | 0.2791 | 0.4553 | 0.2327 | 0.1496 | 0.2746 | 0.4621 | 0.4919 | 0.6649 | 0.4987 | 0.4299 | 0.42 | 0.4458 | 0.686 | 0.4501 | 0.2846 |
| 0.6484 | 98.0 | 10437 | 1.1019 | 0.298 | 0.5545 | 0.2748 | 0.5405 | 0.2887 | 0.2012 | 0.1644 | 0.2954 | 0.4637 | 0.2403 | 0.1608 | 0.2807 | 0.469 | 0.5006 | 0.6698 | 0.5089 | 0.4455 | 0.4185 | 0.4604 | 0.6962 | 0.4532 | 0.3003 |
| 0.6657 | 98.9953 | 10543 | 1.1068 | 0.2972 | 0.5547 | 0.2771 | 0.5424 | 0.2909 | 0.1966 | 0.1623 | 0.2935 | 0.4628 | 0.2375 | 0.1575 | 0.2809 | 0.4665 | 0.502 | 0.673 | 0.5089 | 0.4442 | 0.4246 | 0.4596 | 0.7018 | 0.4544 | 0.2975 |
| 0.6131 | 99.5305 | 10600 | 1.1077 | 0.2966 | 0.5533 | 0.2796 | 0.542 | 0.2897 | 0.1962 | 0.1636 | 0.2918 | 0.4613 | 0.2376 | 0.1574 | 0.2796 | 0.4669 | 0.5019 | 0.673 | 0.5063 | 0.4442 | 0.4262 | 0.46 | 0.701 | 0.4538 | 0.2991 |
### Framework versions
- Transformers 4.41.0.dev0
- Pytorch 1.13.0+cu117
- Datasets 2.18.0
- Tokenizers 0.19.0
|