File size: 36,799 Bytes
2dfa43e 5076e7f 2dfa43e 5076e7f 2dfa43e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 |
---
library_name: transformers
license: apache-2.0
base_model: facebook/detr-resnet-50
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: detr-finetuned-cppe-5-10k-steps
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# detr-finetuned-cppe-5-10k-steps
This model is a fine-tuned version of [facebook/detr-resnet-50](https://huggingface.co/facebook/detr-resnet-50) on the danelcsb/cppe-5-v2 dataset.
It achieves the following results on the evaluation set:
- Loss: 0.9579
- Map: 0.3769
- Map 50: 0.6804
- Map 75: 0.3483
- Map Small: 0.1331
- Map Medium: 0.3109
- Map Large: 0.5141
- Mar 1: 0.3946
- Mar 10: 0.5584
- Mar 100: 0.5691
- Mar Small: 0.3543
- Mar Medium: 0.5333
- Mar Large: 0.6781
- Map Coverall: 0.646
- Mar 100 Coverall: 0.8118
- Map Face Shield: 0.2809
- Mar 100 Face Shield: 0.5564
- Map Gloves: 0.2972
- Mar 100 Gloves: 0.4827
- Map Goggles: 0.223
- Mar 100 Goggles: 0.4476
- Map Mask: 0.4374
- Mar 100 Mask: 0.5469
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 1337
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 100.0
- mixed_precision_training: Native AMP
### Training results
| Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:|
| 2.7184 | 1.0 | 102 | 2.6066 | 0.0053 | 0.0133 | 0.0034 | 0.0015 | 0.0054 | 0.0095 | 0.0358 | 0.0838 | 0.1556 | 0.0565 | 0.1579 | 0.1476 | 0.0178 | 0.5049 | 0.0 | 0.0 | 0.0058 | 0.152 | 0.0 | 0.0 | 0.0027 | 0.121 |
| 2.2231 | 2.0 | 204 | 1.9040 | 0.0421 | 0.0848 | 0.0341 | 0.0115 | 0.057 | 0.0441 | 0.0967 | 0.2064 | 0.2527 | 0.1085 | 0.2546 | 0.2474 | 0.1541 | 0.7 | 0.0 | 0.0 | 0.028 | 0.2642 | 0.0 | 0.0 | 0.0284 | 0.2994 |
| 2.1254 | 3.0 | 306 | 1.8283 | 0.0596 | 0.1146 | 0.0533 | 0.0194 | 0.0679 | 0.0601 | 0.1115 | 0.2279 | 0.2483 | 0.1033 | 0.3053 | 0.247 | 0.2259 | 0.684 | 0.0 | 0.0 | 0.0296 | 0.2168 | 0.0 | 0.0 | 0.0424 | 0.3407 |
| 1.9328 | 4.0 | 408 | 1.8491 | 0.0699 | 0.1462 | 0.0568 | 0.0301 | 0.0714 | 0.0741 | 0.1229 | 0.225 | 0.2587 | 0.1373 | 0.2285 | 0.248 | 0.2484 | 0.7333 | 0.0021 | 0.0164 | 0.0357 | 0.2397 | 0.0 | 0.0 | 0.0631 | 0.3043 |
| 1.7998 | 5.0 | 510 | 1.6615 | 0.1104 | 0.2435 | 0.0839 | 0.0439 | 0.1081 | 0.1176 | 0.1492 | 0.253 | 0.265 | 0.1203 | 0.2916 | 0.2703 | 0.3398 | 0.6458 | 0.033 | 0.0982 | 0.0411 | 0.2391 | 0.0002 | 0.0032 | 0.1378 | 0.3389 |
| 1.7995 | 6.0 | 612 | 1.6423 | 0.136 | 0.2587 | 0.1193 | 0.0429 | 0.111 | 0.154 | 0.1655 | 0.2745 | 0.3097 | 0.1494 | 0.3333 | 0.3207 | 0.4282 | 0.7174 | 0.0326 | 0.0964 | 0.0409 | 0.3101 | 0.0023 | 0.0222 | 0.176 | 0.4025 |
| 1.6677 | 7.0 | 714 | 1.5354 | 0.1412 | 0.281 | 0.123 | 0.0596 | 0.1478 | 0.1447 | 0.1806 | 0.3321 | 0.3586 | 0.2333 | 0.3621 | 0.3616 | 0.4209 | 0.7319 | 0.0337 | 0.2764 | 0.0605 | 0.3497 | 0.0008 | 0.0238 | 0.1903 | 0.4111 |
| 1.6329 | 8.0 | 816 | 1.5835 | 0.1591 | 0.3248 | 0.1322 | 0.0616 | 0.2121 | 0.1744 | 0.1919 | 0.3677 | 0.3951 | 0.3209 | 0.42 | 0.4255 | 0.4396 | 0.7111 | 0.0595 | 0.3655 | 0.0618 | 0.3358 | 0.0182 | 0.1587 | 0.2162 | 0.4043 |
| 1.6031 | 9.0 | 918 | 1.4644 | 0.165 | 0.3424 | 0.1443 | 0.0469 | 0.1803 | 0.1983 | 0.2043 | 0.3692 | 0.3898 | 0.2638 | 0.3951 | 0.4381 | 0.5105 | 0.7521 | 0.0703 | 0.3218 | 0.0619 | 0.3162 | 0.017 | 0.1937 | 0.1656 | 0.3654 |
| 1.5464 | 10.0 | 1020 | 1.3868 | 0.2084 | 0.3927 | 0.1792 | 0.0797 | 0.1933 | 0.2438 | 0.2454 | 0.405 | 0.4273 | 0.2948 | 0.424 | 0.4738 | 0.5649 | 0.7556 | 0.0925 | 0.4455 | 0.0756 | 0.3391 | 0.0261 | 0.1397 | 0.2827 | 0.4568 |
| 1.5454 | 11.0 | 1122 | 1.4023 | 0.192 | 0.3869 | 0.1682 | 0.0792 | 0.1991 | 0.2221 | 0.2421 | 0.4079 | 0.4247 | 0.2727 | 0.3988 | 0.4983 | 0.5026 | 0.7431 | 0.0667 | 0.38 | 0.0785 | 0.3229 | 0.0195 | 0.2063 | 0.2927 | 0.471 |
| 1.5008 | 12.0 | 1224 | 1.4417 | 0.1545 | 0.3341 | 0.1307 | 0.0629 | 0.1426 | 0.1898 | 0.2025 | 0.3779 | 0.4036 | 0.1873 | 0.3478 | 0.4817 | 0.4062 | 0.7465 | 0.0457 | 0.2836 | 0.066 | 0.3425 | 0.0237 | 0.2159 | 0.231 | 0.4296 |
| 1.4689 | 13.0 | 1326 | 1.4068 | 0.1938 | 0.4018 | 0.173 | 0.0734 | 0.2144 | 0.2255 | 0.2475 | 0.417 | 0.4383 | 0.258 | 0.4313 | 0.5185 | 0.475 | 0.7528 | 0.0753 | 0.3655 | 0.0911 | 0.3542 | 0.0468 | 0.2921 | 0.2807 | 0.4272 |
| 1.4263 | 14.0 | 1428 | 1.3763 | 0.1811 | 0.3658 | 0.1486 | 0.0969 | 0.1508 | 0.2104 | 0.2251 | 0.392 | 0.4163 | 0.2785 | 0.3984 | 0.4498 | 0.5154 | 0.7375 | 0.0332 | 0.3091 | 0.0912 | 0.3676 | 0.0303 | 0.2778 | 0.2356 | 0.3895 |
| 1.4193 | 15.0 | 1530 | 1.3191 | 0.2018 | 0.4037 | 0.1755 | 0.0892 | 0.195 | 0.2507 | 0.2617 | 0.4412 | 0.4602 | 0.2284 | 0.4069 | 0.5573 | 0.4697 | 0.7556 | 0.064 | 0.4473 | 0.1109 | 0.3453 | 0.0396 | 0.2794 | 0.325 | 0.4735 |
| 1.3707 | 16.0 | 1632 | 1.2574 | 0.2307 | 0.446 | 0.203 | 0.0786 | 0.2154 | 0.3001 | 0.2646 | 0.4684 | 0.4894 | 0.2933 | 0.4306 | 0.5928 | 0.5449 | 0.7583 | 0.1085 | 0.4582 | 0.1139 | 0.3989 | 0.0573 | 0.3444 | 0.3288 | 0.487 |
| 1.3594 | 17.0 | 1734 | 1.3527 | 0.2115 | 0.4043 | 0.185 | 0.0693 | 0.2171 | 0.2571 | 0.2471 | 0.4242 | 0.4464 | 0.1675 | 0.424 | 0.5451 | 0.4841 | 0.7451 | 0.0776 | 0.3327 | 0.1426 | 0.4061 | 0.041 | 0.2921 | 0.312 | 0.4562 |
| 1.353 | 18.0 | 1836 | 1.2458 | 0.2239 | 0.4409 | 0.206 | 0.1241 | 0.1888 | 0.2979 | 0.2722 | 0.4603 | 0.4849 | 0.3326 | 0.463 | 0.5781 | 0.5126 | 0.7667 | 0.0968 | 0.4636 | 0.1468 | 0.3994 | 0.0432 | 0.3175 | 0.3199 | 0.4772 |
| 1.2895 | 19.0 | 1938 | 1.2359 | 0.2359 | 0.4527 | 0.2218 | 0.1001 | 0.2109 | 0.3097 | 0.2898 | 0.4599 | 0.4741 | 0.2588 | 0.4135 | 0.5761 | 0.5503 | 0.7708 | 0.1012 | 0.4527 | 0.1608 | 0.4207 | 0.0345 | 0.2619 | 0.333 | 0.4642 |
| 1.281 | 20.0 | 2040 | 1.2395 | 0.2336 | 0.4626 | 0.2112 | 0.0803 | 0.1993 | 0.2902 | 0.284 | 0.4584 | 0.4744 | 0.2248 | 0.4237 | 0.5854 | 0.576 | 0.7799 | 0.1113 | 0.4127 | 0.1211 | 0.3872 | 0.0465 | 0.3302 | 0.3129 | 0.4623 |
| 1.2998 | 21.0 | 2142 | 1.2720 | 0.2331 | 0.4603 | 0.2056 | 0.09 | 0.1863 | 0.2905 | 0.2827 | 0.4446 | 0.4632 | 0.208 | 0.4373 | 0.5567 | 0.559 | 0.7667 | 0.1126 | 0.4509 | 0.1362 | 0.3698 | 0.0634 | 0.2952 | 0.2941 | 0.4333 |
| 1.2792 | 22.0 | 2244 | 1.2337 | 0.2484 | 0.4841 | 0.2234 | 0.0792 | 0.2208 | 0.3134 | 0.2857 | 0.4458 | 0.4648 | 0.1966 | 0.4095 | 0.578 | 0.5778 | 0.7882 | 0.1232 | 0.4164 | 0.1722 | 0.3827 | 0.0402 | 0.3079 | 0.3284 | 0.429 |
| 1.2585 | 23.0 | 2346 | 1.2072 | 0.27 | 0.4938 | 0.2544 | 0.0898 | 0.2435 | 0.338 | 0.2941 | 0.4769 | 0.4885 | 0.2701 | 0.4476 | 0.5933 | 0.5733 | 0.7576 | 0.1614 | 0.44 | 0.1648 | 0.4017 | 0.089 | 0.3444 | 0.3614 | 0.4988 |
| 1.2448 | 24.0 | 2448 | 1.2070 | 0.256 | 0.4825 | 0.2235 | 0.084 | 0.2321 | 0.3487 | 0.3079 | 0.459 | 0.4656 | 0.2084 | 0.4237 | 0.5849 | 0.5846 | 0.7736 | 0.1178 | 0.4473 | 0.1628 | 0.3765 | 0.073 | 0.254 | 0.3416 | 0.4765 |
| 1.2294 | 25.0 | 2550 | 1.2309 | 0.2452 | 0.4716 | 0.2184 | 0.0936 | 0.1978 | 0.3224 | 0.2844 | 0.4588 | 0.4675 | 0.2615 | 0.4478 | 0.579 | 0.5602 | 0.7493 | 0.1464 | 0.4309 | 0.1602 | 0.3927 | 0.06 | 0.3286 | 0.2992 | 0.4358 |
| 1.2595 | 26.0 | 2652 | 1.2038 | 0.2487 | 0.4766 | 0.2387 | 0.1149 | 0.1975 | 0.3144 | 0.2949 | 0.4697 | 0.4822 | 0.3066 | 0.4111 | 0.5843 | 0.5839 | 0.7688 | 0.1494 | 0.4745 | 0.1552 | 0.4223 | 0.0462 | 0.3048 | 0.3086 | 0.4407 |
| 1.1934 | 27.0 | 2754 | 1.1991 | 0.2489 | 0.4654 | 0.2356 | 0.111 | 0.2088 | 0.3068 | 0.2877 | 0.469 | 0.4768 | 0.3152 | 0.4497 | 0.5617 | 0.5761 | 0.7611 | 0.1759 | 0.4582 | 0.1172 | 0.3676 | 0.0339 | 0.3286 | 0.3413 | 0.4685 |
| 1.1864 | 28.0 | 2856 | 1.1400 | 0.2631 | 0.5124 | 0.2318 | 0.1017 | 0.2317 | 0.3561 | 0.3264 | 0.5114 | 0.5248 | 0.3453 | 0.4718 | 0.6482 | 0.5566 | 0.7806 | 0.1568 | 0.5091 | 0.2059 | 0.433 | 0.0707 | 0.4317 | 0.3257 | 0.4698 |
| 1.146 | 29.0 | 2958 | 1.1343 | 0.2803 | 0.5264 | 0.2612 | 0.0919 | 0.2465 | 0.3757 | 0.3346 | 0.5101 | 0.5227 | 0.3628 | 0.4858 | 0.6342 | 0.5722 | 0.7743 | 0.1673 | 0.5236 | 0.1962 | 0.4291 | 0.0854 | 0.3857 | 0.3803 | 0.5006 |
| 1.1749 | 30.0 | 3060 | 1.1617 | 0.2458 | 0.4916 | 0.2194 | 0.0753 | 0.194 | 0.3481 | 0.2977 | 0.4894 | 0.5073 | 0.3132 | 0.427 | 0.6398 | 0.583 | 0.7917 | 0.1541 | 0.5273 | 0.1731 | 0.4067 | 0.0472 | 0.3937 | 0.2713 | 0.4173 |
| 1.1695 | 31.0 | 3162 | 1.1849 | 0.254 | 0.5068 | 0.2275 | 0.089 | 0.2121 | 0.3555 | 0.3071 | 0.4853 | 0.498 | 0.2604 | 0.4693 | 0.6007 | 0.5234 | 0.7479 | 0.1237 | 0.4818 | 0.1924 | 0.4268 | 0.0908 | 0.3571 | 0.3395 | 0.4765 |
| 1.1613 | 32.0 | 3264 | 1.1447 | 0.2701 | 0.5138 | 0.2449 | 0.1041 | 0.2158 | 0.3704 | 0.3234 | 0.4972 | 0.508 | 0.2777 | 0.4314 | 0.635 | 0.5824 | 0.741 | 0.0965 | 0.4891 | 0.2241 | 0.4475 | 0.1017 | 0.3762 | 0.3458 | 0.4864 |
| 1.098 | 33.0 | 3366 | 1.1320 | 0.2686 | 0.5117 | 0.2382 | 0.1397 | 0.234 | 0.3737 | 0.3184 | 0.5021 | 0.5167 | 0.3209 | 0.4494 | 0.6358 | 0.5733 | 0.7847 | 0.1279 | 0.5255 | 0.2049 | 0.4302 | 0.0925 | 0.3683 | 0.3442 | 0.4747 |
| 1.119 | 34.0 | 3468 | 1.1157 | 0.2826 | 0.5481 | 0.24 | 0.0995 | 0.2062 | 0.3898 | 0.3266 | 0.5164 | 0.5243 | 0.3035 | 0.4758 | 0.6339 | 0.5914 | 0.791 | 0.149 | 0.5145 | 0.2382 | 0.433 | 0.0871 | 0.3968 | 0.3474 | 0.4864 |
| 1.1193 | 35.0 | 3570 | 1.1290 | 0.2701 | 0.5107 | 0.2566 | 0.1223 | 0.2484 | 0.3594 | 0.3345 | 0.5143 | 0.5339 | 0.3225 | 0.4833 | 0.643 | 0.5701 | 0.7972 | 0.1372 | 0.5436 | 0.2003 | 0.424 | 0.0671 | 0.3984 | 0.376 | 0.5062 |
| 1.1078 | 36.0 | 3672 | 1.1141 | 0.2919 | 0.5577 | 0.2664 | 0.1137 | 0.2548 | 0.3932 | 0.3459 | 0.5121 | 0.5276 | 0.3414 | 0.5069 | 0.6317 | 0.6082 | 0.8028 | 0.1585 | 0.5182 | 0.2206 | 0.4307 | 0.0893 | 0.3873 | 0.3828 | 0.4988 |
| 1.1058 | 37.0 | 3774 | 1.1030 | 0.2998 | 0.5571 | 0.2839 | 0.0986 | 0.2493 | 0.4103 | 0.3382 | 0.5038 | 0.5226 | 0.3159 | 0.4878 | 0.6339 | 0.6137 | 0.7979 | 0.1434 | 0.5109 | 0.2409 | 0.4525 | 0.1156 | 0.3556 | 0.3854 | 0.4963 |
| 1.0858 | 38.0 | 3876 | 1.1045 | 0.2903 | 0.5478 | 0.2586 | 0.1247 | 0.2634 | 0.3745 | 0.3242 | 0.4986 | 0.5144 | 0.3195 | 0.4866 | 0.6067 | 0.6152 | 0.791 | 0.1736 | 0.4982 | 0.2114 | 0.4453 | 0.0625 | 0.3286 | 0.389 | 0.5093 |
| 1.119 | 39.0 | 3978 | 1.0792 | 0.3029 | 0.5638 | 0.2777 | 0.0902 | 0.2537 | 0.4204 | 0.336 | 0.5012 | 0.5142 | 0.2878 | 0.4634 | 0.6236 | 0.6232 | 0.7854 | 0.1472 | 0.4709 | 0.2203 | 0.4503 | 0.1361 | 0.354 | 0.3876 | 0.5105 |
| 1.0875 | 40.0 | 4080 | 1.0980 | 0.2971 | 0.5562 | 0.2757 | 0.0952 | 0.2547 | 0.4105 | 0.3452 | 0.514 | 0.5306 | 0.3262 | 0.5031 | 0.6313 | 0.6002 | 0.7958 | 0.1773 | 0.5527 | 0.2115 | 0.4419 | 0.1141 | 0.3603 | 0.3825 | 0.5025 |
| 1.0678 | 41.0 | 4182 | 1.0920 | 0.3101 | 0.5739 | 0.2992 | 0.1013 | 0.2653 | 0.4163 | 0.3414 | 0.5251 | 0.5339 | 0.3002 | 0.4982 | 0.6393 | 0.6043 | 0.7931 | 0.1829 | 0.4855 | 0.2159 | 0.4553 | 0.1387 | 0.4143 | 0.4085 | 0.5216 |
| 1.063 | 42.0 | 4284 | 1.0699 | 0.298 | 0.5384 | 0.2756 | 0.0953 | 0.2476 | 0.4072 | 0.3549 | 0.5186 | 0.5331 | 0.2756 | 0.4947 | 0.6508 | 0.6078 | 0.791 | 0.1876 | 0.5073 | 0.1886 | 0.4408 | 0.1123 | 0.4111 | 0.3935 | 0.5154 |
| 1.0203 | 43.0 | 4386 | 1.0743 | 0.2996 | 0.5563 | 0.2799 | 0.1052 | 0.2584 | 0.4007 | 0.3431 | 0.5049 | 0.5176 | 0.2654 | 0.4677 | 0.6334 | 0.6125 | 0.7875 | 0.1773 | 0.4855 | 0.2153 | 0.4447 | 0.1303 | 0.3857 | 0.3625 | 0.4846 |
| 1.0451 | 44.0 | 4488 | 1.0523 | 0.3092 | 0.5677 | 0.298 | 0.1081 | 0.2643 | 0.4169 | 0.3462 | 0.5155 | 0.5306 | 0.3082 | 0.4822 | 0.638 | 0.6089 | 0.8014 | 0.1823 | 0.4727 | 0.2165 | 0.4497 | 0.1286 | 0.4 | 0.4099 | 0.529 |
| 1.0466 | 45.0 | 4590 | 1.0640 | 0.3084 | 0.5758 | 0.2981 | 0.1334 | 0.2597 | 0.4242 | 0.3463 | 0.5165 | 0.5313 | 0.2973 | 0.4779 | 0.6353 | 0.6042 | 0.7778 | 0.1959 | 0.5291 | 0.2111 | 0.4391 | 0.1519 | 0.4 | 0.3787 | 0.5105 |
| 1.0193 | 46.0 | 4692 | 1.0589 | 0.3088 | 0.5772 | 0.2879 | 0.097 | 0.254 | 0.4288 | 0.3425 | 0.5165 | 0.5297 | 0.3159 | 0.4744 | 0.6496 | 0.61 | 0.8069 | 0.185 | 0.4891 | 0.2327 | 0.4441 | 0.1067 | 0.3698 | 0.4097 | 0.5383 |
| 0.9959 | 47.0 | 4794 | 1.0625 | 0.3128 | 0.5804 | 0.2986 | 0.1159 | 0.2762 | 0.414 | 0.3518 | 0.5142 | 0.5268 | 0.2813 | 0.5191 | 0.6351 | 0.5796 | 0.8049 | 0.2084 | 0.4836 | 0.2305 | 0.4525 | 0.1401 | 0.3825 | 0.4053 | 0.5105 |
| 1.0161 | 48.0 | 4896 | 1.1113 | 0.2994 | 0.5631 | 0.2718 | 0.1116 | 0.2375 | 0.4107 | 0.3383 | 0.5089 | 0.5205 | 0.3101 | 0.4832 | 0.6215 | 0.6176 | 0.7889 | 0.1863 | 0.5291 | 0.2011 | 0.4358 | 0.1131 | 0.3556 | 0.3788 | 0.4932 |
| 1.0175 | 49.0 | 4998 | 1.0668 | 0.3173 | 0.5917 | 0.2847 | 0.1087 | 0.2504 | 0.4395 | 0.3498 | 0.5015 | 0.5104 | 0.2699 | 0.4529 | 0.6335 | 0.6292 | 0.7778 | 0.2088 | 0.5109 | 0.2267 | 0.4223 | 0.1358 | 0.3556 | 0.3858 | 0.4852 |
| 0.9979 | 50.0 | 5100 | 1.0493 | 0.3214 | 0.5978 | 0.3056 | 0.1125 | 0.2544 | 0.4391 | 0.3528 | 0.522 | 0.5394 | 0.2902 | 0.4955 | 0.6627 | 0.6278 | 0.8 | 0.2297 | 0.56 | 0.2442 | 0.4637 | 0.1171 | 0.3635 | 0.3881 | 0.5099 |
| 0.9904 | 51.0 | 5202 | 1.0453 | 0.3401 | 0.607 | 0.321 | 0.1441 | 0.2577 | 0.454 | 0.3673 | 0.5223 | 0.5363 | 0.3374 | 0.4618 | 0.6465 | 0.6503 | 0.7771 | 0.2359 | 0.5436 | 0.2344 | 0.4318 | 0.1581 | 0.4159 | 0.4217 | 0.513 |
| 0.9846 | 52.0 | 5304 | 1.0403 | 0.326 | 0.5822 | 0.327 | 0.1025 | 0.2834 | 0.4381 | 0.3643 | 0.5234 | 0.531 | 0.2839 | 0.4865 | 0.6413 | 0.6281 | 0.7986 | 0.1991 | 0.5182 | 0.2502 | 0.4514 | 0.1201 | 0.3524 | 0.4324 | 0.5346 |
| 0.9633 | 53.0 | 5406 | 1.0478 | 0.3181 | 0.5837 | 0.3182 | 0.0995 | 0.2797 | 0.4298 | 0.36 | 0.5191 | 0.5322 | 0.2812 | 0.4853 | 0.6551 | 0.631 | 0.8069 | 0.1657 | 0.4836 | 0.2318 | 0.4469 | 0.157 | 0.4 | 0.4049 | 0.5235 |
| 0.9673 | 54.0 | 5508 | 1.0160 | 0.3436 | 0.6169 | 0.3341 | 0.1415 | 0.2963 | 0.4787 | 0.3677 | 0.5326 | 0.5409 | 0.2983 | 0.4858 | 0.6692 | 0.6295 | 0.8069 | 0.2235 | 0.5182 | 0.2507 | 0.4385 | 0.1908 | 0.4095 | 0.4235 | 0.5315 |
| 0.932 | 55.0 | 5610 | 1.0526 | 0.3349 | 0.6158 | 0.3244 | 0.1117 | 0.2969 | 0.4433 | 0.3581 | 0.528 | 0.5416 | 0.3187 | 0.4857 | 0.6567 | 0.6113 | 0.8076 | 0.2424 | 0.5218 | 0.2464 | 0.4531 | 0.1768 | 0.419 | 0.3976 | 0.5062 |
| 0.952 | 56.0 | 5712 | 1.0479 | 0.3293 | 0.6097 | 0.2897 | 0.1166 | 0.2852 | 0.4376 | 0.3632 | 0.5245 | 0.5352 | 0.2998 | 0.5127 | 0.6473 | 0.6394 | 0.7965 | 0.2297 | 0.5309 | 0.2437 | 0.4464 | 0.1251 | 0.3857 | 0.4087 | 0.5167 |
| 0.9407 | 57.0 | 5814 | 1.0272 | 0.3283 | 0.6069 | 0.3116 | 0.1085 | 0.268 | 0.465 | 0.3657 | 0.5302 | 0.5436 | 0.3034 | 0.4854 | 0.6705 | 0.6336 | 0.8021 | 0.2297 | 0.5327 | 0.2335 | 0.4609 | 0.1385 | 0.4 | 0.4064 | 0.5222 |
| 0.9397 | 58.0 | 5916 | 1.0231 | 0.349 | 0.6351 | 0.3303 | 0.1188 | 0.2873 | 0.4816 | 0.3715 | 0.5423 | 0.5536 | 0.3065 | 0.5154 | 0.6701 | 0.6395 | 0.809 | 0.2533 | 0.5473 | 0.2523 | 0.4603 | 0.1838 | 0.4333 | 0.416 | 0.5179 |
| 0.9314 | 59.0 | 6018 | 1.0115 | 0.3483 | 0.6266 | 0.3305 | 0.1316 | 0.3084 | 0.4695 | 0.371 | 0.5311 | 0.5432 | 0.322 | 0.4979 | 0.6664 | 0.6387 | 0.8111 | 0.2686 | 0.5564 | 0.2601 | 0.4626 | 0.1603 | 0.3778 | 0.414 | 0.508 |
| 0.9166 | 60.0 | 6120 | 1.0243 | 0.3391 | 0.6249 | 0.3221 | 0.1232 | 0.2851 | 0.4776 | 0.3666 | 0.5371 | 0.5505 | 0.3372 | 0.5103 | 0.6696 | 0.6324 | 0.7979 | 0.2062 | 0.54 | 0.2379 | 0.4615 | 0.2038 | 0.4317 | 0.4152 | 0.5216 |
| 0.924 | 61.0 | 6222 | 1.0122 | 0.3354 | 0.6173 | 0.3128 | 0.1347 | 0.2828 | 0.4528 | 0.3614 | 0.5374 | 0.5528 | 0.3338 | 0.5168 | 0.6655 | 0.6429 | 0.8014 | 0.2192 | 0.5527 | 0.2427 | 0.4698 | 0.1652 | 0.427 | 0.4071 | 0.513 |
| 0.9165 | 62.0 | 6324 | 1.0434 | 0.3345 | 0.6152 | 0.3282 | 0.1142 | 0.2817 | 0.4585 | 0.3644 | 0.531 | 0.5431 | 0.2893 | 0.5075 | 0.6588 | 0.6436 | 0.7965 | 0.2145 | 0.5327 | 0.2701 | 0.4637 | 0.1629 | 0.427 | 0.3815 | 0.4957 |
| 0.9005 | 63.0 | 6426 | 0.9866 | 0.3572 | 0.6479 | 0.3335 | 0.128 | 0.2956 | 0.4984 | 0.376 | 0.5559 | 0.5668 | 0.3083 | 0.5304 | 0.6817 | 0.6512 | 0.8125 | 0.2538 | 0.5618 | 0.2758 | 0.4693 | 0.1885 | 0.4492 | 0.4167 | 0.5414 |
| 0.8996 | 64.0 | 6528 | 0.9901 | 0.3477 | 0.6335 | 0.3346 | 0.1162 | 0.2967 | 0.4793 | 0.3704 | 0.5415 | 0.5534 | 0.2957 | 0.5201 | 0.675 | 0.643 | 0.8056 | 0.2311 | 0.5418 | 0.2598 | 0.4838 | 0.1697 | 0.3921 | 0.4348 | 0.5438 |
| 0.8975 | 65.0 | 6630 | 1.0033 | 0.3397 | 0.634 | 0.3112 | 0.1167 | 0.2969 | 0.4509 | 0.3652 | 0.5342 | 0.5486 | 0.362 | 0.5161 | 0.6506 | 0.6341 | 0.7951 | 0.249 | 0.5255 | 0.2452 | 0.4726 | 0.1589 | 0.4206 | 0.4116 | 0.529 |
| 0.8908 | 66.0 | 6732 | 0.9923 | 0.3449 | 0.6215 | 0.3384 | 0.123 | 0.2871 | 0.474 | 0.3701 | 0.5418 | 0.5559 | 0.3346 | 0.5038 | 0.6677 | 0.6338 | 0.8007 | 0.2394 | 0.5309 | 0.2635 | 0.486 | 0.1822 | 0.4349 | 0.4057 | 0.5272 |
| 0.8959 | 67.0 | 6834 | 1.0181 | 0.3435 | 0.6396 | 0.3147 | 0.1244 | 0.3009 | 0.4555 | 0.3701 | 0.5421 | 0.5582 | 0.3111 | 0.5186 | 0.6676 | 0.6351 | 0.8069 | 0.2261 | 0.56 | 0.246 | 0.4626 | 0.1869 | 0.4127 | 0.4235 | 0.5488 |
| 0.8859 | 68.0 | 6936 | 1.0185 | 0.3487 | 0.6383 | 0.3248 | 0.1315 | 0.3021 | 0.4684 | 0.3732 | 0.5443 | 0.5579 | 0.313 | 0.5189 | 0.6687 | 0.6356 | 0.8014 | 0.262 | 0.5545 | 0.2352 | 0.4603 | 0.1923 | 0.4333 | 0.4187 | 0.5401 |
| 0.8789 | 69.0 | 7038 | 0.9968 | 0.3569 | 0.6402 | 0.3474 | 0.1113 | 0.3215 | 0.4761 | 0.376 | 0.5435 | 0.5574 | 0.3 | 0.5361 | 0.6643 | 0.6316 | 0.8076 | 0.2636 | 0.5418 | 0.2702 | 0.4654 | 0.19 | 0.4349 | 0.4289 | 0.537 |
| 0.8675 | 70.0 | 7140 | 0.9992 | 0.3535 | 0.6402 | 0.3588 | 0.1253 | 0.301 | 0.478 | 0.3704 | 0.5412 | 0.5562 | 0.3174 | 0.5313 | 0.6622 | 0.6274 | 0.8104 | 0.2616 | 0.5491 | 0.2785 | 0.4693 | 0.1847 | 0.4302 | 0.4153 | 0.5222 |
| 0.8513 | 71.0 | 7242 | 1.0028 | 0.3543 | 0.6439 | 0.3148 | 0.12 | 0.3177 | 0.4679 | 0.3838 | 0.5404 | 0.5554 | 0.3157 | 0.5152 | 0.6597 | 0.646 | 0.8174 | 0.2473 | 0.5564 | 0.2541 | 0.462 | 0.2172 | 0.419 | 0.407 | 0.5222 |
| 0.8621 | 72.0 | 7344 | 1.0029 | 0.3485 | 0.6401 | 0.3418 | 0.1305 | 0.3149 | 0.4686 | 0.3754 | 0.5321 | 0.5483 | 0.2893 | 0.5143 | 0.6649 | 0.6281 | 0.8083 | 0.2476 | 0.5436 | 0.2695 | 0.4626 | 0.1768 | 0.3952 | 0.4206 | 0.5315 |
| 0.8598 | 73.0 | 7446 | 1.0067 | 0.3558 | 0.6601 | 0.3215 | 0.1212 | 0.3124 | 0.4768 | 0.3692 | 0.539 | 0.5533 | 0.3012 | 0.5177 | 0.6634 | 0.6468 | 0.8028 | 0.2425 | 0.5236 | 0.264 | 0.457 | 0.2102 | 0.4492 | 0.4154 | 0.534 |
| 0.858 | 74.0 | 7548 | 0.9737 | 0.3611 | 0.6578 | 0.3395 | 0.1112 | 0.318 | 0.4917 | 0.3792 | 0.5544 | 0.5668 | 0.3003 | 0.5348 | 0.6774 | 0.6436 | 0.8083 | 0.2561 | 0.5855 | 0.279 | 0.4665 | 0.2096 | 0.4381 | 0.4171 | 0.5358 |
| 0.8404 | 75.0 | 7650 | 0.9834 | 0.3638 | 0.6521 | 0.3412 | 0.1358 | 0.3115 | 0.4937 | 0.3866 | 0.546 | 0.5596 | 0.3181 | 0.5281 | 0.6844 | 0.6387 | 0.7986 | 0.2642 | 0.5582 | 0.2725 | 0.4726 | 0.2278 | 0.4429 | 0.4158 | 0.5259 |
| 0.8558 | 76.0 | 7752 | 0.9765 | 0.3656 | 0.6597 | 0.3563 | 0.1068 | 0.3392 | 0.4915 | 0.3845 | 0.5463 | 0.5607 | 0.3079 | 0.5338 | 0.6779 | 0.6511 | 0.8042 | 0.2675 | 0.56 | 0.2923 | 0.4799 | 0.2092 | 0.4365 | 0.4079 | 0.5228 |
| 0.8338 | 77.0 | 7854 | 0.9860 | 0.3682 | 0.6592 | 0.331 | 0.1094 | 0.3315 | 0.4936 | 0.3778 | 0.5518 | 0.5637 | 0.3483 | 0.5224 | 0.6737 | 0.6595 | 0.8049 | 0.2605 | 0.5673 | 0.2689 | 0.4709 | 0.2163 | 0.4444 | 0.4361 | 0.5309 |
| 0.8454 | 78.0 | 7956 | 0.9876 | 0.366 | 0.6662 | 0.3421 | 0.1131 | 0.3236 | 0.489 | 0.3807 | 0.5459 | 0.5562 | 0.3028 | 0.5072 | 0.6758 | 0.6509 | 0.8014 | 0.278 | 0.5418 | 0.2593 | 0.4648 | 0.21 | 0.4317 | 0.432 | 0.5414 |
| 0.8319 | 79.0 | 8058 | 0.9771 | 0.3651 | 0.6651 | 0.3351 | 0.1234 | 0.3099 | 0.4936 | 0.3839 | 0.5498 | 0.5642 | 0.317 | 0.5096 | 0.6813 | 0.6521 | 0.816 | 0.2753 | 0.5509 | 0.2707 | 0.4804 | 0.1979 | 0.4317 | 0.4294 | 0.542 |
| 0.8368 | 80.0 | 8160 | 0.9886 | 0.3654 | 0.6689 | 0.3357 | 0.1371 | 0.3275 | 0.4843 | 0.3767 | 0.5479 | 0.5584 | 0.3301 | 0.5112 | 0.6671 | 0.6367 | 0.7972 | 0.2799 | 0.56 | 0.2777 | 0.4827 | 0.2147 | 0.427 | 0.4178 | 0.5253 |
| 0.8346 | 81.0 | 8262 | 0.9593 | 0.3663 | 0.6595 | 0.3305 | 0.1097 | 0.3251 | 0.4945 | 0.3839 | 0.5541 | 0.5656 | 0.3244 | 0.5284 | 0.6835 | 0.6385 | 0.8062 | 0.2747 | 0.5527 | 0.2886 | 0.4944 | 0.203 | 0.4333 | 0.4268 | 0.5414 |
| 0.8247 | 82.0 | 8364 | 0.9591 | 0.3674 | 0.6658 | 0.3293 | 0.1102 | 0.319 | 0.4972 | 0.3788 | 0.5496 | 0.5616 | 0.3093 | 0.5183 | 0.6776 | 0.6414 | 0.8097 | 0.2621 | 0.5545 | 0.2876 | 0.4788 | 0.2113 | 0.4222 | 0.4344 | 0.5426 |
| 0.8021 | 83.0 | 8466 | 0.9635 | 0.373 | 0.6714 | 0.3418 | 0.1179 | 0.3261 | 0.5015 | 0.3839 | 0.5507 | 0.562 | 0.323 | 0.5185 | 0.6753 | 0.6439 | 0.8111 | 0.2769 | 0.5545 | 0.2796 | 0.4732 | 0.2274 | 0.4317 | 0.4369 | 0.5395 |
| 0.8113 | 84.0 | 8568 | 0.9459 | 0.3785 | 0.6794 | 0.3632 | 0.1305 | 0.3286 | 0.514 | 0.388 | 0.5518 | 0.5654 | 0.3149 | 0.5341 | 0.679 | 0.6467 | 0.8132 | 0.2899 | 0.5564 | 0.2881 | 0.481 | 0.2335 | 0.4333 | 0.4343 | 0.5432 |
| 0.8146 | 85.0 | 8670 | 0.9516 | 0.3798 | 0.69 | 0.3588 | 0.1255 | 0.3253 | 0.5141 | 0.3884 | 0.553 | 0.5664 | 0.3204 | 0.5261 | 0.6825 | 0.6431 | 0.8049 | 0.2913 | 0.5582 | 0.3048 | 0.4844 | 0.2255 | 0.4444 | 0.4341 | 0.5401 |
| 0.8129 | 86.0 | 8772 | 0.9782 | 0.3791 | 0.6869 | 0.3499 | 0.1286 | 0.3203 | 0.5144 | 0.3914 | 0.5523 | 0.566 | 0.3086 | 0.5321 | 0.6841 | 0.642 | 0.8062 | 0.2851 | 0.5782 | 0.2948 | 0.4682 | 0.2418 | 0.4365 | 0.4316 | 0.5407 |
| 0.7919 | 87.0 | 8874 | 0.9658 | 0.382 | 0.6836 | 0.3658 | 0.1333 | 0.3282 | 0.5098 | 0.386 | 0.5553 | 0.5696 | 0.3325 | 0.5265 | 0.6809 | 0.6517 | 0.8097 | 0.2841 | 0.5727 | 0.3035 | 0.4872 | 0.2244 | 0.4286 | 0.4462 | 0.55 |
| 0.7972 | 88.0 | 8976 | 0.9767 | 0.376 | 0.6721 | 0.3546 | 0.1168 | 0.3185 | 0.507 | 0.3862 | 0.5568 | 0.5713 | 0.3286 | 0.55 | 0.6792 | 0.6441 | 0.8111 | 0.2799 | 0.5691 | 0.2954 | 0.4832 | 0.2197 | 0.4492 | 0.4411 | 0.5438 |
| 0.7994 | 89.0 | 9078 | 0.9656 | 0.382 | 0.669 | 0.3615 | 0.1262 | 0.3273 | 0.5104 | 0.3907 | 0.5606 | 0.5717 | 0.3356 | 0.5459 | 0.6844 | 0.6519 | 0.8153 | 0.2958 | 0.5636 | 0.2968 | 0.4872 | 0.2164 | 0.4381 | 0.4489 | 0.5543 |
| 0.789 | 90.0 | 9180 | 0.9649 | 0.3786 | 0.6728 | 0.3539 | 0.1144 | 0.3136 | 0.5142 | 0.3918 | 0.5544 | 0.5652 | 0.3281 | 0.5252 | 0.6838 | 0.651 | 0.8097 | 0.2838 | 0.5509 | 0.3014 | 0.4804 | 0.2118 | 0.4349 | 0.4451 | 0.55 |
| 0.799 | 91.0 | 9282 | 0.9637 | 0.3826 | 0.6882 | 0.3597 | 0.1366 | 0.33 | 0.5186 | 0.3972 | 0.5646 | 0.5763 | 0.366 | 0.5349 | 0.6859 | 0.6376 | 0.8069 | 0.2985 | 0.5855 | 0.2998 | 0.481 | 0.2427 | 0.4603 | 0.4343 | 0.5475 |
| 0.7742 | 92.0 | 9384 | 0.9634 | 0.3732 | 0.6658 | 0.3523 | 0.1325 | 0.3044 | 0.5138 | 0.391 | 0.5533 | 0.5636 | 0.3418 | 0.5087 | 0.6828 | 0.6481 | 0.8097 | 0.2727 | 0.54 | 0.2907 | 0.4732 | 0.2244 | 0.454 | 0.4301 | 0.5414 |
| 0.789 | 93.0 | 9486 | 0.9582 | 0.3734 | 0.6717 | 0.3496 | 0.1235 | 0.3045 | 0.5036 | 0.3934 | 0.5599 | 0.5709 | 0.3576 | 0.5285 | 0.6807 | 0.6445 | 0.8062 | 0.2755 | 0.5509 | 0.2971 | 0.4855 | 0.2188 | 0.4651 | 0.431 | 0.5469 |
| 0.7788 | 94.0 | 9588 | 0.9508 | 0.3794 | 0.6814 | 0.3451 | 0.1139 | 0.3162 | 0.5163 | 0.3954 | 0.5585 | 0.5704 | 0.3361 | 0.5368 | 0.6867 | 0.6516 | 0.8146 | 0.2837 | 0.5582 | 0.298 | 0.4888 | 0.2231 | 0.446 | 0.4404 | 0.5444 |
| 0.7757 | 95.0 | 9690 | 0.9593 | 0.3785 | 0.6749 | 0.3541 | 0.1197 | 0.322 | 0.5183 | 0.3983 | 0.558 | 0.5715 | 0.3425 | 0.5356 | 0.6857 | 0.6436 | 0.8132 | 0.2853 | 0.5618 | 0.2965 | 0.4832 | 0.226 | 0.4492 | 0.4412 | 0.55 |
| 0.7672 | 96.0 | 9792 | 0.9619 | 0.3781 | 0.6715 | 0.3528 | 0.1251 | 0.3249 | 0.5164 | 0.3944 | 0.5569 | 0.571 | 0.3525 | 0.53 | 0.685 | 0.645 | 0.8132 | 0.2836 | 0.5582 | 0.2902 | 0.4894 | 0.2391 | 0.4508 | 0.4328 | 0.5432 |
| 0.7646 | 97.0 | 9894 | 0.9548 | 0.3788 | 0.6778 | 0.3553 | 0.1221 | 0.3209 | 0.5197 | 0.3965 | 0.5568 | 0.5692 | 0.353 | 0.5344 | 0.6819 | 0.6463 | 0.8167 | 0.2846 | 0.5582 | 0.2956 | 0.4838 | 0.2313 | 0.4413 | 0.4362 | 0.5463 |
| 0.7742 | 98.0 | 9996 | 0.9617 | 0.3802 | 0.6793 | 0.3575 | 0.1269 | 0.3209 | 0.52 | 0.3957 | 0.5583 | 0.5702 | 0.3563 | 0.5287 | 0.6829 | 0.6474 | 0.8146 | 0.2867 | 0.5564 | 0.2991 | 0.4872 | 0.2307 | 0.4429 | 0.4373 | 0.55 |
| 0.7704 | 99.0 | 10098 | 0.9599 | 0.3766 | 0.6798 | 0.3493 | 0.1305 | 0.3206 | 0.5156 | 0.3957 | 0.5592 | 0.5707 | 0.3523 | 0.5352 | 0.6809 | 0.6434 | 0.8125 | 0.2833 | 0.5582 | 0.2967 | 0.4872 | 0.2228 | 0.4476 | 0.437 | 0.5481 |
| 0.7546 | 100.0 | 10200 | 0.9579 | 0.3769 | 0.6804 | 0.3483 | 0.1331 | 0.3109 | 0.5141 | 0.3946 | 0.5584 | 0.5691 | 0.3543 | 0.5333 | 0.6781 | 0.646 | 0.8118 | 0.2809 | 0.5564 | 0.2972 | 0.4827 | 0.223 | 0.4476 | 0.4374 | 0.5469 |
### Framework versions
- Transformers 4.47.1
- Pytorch 2.5.1+cu121
- Datasets 3.2.0
- Tokenizers 0.21.0
|