File size: 36,092 Bytes
d3cf2e0 adbb639 d3cf2e0 adbb639 d3cf2e0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 |
---
library_name: transformers
license: apache-2.0
base_model: facebook/detr-resnet-50
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: detr-finetuned-ppe
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# detr-finetuned-ppe
This model is a fine-tuned version of [facebook/detr-resnet-50](https://huggingface.co/facebook/detr-resnet-50) on the Francesco/construction-safety-gsnvb dataset.
It achieves the following results on the evaluation set:
- Loss: 1.0499
- Map: 0.3948
- Map 50: 0.7609
- Map 75: 0.3767
- Map Small: 0.0619
- Map Medium: 0.3097
- Map Large: 0.4634
- Mar 1: 0.2239
- Mar 10: 0.5134
- Mar 100: 0.5368
- Mar Small: 0.1158
- Mar Medium: 0.4656
- Mar Large: 0.5905
- Map Helmet: 0.4535
- Mar 100 Helmet: 0.5418
- Map No-helmet: 0.1846
- Mar 100 No-helmet: 0.3125
- Map No-vest: 0.3122
- Mar 100 No-vest: 0.4984
- Map Person: 0.5839
- Mar 100 Person: 0.7285
- Map Vest: 0.4398
- Mar 100 Vest: 0.6031
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 1337
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0
- mixed_precision_training: Native AMP
### Training results
| Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Helmet | Mar 100 Helmet | Map No-helmet | Mar 100 No-helmet | Map No-vest | Mar 100 No-vest | Map Person | Mar 100 Person | Map Vest | Mar 100 Vest |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:----------:|:--------------:|:-------------:|:-----------------:|:-----------:|:---------------:|:----------:|:--------------:|:--------:|:------------:|
| 2.5109 | 1.0 | 125 | 1.9828 | 0.0558 | 0.1174 | 0.0493 | 0.0064 | 0.0485 | 0.0694 | 0.0648 | 0.1756 | 0.2281 | 0.0719 | 0.136 | 0.2687 | 0.0782 | 0.4985 | 0.0 | 0.0 | 0.0 | 0.0 | 0.2008 | 0.6421 | 0.0 | 0.0 |
| 1.7905 | 2.0 | 250 | 1.6901 | 0.0831 | 0.1758 | 0.0628 | 0.018 | 0.0768 | 0.1105 | 0.1162 | 0.2681 | 0.3363 | 0.0789 | 0.2158 | 0.4014 | 0.1284 | 0.5077 | 0.0 | 0.0 | 0.0 | 0.0 | 0.2131 | 0.6949 | 0.0739 | 0.4789 |
| 1.6164 | 3.0 | 375 | 1.5478 | 0.1351 | 0.2758 | 0.1104 | 0.0084 | 0.1233 | 0.1683 | 0.1286 | 0.3095 | 0.3542 | 0.0737 | 0.2677 | 0.4032 | 0.2175 | 0.5433 | 0.0 | 0.0 | 0.0033 | 0.0213 | 0.3345 | 0.6636 | 0.1205 | 0.543 |
| 1.3782 | 4.0 | 500 | 1.4839 | 0.1675 | 0.339 | 0.1427 | 0.0194 | 0.1138 | 0.2255 | 0.1403 | 0.3236 | 0.3638 | 0.0754 | 0.237 | 0.4257 | 0.3086 | 0.5376 | 0.0 | 0.0 | 0.0028 | 0.0787 | 0.3963 | 0.6505 | 0.1296 | 0.5523 |
| 1.2708 | 5.0 | 625 | 1.3486 | 0.208 | 0.4184 | 0.1731 | 0.012 | 0.1542 | 0.267 | 0.1361 | 0.3427 | 0.3664 | 0.0491 | 0.3041 | 0.4139 | 0.345 | 0.4974 | 0.0 | 0.0 | 0.0058 | 0.1459 | 0.4403 | 0.6509 | 0.2488 | 0.5375 |
| 1.2041 | 6.0 | 750 | 1.2969 | 0.225 | 0.4379 | 0.2059 | 0.0235 | 0.1577 | 0.2902 | 0.1632 | 0.3864 | 0.4178 | 0.0614 | 0.291 | 0.4897 | 0.3662 | 0.5165 | 0.0 | 0.0 | 0.0245 | 0.4197 | 0.4365 | 0.6514 | 0.2976 | 0.5016 |
| 1.167 | 7.0 | 875 | 1.2861 | 0.2344 | 0.4597 | 0.2018 | 0.0109 | 0.1613 | 0.2969 | 0.1589 | 0.3848 | 0.4244 | 0.0298 | 0.3216 | 0.489 | 0.3452 | 0.4825 | 0.0 | 0.0 | 0.0349 | 0.4574 | 0.4691 | 0.6397 | 0.3228 | 0.5422 |
| 1.1438 | 8.0 | 1000 | 1.3371 | 0.2339 | 0.4571 | 0.2078 | 0.0124 | 0.1638 | 0.29 | 0.1722 | 0.3952 | 0.421 | 0.0386 | 0.3192 | 0.4806 | 0.371 | 0.5046 | 0.0 | 0.0 | 0.0285 | 0.4656 | 0.4588 | 0.6416 | 0.3113 | 0.493 |
| 1.1373 | 9.0 | 1125 | 1.2976 | 0.2392 | 0.4773 | 0.2183 | 0.0197 | 0.1831 | 0.297 | 0.1647 | 0.3854 | 0.4153 | 0.0544 | 0.3236 | 0.479 | 0.3741 | 0.5072 | 0.0 | 0.0 | 0.0544 | 0.382 | 0.4769 | 0.6804 | 0.2905 | 0.507 |
| 1.1265 | 10.0 | 1250 | 1.2837 | 0.2404 | 0.4778 | 0.217 | 0.0218 | 0.1868 | 0.2931 | 0.16 | 0.3908 | 0.4199 | 0.0526 | 0.3448 | 0.4705 | 0.3835 | 0.5206 | 0.0 | 0.0 | 0.0609 | 0.4623 | 0.4815 | 0.6495 | 0.2763 | 0.4672 |
| 1.0924 | 11.0 | 1375 | 1.1893 | 0.272 | 0.5167 | 0.252 | 0.0293 | 0.1892 | 0.3339 | 0.1792 | 0.412 | 0.4501 | 0.0667 | 0.368 | 0.5018 | 0.3881 | 0.5299 | 0.0 | 0.0 | 0.0721 | 0.5148 | 0.5236 | 0.6762 | 0.376 | 0.5297 |
| 1.0577 | 12.0 | 1500 | 1.2619 | 0.262 | 0.5288 | 0.226 | 0.0366 | 0.1793 | 0.3175 | 0.1741 | 0.3945 | 0.4351 | 0.0719 | 0.3543 | 0.4875 | 0.3686 | 0.4964 | 0.0 | 0.0 | 0.0684 | 0.4803 | 0.4905 | 0.6621 | 0.3825 | 0.5367 |
| 1.058 | 13.0 | 1625 | 1.2249 | 0.286 | 0.535 | 0.2727 | 0.029 | 0.227 | 0.3347 | 0.1812 | 0.4169 | 0.4501 | 0.0667 | 0.3595 | 0.5052 | 0.4021 | 0.5165 | 0.005 | 0.0167 | 0.0932 | 0.4967 | 0.5213 | 0.6916 | 0.4082 | 0.5289 |
| 1.0255 | 14.0 | 1750 | 1.2688 | 0.2831 | 0.5428 | 0.2802 | 0.0337 | 0.1855 | 0.3399 | 0.1797 | 0.4067 | 0.4405 | 0.0614 | 0.3503 | 0.4961 | 0.4099 | 0.5258 | 0.0 | 0.0 | 0.1036 | 0.4934 | 0.4915 | 0.6584 | 0.4104 | 0.525 |
| 1.0236 | 15.0 | 1875 | 1.2698 | 0.2663 | 0.5138 | 0.253 | 0.0281 | 0.2051 | 0.3141 | 0.1742 | 0.4018 | 0.4302 | 0.0579 | 0.3234 | 0.4836 | 0.3949 | 0.5119 | 0.0 | 0.0 | 0.112 | 0.4328 | 0.5151 | 0.7056 | 0.3097 | 0.5008 |
| 1.0098 | 16.0 | 2000 | 1.2096 | 0.2869 | 0.5506 | 0.2667 | 0.0269 | 0.2097 | 0.3437 | 0.1897 | 0.4196 | 0.4527 | 0.0667 | 0.3446 | 0.515 | 0.3993 | 0.5098 | 0.0021 | 0.0208 | 0.0932 | 0.4754 | 0.5153 | 0.6967 | 0.4246 | 0.5609 |
| 0.9636 | 17.0 | 2125 | 1.1379 | 0.2929 | 0.564 | 0.269 | 0.0285 | 0.2219 | 0.3811 | 0.1874 | 0.4375 | 0.4642 | 0.0754 | 0.3713 | 0.5393 | 0.4182 | 0.5139 | 0.0053 | 0.075 | 0.1532 | 0.5426 | 0.5408 | 0.7136 | 0.3469 | 0.4758 |
| 0.962 | 18.0 | 2250 | 1.2004 | 0.2941 | 0.5636 | 0.2888 | 0.0297 | 0.23 | 0.3505 | 0.1887 | 0.4349 | 0.4616 | 0.0509 | 0.3711 | 0.5168 | 0.3959 | 0.4938 | 0.0028 | 0.0458 | 0.1337 | 0.5049 | 0.5262 | 0.7033 | 0.412 | 0.5602 |
| 0.9555 | 19.0 | 2375 | 1.1228 | 0.3116 | 0.5828 | 0.2922 | 0.0225 | 0.2412 | 0.3766 | 0.1805 | 0.4539 | 0.4877 | 0.0614 | 0.3979 | 0.5619 | 0.4299 | 0.5309 | 0.0073 | 0.0958 | 0.1398 | 0.5393 | 0.5455 | 0.7178 | 0.4358 | 0.5547 |
| 0.9251 | 20.0 | 2500 | 1.1541 | 0.3116 | 0.5875 | 0.2999 | 0.028 | 0.2293 | 0.4057 | 0.2139 | 0.4652 | 0.4973 | 0.0561 | 0.4187 | 0.5584 | 0.4107 | 0.5 | 0.0592 | 0.1958 | 0.1483 | 0.5115 | 0.5294 | 0.7126 | 0.4106 | 0.5664 |
| 0.9298 | 21.0 | 2625 | 1.1406 | 0.3091 | 0.591 | 0.2913 | 0.035 | 0.2095 | 0.3635 | 0.2027 | 0.4631 | 0.494 | 0.0632 | 0.3792 | 0.5336 | 0.4337 | 0.533 | 0.0212 | 0.1375 | 0.1154 | 0.5016 | 0.5318 | 0.7019 | 0.4432 | 0.5961 |
| 0.9384 | 22.0 | 2750 | 1.1709 | 0.2984 | 0.5983 | 0.2653 | 0.0309 | 0.2227 | 0.356 | 0.1979 | 0.4421 | 0.4706 | 0.0526 | 0.3809 | 0.5139 | 0.3935 | 0.517 | 0.0194 | 0.0792 | 0.1556 | 0.5 | 0.51 | 0.6879 | 0.4135 | 0.5688 |
| 0.932 | 23.0 | 2875 | 1.1606 | 0.3024 | 0.5767 | 0.2927 | 0.0143 | 0.2188 | 0.3643 | 0.2012 | 0.4343 | 0.4543 | 0.0351 | 0.3625 | 0.5066 | 0.3937 | 0.4794 | 0.0222 | 0.0708 | 0.1487 | 0.4754 | 0.5293 | 0.6967 | 0.4181 | 0.5492 |
| 0.9298 | 24.0 | 3000 | 1.1233 | 0.3052 | 0.5806 | 0.2883 | 0.0302 | 0.2114 | 0.3692 | 0.2053 | 0.4602 | 0.4842 | 0.0632 | 0.3951 | 0.5177 | 0.3979 | 0.499 | 0.0304 | 0.1708 | 0.1618 | 0.4754 | 0.536 | 0.7107 | 0.3997 | 0.5648 |
| 0.9172 | 25.0 | 3125 | 1.1104 | 0.3169 | 0.6001 | 0.2979 | 0.0234 | 0.2242 | 0.3795 | 0.2 | 0.4626 | 0.4864 | 0.0491 | 0.4061 | 0.5225 | 0.4179 | 0.5139 | 0.0263 | 0.1042 | 0.1934 | 0.5164 | 0.5305 | 0.7075 | 0.4164 | 0.5898 |
| 0.8898 | 26.0 | 3250 | 1.1196 | 0.3241 | 0.6218 | 0.3101 | 0.0504 | 0.2405 | 0.4022 | 0.1959 | 0.4528 | 0.4823 | 0.0807 | 0.4021 | 0.5336 | 0.4387 | 0.5335 | 0.0172 | 0.0917 | 0.2206 | 0.5164 | 0.5061 | 0.6799 | 0.4379 | 0.5898 |
| 0.8917 | 27.0 | 3375 | 1.0439 | 0.3374 | 0.6444 | 0.3261 | 0.0355 | 0.2518 | 0.4023 | 0.224 | 0.4934 | 0.52 | 0.0772 | 0.4439 | 0.5436 | 0.45 | 0.5351 | 0.0503 | 0.1875 | 0.2058 | 0.5475 | 0.5475 | 0.7285 | 0.4334 | 0.6016 |
| 0.8787 | 28.0 | 3500 | 1.1134 | 0.3303 | 0.6379 | 0.3143 | 0.0197 | 0.2547 | 0.378 | 0.2082 | 0.4709 | 0.5017 | 0.0667 | 0.418 | 0.539 | 0.4113 | 0.5036 | 0.0339 | 0.1292 | 0.2369 | 0.5492 | 0.5332 | 0.7266 | 0.4359 | 0.6 |
| 0.883 | 29.0 | 3625 | 1.1225 | 0.3156 | 0.6336 | 0.2867 | 0.025 | 0.2447 | 0.3632 | 0.2014 | 0.4621 | 0.4898 | 0.0746 | 0.3937 | 0.5254 | 0.3868 | 0.4835 | 0.0196 | 0.125 | 0.2024 | 0.5328 | 0.5395 | 0.7126 | 0.4297 | 0.5953 |
| 0.8696 | 30.0 | 3750 | 1.0521 | 0.3552 | 0.68 | 0.3438 | 0.0227 | 0.2741 | 0.4085 | 0.2235 | 0.4986 | 0.5299 | 0.0474 | 0.4498 | 0.5693 | 0.4338 | 0.5191 | 0.1184 | 0.2792 | 0.2113 | 0.5328 | 0.558 | 0.714 | 0.4547 | 0.6047 |
| 0.8639 | 31.0 | 3875 | 1.0890 | 0.3285 | 0.6298 | 0.3099 | 0.0342 | 0.2473 | 0.4063 | 0.2153 | 0.4859 | 0.5049 | 0.0798 | 0.4127 | 0.544 | 0.435 | 0.5268 | 0.0789 | 0.2417 | 0.2448 | 0.5344 | 0.5462 | 0.7075 | 0.3375 | 0.5141 |
| 0.8479 | 32.0 | 4000 | 1.0418 | 0.3613 | 0.6655 | 0.3486 | 0.0553 | 0.2694 | 0.4411 | 0.2169 | 0.518 | 0.5364 | 0.1053 | 0.4537 | 0.5705 | 0.4646 | 0.5448 | 0.1411 | 0.3458 | 0.2282 | 0.5066 | 0.552 | 0.7033 | 0.4205 | 0.5813 |
| 0.8375 | 33.0 | 4125 | 1.0895 | 0.342 | 0.6686 | 0.3098 | 0.0374 | 0.248 | 0.4414 | 0.2262 | 0.4985 | 0.5157 | 0.0614 | 0.4194 | 0.5884 | 0.438 | 0.5242 | 0.1269 | 0.325 | 0.2639 | 0.5279 | 0.5288 | 0.6967 | 0.3525 | 0.5047 |
| 0.8285 | 34.0 | 4250 | 1.0510 | 0.3576 | 0.6709 | 0.3589 | 0.0289 | 0.2624 | 0.4457 | 0.218 | 0.5088 | 0.5358 | 0.0737 | 0.4211 | 0.6168 | 0.4464 | 0.532 | 0.1416 | 0.3375 | 0.2019 | 0.4754 | 0.5553 | 0.7093 | 0.4426 | 0.625 |
| 0.8398 | 35.0 | 4375 | 1.0646 | 0.3448 | 0.6598 | 0.3461 | 0.033 | 0.2641 | 0.4097 | 0.2262 | 0.5089 | 0.5354 | 0.0763 | 0.4438 | 0.606 | 0.431 | 0.5196 | 0.1202 | 0.325 | 0.1912 | 0.4836 | 0.5487 | 0.7042 | 0.4327 | 0.6445 |
| 0.8327 | 36.0 | 4500 | 1.0480 | 0.3598 | 0.6928 | 0.334 | 0.0306 | 0.2819 | 0.4678 | 0.2234 | 0.5114 | 0.5411 | 0.0667 | 0.451 | 0.6129 | 0.4196 | 0.5113 | 0.1628 | 0.3833 | 0.2531 | 0.4984 | 0.5459 | 0.6986 | 0.4172 | 0.6141 |
| 0.8194 | 37.0 | 4625 | 1.0323 | 0.356 | 0.6866 | 0.334 | 0.0395 | 0.2632 | 0.479 | 0.2202 | 0.5051 | 0.5296 | 0.0746 | 0.4121 | 0.6385 | 0.418 | 0.5093 | 0.1338 | 0.3375 | 0.2652 | 0.5 | 0.5539 | 0.7238 | 0.409 | 0.5773 |
| 0.82 | 38.0 | 4750 | 1.0444 | 0.3564 | 0.6953 | 0.3388 | 0.0411 | 0.2767 | 0.4383 | 0.2318 | 0.5137 | 0.5363 | 0.0596 | 0.4355 | 0.5846 | 0.4249 | 0.5165 | 0.1367 | 0.3583 | 0.2447 | 0.5148 | 0.5426 | 0.6972 | 0.433 | 0.5945 |
| 0.8197 | 39.0 | 4875 | 1.0617 | 0.359 | 0.6728 | 0.337 | 0.0434 | 0.2664 | 0.4577 | 0.2289 | 0.5157 | 0.5415 | 0.1053 | 0.4469 | 0.6131 | 0.4459 | 0.5407 | 0.1162 | 0.35 | 0.2497 | 0.5098 | 0.554 | 0.7201 | 0.4293 | 0.5867 |
| 0.8064 | 40.0 | 5000 | 1.0729 | 0.3635 | 0.7076 | 0.3642 | 0.048 | 0.268 | 0.4452 | 0.2271 | 0.5046 | 0.5334 | 0.086 | 0.4447 | 0.6253 | 0.4333 | 0.517 | 0.1675 | 0.3833 | 0.2596 | 0.5148 | 0.551 | 0.6958 | 0.4061 | 0.5562 |
| 0.796 | 41.0 | 5125 | 1.1061 | 0.359 | 0.7112 | 0.3253 | 0.0359 | 0.2875 | 0.43 | 0.2193 | 0.5111 | 0.5356 | 0.0675 | 0.4415 | 0.5808 | 0.3865 | 0.4897 | 0.136 | 0.3375 | 0.2818 | 0.5197 | 0.5513 | 0.7028 | 0.4391 | 0.6281 |
| 0.8013 | 42.0 | 5250 | 1.0606 | 0.3659 | 0.7225 | 0.3409 | 0.0227 | 0.275 | 0.4292 | 0.218 | 0.5087 | 0.5343 | 0.0579 | 0.446 | 0.5935 | 0.4211 | 0.5093 | 0.1117 | 0.2708 | 0.2921 | 0.5508 | 0.5599 | 0.7037 | 0.4448 | 0.6367 |
| 0.7947 | 43.0 | 5375 | 1.0473 | 0.3659 | 0.699 | 0.3413 | 0.0494 | 0.2698 | 0.4622 | 0.2311 | 0.5197 | 0.5491 | 0.1211 | 0.4527 | 0.6269 | 0.4211 | 0.5134 | 0.167 | 0.425 | 0.2655 | 0.5311 | 0.559 | 0.707 | 0.417 | 0.5688 |
| 0.792 | 44.0 | 5500 | 1.0752 | 0.3654 | 0.7163 | 0.3508 | 0.0469 | 0.2804 | 0.4471 | 0.2243 | 0.5066 | 0.531 | 0.0877 | 0.441 | 0.596 | 0.4316 | 0.5402 | 0.1157 | 0.275 | 0.2922 | 0.518 | 0.5537 | 0.6991 | 0.4337 | 0.6227 |
| 0.7713 | 45.0 | 5625 | 1.0290 | 0.3786 | 0.7036 | 0.3584 | 0.0495 | 0.2775 | 0.459 | 0.2225 | 0.5189 | 0.5448 | 0.0737 | 0.4521 | 0.6117 | 0.4421 | 0.5227 | 0.1884 | 0.3542 | 0.2585 | 0.5197 | 0.5701 | 0.7407 | 0.4341 | 0.5867 |
| 0.7569 | 46.0 | 5750 | 1.0664 | 0.3702 | 0.7162 | 0.3385 | 0.0241 | 0.3008 | 0.446 | 0.2249 | 0.5208 | 0.5498 | 0.0509 | 0.4528 | 0.6383 | 0.4071 | 0.4979 | 0.1928 | 0.375 | 0.2405 | 0.5197 | 0.56 | 0.7182 | 0.4506 | 0.6383 |
| 0.7632 | 47.0 | 5875 | 1.0491 | 0.3669 | 0.7101 | 0.3577 | 0.047 | 0.2875 | 0.4469 | 0.2218 | 0.5138 | 0.543 | 0.136 | 0.462 | 0.621 | 0.4487 | 0.5459 | 0.1173 | 0.3125 | 0.2859 | 0.5361 | 0.5676 | 0.7285 | 0.4149 | 0.5922 |
| 0.7693 | 48.0 | 6000 | 1.0445 | 0.3664 | 0.6865 | 0.3622 | 0.0635 | 0.2783 | 0.4332 | 0.2275 | 0.5122 | 0.5407 | 0.0965 | 0.44 | 0.6027 | 0.4581 | 0.5381 | 0.1285 | 0.3125 | 0.2623 | 0.5279 | 0.5748 | 0.7271 | 0.4085 | 0.5977 |
| 0.7516 | 49.0 | 6125 | 1.0276 | 0.374 | 0.7253 | 0.3508 | 0.0452 | 0.2669 | 0.4398 | 0.2265 | 0.5035 | 0.5359 | 0.0684 | 0.4354 | 0.6124 | 0.4327 | 0.5216 | 0.131 | 0.3208 | 0.2946 | 0.4934 | 0.5596 | 0.7313 | 0.452 | 0.6125 |
| 0.7538 | 50.0 | 6250 | 1.0193 | 0.3692 | 0.7065 | 0.3365 | 0.0591 | 0.2716 | 0.4337 | 0.2229 | 0.5147 | 0.5464 | 0.0965 | 0.4402 | 0.6081 | 0.4553 | 0.5448 | 0.1087 | 0.3333 | 0.2603 | 0.4869 | 0.5641 | 0.7192 | 0.4576 | 0.6477 |
| 0.7504 | 51.0 | 6375 | 1.0346 | 0.3685 | 0.7171 | 0.3413 | 0.0905 | 0.2821 | 0.4316 | 0.2249 | 0.521 | 0.5556 | 0.1386 | 0.4632 | 0.6369 | 0.4318 | 0.5124 | 0.1205 | 0.3583 | 0.2767 | 0.5361 | 0.5592 | 0.7234 | 0.4542 | 0.6477 |
| 0.7429 | 52.0 | 6500 | 1.0513 | 0.3646 | 0.6926 | 0.3456 | 0.0475 | 0.2755 | 0.4719 | 0.2277 | 0.518 | 0.5514 | 0.0807 | 0.4627 | 0.6297 | 0.4381 | 0.5237 | 0.1272 | 0.3875 | 0.2817 | 0.5148 | 0.5639 | 0.7271 | 0.4123 | 0.6039 |
| 0.7353 | 53.0 | 6625 | 1.0335 | 0.3694 | 0.687 | 0.3477 | 0.0545 | 0.2744 | 0.4644 | 0.2298 | 0.5102 | 0.543 | 0.0912 | 0.4469 | 0.6114 | 0.4364 | 0.5232 | 0.1481 | 0.4 | 0.2684 | 0.4557 | 0.572 | 0.7407 | 0.4221 | 0.5953 |
| 0.7437 | 54.0 | 6750 | 1.0574 | 0.3717 | 0.7126 | 0.3367 | 0.0362 | 0.2924 | 0.4434 | 0.2248 | 0.5097 | 0.5369 | 0.0842 | 0.438 | 0.6111 | 0.4318 | 0.5201 | 0.1387 | 0.3375 | 0.2964 | 0.4918 | 0.5696 | 0.7243 | 0.4218 | 0.6109 |
| 0.7356 | 55.0 | 6875 | 1.0435 | 0.3815 | 0.7309 | 0.3448 | 0.0371 | 0.3081 | 0.4492 | 0.22 | 0.5156 | 0.5521 | 0.093 | 0.4667 | 0.6244 | 0.4181 | 0.5046 | 0.1659 | 0.3792 | 0.33 | 0.5311 | 0.5719 | 0.7383 | 0.4218 | 0.607 |
| 0.7278 | 56.0 | 7000 | 1.0575 | 0.3789 | 0.7154 | 0.365 | 0.0471 | 0.3017 | 0.456 | 0.223 | 0.5054 | 0.5351 | 0.0684 | 0.4455 | 0.6165 | 0.4294 | 0.517 | 0.1677 | 0.3208 | 0.2983 | 0.5148 | 0.5725 | 0.7215 | 0.4264 | 0.6016 |
| 0.7322 | 57.0 | 7125 | 1.0405 | 0.3746 | 0.7104 | 0.3383 | 0.0543 | 0.2889 | 0.4816 | 0.2296 | 0.5216 | 0.5524 | 0.1088 | 0.4479 | 0.6339 | 0.4292 | 0.5206 | 0.15 | 0.4 | 0.2867 | 0.4852 | 0.5619 | 0.7294 | 0.4454 | 0.6266 |
| 0.719 | 58.0 | 7250 | 1.0121 | 0.3835 | 0.7468 | 0.3546 | 0.066 | 0.3042 | 0.4607 | 0.228 | 0.524 | 0.558 | 0.114 | 0.4667 | 0.6315 | 0.451 | 0.5428 | 0.179 | 0.4125 | 0.2806 | 0.4738 | 0.5579 | 0.7243 | 0.4487 | 0.6367 |
| 0.7097 | 59.0 | 7375 | 1.0164 | 0.3814 | 0.7456 | 0.3344 | 0.0614 | 0.3027 | 0.437 | 0.2252 | 0.5141 | 0.5352 | 0.0982 | 0.4579 | 0.5734 | 0.4339 | 0.5253 | 0.163 | 0.3208 | 0.2944 | 0.4934 | 0.5728 | 0.7145 | 0.4429 | 0.6219 |
| 0.6941 | 60.0 | 7500 | 1.0747 | 0.3672 | 0.7035 | 0.3351 | 0.0463 | 0.2865 | 0.4363 | 0.2281 | 0.5008 | 0.5285 | 0.0842 | 0.4362 | 0.6127 | 0.4181 | 0.5072 | 0.1872 | 0.3792 | 0.3047 | 0.5328 | 0.5736 | 0.7327 | 0.3523 | 0.4906 |
| 0.7108 | 61.0 | 7625 | 1.0140 | 0.3956 | 0.7255 | 0.3997 | 0.0649 | 0.3137 | 0.4592 | 0.2351 | 0.5327 | 0.5548 | 0.164 | 0.4674 | 0.6131 | 0.4544 | 0.5412 | 0.1958 | 0.375 | 0.3081 | 0.5033 | 0.5788 | 0.7318 | 0.4408 | 0.6227 |
| 0.6952 | 62.0 | 7750 | 1.0354 | 0.3877 | 0.7308 | 0.3723 | 0.055 | 0.3067 | 0.441 | 0.2349 | 0.5143 | 0.5376 | 0.1 | 0.4521 | 0.5973 | 0.4315 | 0.5191 | 0.1995 | 0.3333 | 0.3031 | 0.5066 | 0.5783 | 0.7327 | 0.4262 | 0.5961 |
| 0.6899 | 63.0 | 7875 | 1.0220 | 0.3822 | 0.7322 | 0.3614 | 0.0478 | 0.2985 | 0.4276 | 0.2257 | 0.5098 | 0.5375 | 0.0947 | 0.4565 | 0.5916 | 0.4354 | 0.5258 | 0.18 | 0.3292 | 0.2982 | 0.4984 | 0.564 | 0.7262 | 0.4334 | 0.6078 |
| 0.6958 | 64.0 | 8000 | 0.9985 | 0.3976 | 0.7625 | 0.363 | 0.0559 | 0.3047 | 0.459 | 0.2245 | 0.5216 | 0.5472 | 0.1123 | 0.4562 | 0.6028 | 0.4425 | 0.5366 | 0.2016 | 0.3333 | 0.3182 | 0.5 | 0.568 | 0.7327 | 0.4575 | 0.6336 |
| 0.6946 | 65.0 | 8125 | 1.0314 | 0.3914 | 0.7321 | 0.3656 | 0.0616 | 0.3101 | 0.438 | 0.2253 | 0.5217 | 0.5472 | 0.1 | 0.4643 | 0.6156 | 0.4418 | 0.5325 | 0.1895 | 0.3333 | 0.3056 | 0.5148 | 0.5742 | 0.7327 | 0.4461 | 0.6227 |
| 0.6716 | 66.0 | 8250 | 1.0477 | 0.3792 | 0.7178 | 0.3634 | 0.0537 | 0.2806 | 0.4455 | 0.2317 | 0.5114 | 0.5364 | 0.1035 | 0.4339 | 0.6199 | 0.4299 | 0.5237 | 0.199 | 0.3542 | 0.2903 | 0.5082 | 0.565 | 0.7215 | 0.4119 | 0.5742 |
| 0.6771 | 67.0 | 8375 | 1.0453 | 0.3932 | 0.747 | 0.3852 | 0.0468 | 0.2993 | 0.4701 | 0.2243 | 0.5267 | 0.5499 | 0.0912 | 0.4802 | 0.5973 | 0.4397 | 0.5335 | 0.1758 | 0.375 | 0.3342 | 0.5131 | 0.5649 | 0.7178 | 0.4514 | 0.6102 |
| 0.6752 | 68.0 | 8500 | 1.0427 | 0.3936 | 0.7533 | 0.3712 | 0.0615 | 0.2892 | 0.4722 | 0.2287 | 0.5139 | 0.537 | 0.0851 | 0.4403 | 0.6085 | 0.4357 | 0.5211 | 0.184 | 0.3125 | 0.3235 | 0.518 | 0.5744 | 0.7308 | 0.4503 | 0.6023 |
| 0.6732 | 69.0 | 8625 | 1.0298 | 0.3996 | 0.7544 | 0.3858 | 0.0739 | 0.3003 | 0.4836 | 0.2361 | 0.5265 | 0.5549 | 0.1614 | 0.4536 | 0.6302 | 0.4538 | 0.5423 | 0.2011 | 0.3958 | 0.3333 | 0.5082 | 0.5811 | 0.7374 | 0.4287 | 0.5906 |
| 0.6685 | 70.0 | 8750 | 1.0314 | 0.3921 | 0.749 | 0.358 | 0.0533 | 0.3091 | 0.4485 | 0.2309 | 0.5113 | 0.5384 | 0.1061 | 0.4475 | 0.596 | 0.4487 | 0.5345 | 0.1969 | 0.3417 | 0.3054 | 0.5 | 0.5722 | 0.7136 | 0.4371 | 0.6023 |
| 0.663 | 71.0 | 8875 | 1.0564 | 0.3851 | 0.7407 | 0.3575 | 0.0467 | 0.3091 | 0.4536 | 0.2195 | 0.5054 | 0.5291 | 0.093 | 0.4607 | 0.5722 | 0.4294 | 0.517 | 0.181 | 0.3042 | 0.3183 | 0.5197 | 0.5651 | 0.7033 | 0.4317 | 0.6016 |
| 0.6497 | 72.0 | 9000 | 1.0388 | 0.3996 | 0.7587 | 0.365 | 0.0601 | 0.3128 | 0.4669 | 0.2296 | 0.5162 | 0.5447 | 0.1018 | 0.459 | 0.6203 | 0.4496 | 0.5304 | 0.2049 | 0.3625 | 0.3233 | 0.4885 | 0.5801 | 0.728 | 0.4402 | 0.6141 |
| 0.6479 | 73.0 | 9125 | 1.0326 | 0.3948 | 0.7596 | 0.3619 | 0.0539 | 0.3109 | 0.4588 | 0.2306 | 0.5127 | 0.5396 | 0.093 | 0.4613 | 0.5903 | 0.4449 | 0.5294 | 0.1929 | 0.3333 | 0.3218 | 0.4984 | 0.5808 | 0.7355 | 0.4337 | 0.6016 |
| 0.6681 | 74.0 | 9250 | 1.0166 | 0.3931 | 0.747 | 0.3762 | 0.0528 | 0.3058 | 0.4622 | 0.2261 | 0.5163 | 0.5376 | 0.107 | 0.4503 | 0.5846 | 0.4533 | 0.5412 | 0.1658 | 0.3292 | 0.342 | 0.4934 | 0.5629 | 0.7271 | 0.4417 | 0.5969 |
| 0.6632 | 75.0 | 9375 | 1.0265 | 0.3993 | 0.7544 | 0.3837 | 0.0528 | 0.3158 | 0.46 | 0.2328 | 0.5144 | 0.5432 | 0.107 | 0.4664 | 0.6026 | 0.4507 | 0.5443 | 0.2036 | 0.3125 | 0.3309 | 0.5 | 0.5722 | 0.7341 | 0.4391 | 0.625 |
| 0.6359 | 76.0 | 9500 | 1.0260 | 0.3937 | 0.7561 | 0.3659 | 0.0653 | 0.3062 | 0.4582 | 0.2289 | 0.5119 | 0.5446 | 0.1228 | 0.466 | 0.6294 | 0.4545 | 0.5454 | 0.1809 | 0.325 | 0.3197 | 0.5016 | 0.5885 | 0.7439 | 0.4248 | 0.607 |
| 0.6419 | 77.0 | 9625 | 1.0309 | 0.3921 | 0.7408 | 0.366 | 0.0555 | 0.2971 | 0.4838 | 0.2322 | 0.512 | 0.5414 | 0.086 | 0.4503 | 0.6169 | 0.4278 | 0.5134 | 0.183 | 0.35 | 0.3302 | 0.5049 | 0.586 | 0.7308 | 0.4337 | 0.6078 |
| 0.6379 | 78.0 | 9750 | 1.0483 | 0.3911 | 0.7289 | 0.3711 | 0.0684 | 0.2959 | 0.4524 | 0.23 | 0.5112 | 0.5358 | 0.1228 | 0.452 | 0.5746 | 0.4508 | 0.5433 | 0.1882 | 0.2958 | 0.308 | 0.4984 | 0.5904 | 0.7393 | 0.4182 | 0.6023 |
| 0.6355 | 79.0 | 9875 | 1.0382 | 0.3883 | 0.7481 | 0.3549 | 0.0627 | 0.2954 | 0.4571 | 0.2302 | 0.5076 | 0.5334 | 0.1018 | 0.4463 | 0.5883 | 0.4503 | 0.5361 | 0.183 | 0.325 | 0.3161 | 0.4902 | 0.5763 | 0.7355 | 0.4157 | 0.5805 |
| 0.6348 | 80.0 | 10000 | 1.0524 | 0.3949 | 0.7432 | 0.383 | 0.0646 | 0.2971 | 0.4503 | 0.2304 | 0.5097 | 0.535 | 0.1263 | 0.4598 | 0.5552 | 0.4613 | 0.5515 | 0.1776 | 0.275 | 0.329 | 0.5098 | 0.5774 | 0.7294 | 0.4293 | 0.6094 |
| 0.6286 | 81.0 | 10125 | 1.0426 | 0.3957 | 0.7445 | 0.3925 | 0.0583 | 0.306 | 0.4901 | 0.2298 | 0.5086 | 0.5349 | 0.1158 | 0.4637 | 0.5952 | 0.454 | 0.5479 | 0.1911 | 0.2958 | 0.3362 | 0.4951 | 0.566 | 0.7262 | 0.4312 | 0.6094 |
| 0.6236 | 82.0 | 10250 | 1.0544 | 0.3878 | 0.7336 | 0.3682 | 0.0487 | 0.296 | 0.4629 | 0.2239 | 0.5005 | 0.527 | 0.1193 | 0.4405 | 0.5747 | 0.4507 | 0.5392 | 0.1724 | 0.2875 | 0.3215 | 0.4852 | 0.5682 | 0.7215 | 0.426 | 0.6016 |
| 0.63 | 83.0 | 10375 | 1.0655 | 0.3886 | 0.7454 | 0.3761 | 0.065 | 0.2948 | 0.4519 | 0.2205 | 0.5194 | 0.5421 | 0.1544 | 0.4551 | 0.606 | 0.4515 | 0.5381 | 0.1845 | 0.3333 | 0.3119 | 0.4918 | 0.5753 | 0.7308 | 0.4199 | 0.6164 |
| 0.6245 | 84.0 | 10500 | 1.0492 | 0.3898 | 0.7552 | 0.3627 | 0.0612 | 0.2927 | 0.4624 | 0.2323 | 0.5138 | 0.5363 | 0.1211 | 0.445 | 0.5873 | 0.4403 | 0.5247 | 0.2005 | 0.3417 | 0.3085 | 0.4902 | 0.5759 | 0.729 | 0.4237 | 0.5961 |
| 0.6174 | 85.0 | 10625 | 1.0339 | 0.4002 | 0.7577 | 0.3794 | 0.0641 | 0.3085 | 0.4772 | 0.2314 | 0.5197 | 0.5449 | 0.1088 | 0.4639 | 0.6087 | 0.4426 | 0.5376 | 0.2042 | 0.3458 | 0.33 | 0.5082 | 0.5884 | 0.7266 | 0.4356 | 0.6062 |
| 0.6133 | 86.0 | 10750 | 1.0456 | 0.3959 | 0.7531 | 0.3756 | 0.0544 | 0.3039 | 0.4799 | 0.2319 | 0.515 | 0.5365 | 0.1088 | 0.461 | 0.5995 | 0.4534 | 0.5423 | 0.18 | 0.2958 | 0.3258 | 0.4967 | 0.5835 | 0.7299 | 0.4369 | 0.618 |
| 0.6081 | 87.0 | 10875 | 1.0713 | 0.3883 | 0.7387 | 0.3777 | 0.0603 | 0.3018 | 0.4519 | 0.2255 | 0.4967 | 0.523 | 0.1123 | 0.4519 | 0.5789 | 0.4519 | 0.5371 | 0.1789 | 0.2708 | 0.3117 | 0.4836 | 0.578 | 0.7224 | 0.421 | 0.6008 |
| 0.6096 | 88.0 | 11000 | 1.0603 | 0.3939 | 0.7597 | 0.3706 | 0.0631 | 0.2977 | 0.4767 | 0.2241 | 0.5097 | 0.5317 | 0.1088 | 0.4551 | 0.5866 | 0.4463 | 0.5361 | 0.1858 | 0.2792 | 0.3182 | 0.5049 | 0.5782 | 0.7257 | 0.4412 | 0.6125 |
| 0.6164 | 89.0 | 11125 | 1.0610 | 0.3948 | 0.7531 | 0.3699 | 0.0534 | 0.305 | 0.4605 | 0.227 | 0.5168 | 0.5353 | 0.1088 | 0.4595 | 0.5858 | 0.4488 | 0.5351 | 0.1898 | 0.2958 | 0.3237 | 0.5131 | 0.5813 | 0.7299 | 0.4305 | 0.6023 |
| 0.6034 | 90.0 | 11250 | 1.0559 | 0.3984 | 0.775 | 0.3731 | 0.0629 | 0.3104 | 0.4689 | 0.2256 | 0.5148 | 0.5355 | 0.1035 | 0.4579 | 0.593 | 0.4423 | 0.5314 | 0.2074 | 0.3 | 0.3173 | 0.5049 | 0.5825 | 0.7262 | 0.4426 | 0.6148 |
| 0.602 | 91.0 | 11375 | 1.0424 | 0.3992 | 0.757 | 0.3948 | 0.0629 | 0.3061 | 0.4826 | 0.2291 | 0.5162 | 0.5392 | 0.114 | 0.4584 | 0.6199 | 0.4506 | 0.5366 | 0.2115 | 0.3208 | 0.3256 | 0.5 | 0.5893 | 0.7369 | 0.4191 | 0.6016 |
| 0.6038 | 92.0 | 11500 | 1.0444 | 0.396 | 0.767 | 0.3642 | 0.0553 | 0.3041 | 0.4848 | 0.2288 | 0.5147 | 0.5396 | 0.093 | 0.4538 | 0.6288 | 0.439 | 0.5263 | 0.1974 | 0.3375 | 0.316 | 0.4934 | 0.5878 | 0.7308 | 0.4398 | 0.6102 |
| 0.5982 | 93.0 | 11625 | 1.0463 | 0.3973 | 0.7604 | 0.3895 | 0.0561 | 0.3099 | 0.4892 | 0.2252 | 0.5157 | 0.5451 | 0.1035 | 0.4678 | 0.6353 | 0.4483 | 0.534 | 0.1939 | 0.3375 | 0.3251 | 0.5115 | 0.5873 | 0.7308 | 0.4321 | 0.6117 |
| 0.5879 | 94.0 | 11750 | 1.0578 | 0.393 | 0.7637 | 0.373 | 0.0607 | 0.3019 | 0.4779 | 0.2259 | 0.5173 | 0.5394 | 0.1158 | 0.4641 | 0.6119 | 0.4539 | 0.5443 | 0.1773 | 0.3208 | 0.312 | 0.4902 | 0.5835 | 0.7299 | 0.438 | 0.6117 |
| 0.6044 | 95.0 | 11875 | 1.0631 | 0.3917 | 0.7619 | 0.3591 | 0.0591 | 0.3023 | 0.477 | 0.222 | 0.51 | 0.5345 | 0.1035 | 0.4526 | 0.6163 | 0.454 | 0.5392 | 0.178 | 0.3167 | 0.3152 | 0.4951 | 0.5826 | 0.7285 | 0.4286 | 0.593 |
| 0.5918 | 96.0 | 12000 | 1.0576 | 0.3961 | 0.7651 | 0.3802 | 0.0559 | 0.3026 | 0.4708 | 0.2261 | 0.514 | 0.538 | 0.1035 | 0.4589 | 0.5961 | 0.4513 | 0.5376 | 0.1855 | 0.3042 | 0.3217 | 0.5016 | 0.5842 | 0.7308 | 0.4377 | 0.6156 |
| 0.5973 | 97.0 | 12125 | 1.0587 | 0.3938 | 0.758 | 0.3776 | 0.0582 | 0.2962 | 0.4658 | 0.2226 | 0.5132 | 0.535 | 0.107 | 0.4528 | 0.5931 | 0.4496 | 0.5361 | 0.1832 | 0.3083 | 0.3225 | 0.5 | 0.5842 | 0.7313 | 0.4293 | 0.5992 |
| 0.5919 | 98.0 | 12250 | 1.0515 | 0.3936 | 0.7612 | 0.3704 | 0.062 | 0.3038 | 0.4771 | 0.2188 | 0.5096 | 0.54 | 0.1123 | 0.4635 | 0.6172 | 0.4557 | 0.5418 | 0.1783 | 0.3292 | 0.3147 | 0.4885 | 0.584 | 0.728 | 0.4353 | 0.6125 |
| 0.5931 | 99.0 | 12375 | 1.0502 | 0.3947 | 0.7609 | 0.3773 | 0.0599 | 0.3094 | 0.4612 | 0.2229 | 0.5116 | 0.5366 | 0.1123 | 0.4615 | 0.5916 | 0.4537 | 0.5407 | 0.1847 | 0.3125 | 0.3124 | 0.4984 | 0.5849 | 0.7313 | 0.4378 | 0.6 |
| 0.5924 | 100.0 | 12500 | 1.0499 | 0.3948 | 0.7609 | 0.3767 | 0.0619 | 0.3097 | 0.4634 | 0.2239 | 0.5134 | 0.5368 | 0.1158 | 0.4656 | 0.5905 | 0.4535 | 0.5418 | 0.1846 | 0.3125 | 0.3122 | 0.4984 | 0.5839 | 0.7285 | 0.4398 | 0.6031 |
### Framework versions
- Transformers 4.45.0.dev0
- Pytorch 2.4.0+cu124
- Datasets 2.21.0
- Tokenizers 0.19.1
|