--- license: other base_model: nvidia/mit-b2 tags: - vision - image-segmentation - generated_from_trainer metrics: - recall model-index: - name: segformer-b2-finetuned-segments-greenhousev7-oct-18 results: [] --- # segformer-b2-finetuned-segments-greenhousev7-oct-18 This model is a fine-tuned version of [nvidia/mit-b2](https://huggingface.co/nvidia/mit-b2) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 0.1841 - Mean Iou: 0.5314 - Mean Accuracy: 0.7218 - Overall Accuracy: 0.9593 - F1 Score: 0.9573 - Recall: 0.9593 - Accuracy Unlabeled: nan - Accuracy Object: 0.7654 - Accuracy Road: nan - Accuracy Plant: 0.9576 - Accuracy Iron: 0.7387 - Accuracy Wood: 0.2407 - Accuracy Wall: 0.9835 - Accuracy Raw Road: 0.9917 - Accuracy Bottom Wall: 0.6095 - Accuracy Roof: 0.7820 - Accuracy Grass: 0.0621 - Accuracy Mulch: 0.9230 - Accuracy Person: nan - Accuracy Tomato: 0.8854 - Iou Unlabeled: 0.0 - Iou Object: 0.4810 - Iou Road: nan - Iou Plant: 0.8973 - Iou Iron: 0.6272 - Iou Wood: 0.2386 - Iou Wall: 0.8552 - Iou Raw Road: 0.9824 - Iou Bottom Wall: 0.5743 - Iou Roof: 0.6470 - Iou Grass: 0.0603 - Iou Mulch: 0.8715 - Iou Person: 0.0 - Iou Tomato: 0.6733 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 6e-05 - train_batch_size: 2 - eval_batch_size: 2 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 15 ### Training results | Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | F1 Score | Recall | Accuracy Unlabeled | Accuracy Object | Accuracy Road | Accuracy Plant | Accuracy Iron | Accuracy Wood | Accuracy Wall | Accuracy Raw Road | Accuracy Bottom Wall | Accuracy Roof | Accuracy Grass | Accuracy Mulch | Accuracy Person | Accuracy Tomato | Iou Unlabeled | Iou Object | Iou Road | Iou Plant | Iou Iron | Iou Wood | Iou Wall | Iou Raw Road | Iou Bottom Wall | Iou Roof | Iou Grass | Iou Mulch | Iou Person | Iou Tomato | |:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:--------:|:------:|:------------------:|:---------------:|:-------------:|:--------------:|:-------------:|:-------------:|:-------------:|:-----------------:|:--------------------:|:-------------:|:--------------:|:--------------:|:---------------:|:---------------:|:-------------:|:----------:|:--------:|:---------:|:--------:|:--------:|:--------:|:------------:|:---------------:|:--------:|:---------:|:---------:|:----------:|:----------:| | 0.475 | 0.14 | 20 | 0.8886 | 0.2166 | 0.3017 | 0.8734 | 0.8714 | 0.8734 | nan | 0.0 | nan | 0.9421 | 0.0 | 0.0 | 0.5209 | 0.9352 | 0.0586 | 0.0 | 0.0 | 0.8620 | nan | 0.0 | 0.0 | 0.0 | nan | 0.7847 | 0.0 | 0.0 | 0.4664 | 0.9106 | 0.0577 | 0.0 | 0.0 | 0.5969 | 0.0 | 0.0 | | 0.9457 | 0.29 | 40 | 0.3560 | 0.3104 | 0.3503 | 0.9259 | 0.9238 | 0.9259 | nan | 0.0 | nan | 0.9424 | 0.0001 | 0.0 | 0.9365 | 0.9859 | 0.0258 | 0.0693 | 0.0 | 0.8930 | nan | 0.0 | nan | 0.0 | nan | 0.8607 | 0.0001 | 0.0 | 0.7177 | 0.9529 | 0.0253 | 0.0689 | 0.0 | 0.7892 | nan | 0.0 | | 0.1979 | 0.43 | 60 | 0.2641 | 0.3867 | 0.4319 | 0.9358 | 0.9337 | 0.9358 | nan | 0.0 | nan | 0.9564 | 0.0941 | 0.0 | 0.9046 | 0.9897 | 0.4045 | 0.5197 | 0.0 | 0.8823 | nan | 0.0 | nan | 0.0 | nan | 0.8706 | 0.0931 | 0.0 | 0.7503 | 0.9668 | 0.3079 | 0.4590 | 0.0 | 0.8064 | nan | 0.0 | | 0.1755 | 0.57 | 80 | 0.2558 | 0.3591 | 0.3998 | 0.9404 | 0.9383 | 0.9404 | nan | 0.0 | nan | 0.9719 | 0.1265 | 0.0 | 0.9660 | 0.9878 | 0.4353 | 0.0389 | 0.0 | 0.8712 | nan | 0.0 | nan | 0.0 | nan | 0.8718 | 0.1221 | 0.0 | 0.7682 | 0.9742 | 0.3571 | 0.0389 | 0.0 | 0.8182 | nan | 0.0 | | 0.1247 | 0.71 | 100 | 0.2280 | 0.4159 | 0.4729 | 0.9397 | 0.9376 | 0.9397 | nan | 0.0 | nan | 0.9661 | 0.3451 | 0.0 | 0.8020 | 0.9906 | 0.7143 | 0.5085 | 0.0 | 0.8750 | nan | 0.0 | nan | 0.0 | nan | 0.8781 | 0.3091 | 0.0 | 0.7157 | 0.9735 | 0.4129 | 0.4581 | 0.0 | 0.8273 | nan | 0.0 | | 0.316 | 0.86 | 120 | 0.2227 | 0.4312 | 0.4811 | 0.9432 | 0.9411 | 0.9432 | nan | 0.0 | nan | 0.9353 | 0.3324 | 0.0 | 0.9422 | 0.9869 | 0.5293 | 0.6251 | 0.0 | 0.9404 | nan | 0.0 | nan | 0.0 | nan | 0.8735 | 0.3008 | 0.0 | 0.7993 | 0.9743 | 0.4533 | 0.5267 | 0.0 | 0.8149 | nan | 0.0 | | 3.5058 | 1.0 | 140 | 0.2212 | 0.3700 | 0.4627 | 0.9385 | 0.9364 | 0.9385 | nan | 0.0 | nan | 0.9239 | 0.5116 | 0.0 | 0.8047 | 0.9850 | 0.7050 | 0.2073 | 0.0 | 0.9520 | nan | 0.0 | 0.0 | 0.0 | nan | 0.8699 | 0.4246 | 0.0 | 0.7174 | 0.9751 | 0.4406 | 0.2017 | 0.0 | 0.8107 | nan | 0.0 | | 0.1132 | 1.14 | 160 | 0.2134 | 0.3906 | 0.4898 | 0.9392 | 0.9371 | 0.9392 | nan | 0.0 | nan | 0.9799 | 0.5195 | 0.0 | 0.7225 | 0.9891 | 0.7533 | 0.5434 | 0.0 | 0.8684 | nan | 0.0117 | 0.0 | 0.0 | nan | 0.8715 | 0.4228 | 0.0 | 0.6721 | 0.9773 | 0.4292 | 0.4761 | 0.0 | 0.8260 | nan | 0.0117 | | 0.1254 | 1.29 | 180 | 0.1923 | 0.4005 | 0.4893 | 0.9476 | 0.9455 | 0.9476 | nan | 0.0 | nan | 0.9562 | 0.6417 | 0.0 | 0.8687 | 0.9924 | 0.7268 | 0.2351 | 0.0 | 0.8999 | nan | 0.0610 | 0.0 | 0.0 | nan | 0.8853 | 0.5208 | 0.0 | 0.7818 | 0.9749 | 0.5139 | 0.2277 | 0.0 | 0.8402 | nan | 0.0609 | | 0.1064 | 1.43 | 200 | 0.1909 | 0.4303 | 0.5472 | 0.9485 | 0.9464 | 0.9485 | nan | 0.0 | nan | 0.9562 | 0.4434 | 0.0 | 0.9202 | 0.9904 | 0.5945 | 0.9125 | 0.0 | 0.9175 | nan | 0.2847 | 0.0 | 0.0 | nan | 0.8868 | 0.3847 | 0.0 | 0.7809 | 0.9782 | 0.4704 | 0.5405 | 0.0 | 0.8444 | nan | 0.2772 | | 0.3279 | 1.57 | 220 | 0.1949 | 0.4762 | 0.6041 | 0.9498 | 0.9477 | 0.9498 | nan | 0.0032 | nan | 0.9779 | 0.7402 | 0.0 | 0.9345 | 0.9889 | 0.5763 | 0.8441 | 0.0 | 0.8702 | nan | 0.7098 | 0.0 | 0.0032 | nan | 0.8813 | 0.5074 | 0.0 | 0.8253 | 0.9788 | 0.5196 | 0.5616 | 0.0 | 0.8271 | nan | 0.6098 | | 0.2236 | 1.71 | 240 | 0.1806 | 0.5105 | 0.5944 | 0.9493 | 0.9472 | 0.9493 | nan | 0.0004 | nan | 0.9558 | 0.5152 | 0.0 | 0.8326 | 0.9910 | 0.7987 | 0.7282 | 0.0 | 0.9144 | nan | 0.8020 | nan | 0.0004 | nan | 0.8924 | 0.4329 | 0.0 | 0.7704 | 0.9782 | 0.5054 | 0.5508 | 0.0 | 0.8473 | nan | 0.6375 | | 0.1532 | 1.86 | 260 | 0.1979 | 0.4322 | 0.6023 | 0.9476 | 0.9455 | 0.9476 | nan | 0.0116 | nan | 0.9291 | 0.5118 | 0.0 | 0.9217 | 0.9894 | 0.5798 | 0.9418 | 0.0 | 0.9484 | nan | 0.7916 | 0.0 | 0.0116 | nan | 0.8827 | 0.4377 | 0.0 | 0.7888 | 0.9789 | 0.5087 | 0.1096 | 0.0 | 0.8335 | nan | 0.6345 | | 0.1206 | 2.0 | 280 | 0.1930 | 0.4854 | 0.5859 | 0.9527 | 0.9506 | 0.9527 | nan | 0.1672 | nan | 0.9723 | 0.5995 | 0.0 | 0.9599 | 0.9900 | 0.5862 | 0.6101 | 0.0 | 0.8928 | nan | 0.6668 | 0.0 | 0.1662 | nan | 0.8885 | 0.5009 | 0.0 | 0.8244 | 0.9794 | 0.5073 | 0.5346 | 0.0 | 0.8498 | nan | 0.5738 | | 0.1327 | 2.14 | 300 | 0.2078 | 0.5081 | 0.6851 | 0.9529 | 0.9508 | 0.9529 | nan | 0.6150 | nan | 0.9682 | 0.6568 | 0.0 | 0.9783 | 0.9914 | 0.5713 | 0.9647 | 0.0 | 0.8749 | nan | 0.9154 | 0.0 | 0.4093 | nan | 0.8873 | 0.5393 | 0.0 | 0.8351 | 0.9789 | 0.5273 | 0.4815 | 0.0 | 0.8442 | nan | 0.5945 | | 0.1952 | 2.29 | 320 | 0.1985 | 0.4575 | 0.5808 | 0.9522 | 0.9501 | 0.9522 | nan | 0.5917 | nan | 0.9630 | 0.4411 | 0.0 | 0.9714 | 0.9912 | 0.6056 | 0.0 | 0.0 | 0.8923 | nan | 0.9322 | 0.0 | 0.4676 | nan | 0.8883 | 0.3818 | 0.0 | 0.8247 | 0.9785 | 0.5208 | 0.0 | 0.0 | 0.8521 | nan | 0.5762 | | 0.0827 | 2.43 | 340 | 0.1896 | 0.5238 | 0.6390 | 0.9544 | 0.9523 | 0.9544 | nan | 0.6178 | nan | 0.9565 | 0.6867 | 0.0 | 0.9651 | 0.9890 | 0.5665 | 0.5513 | 0.0 | 0.9237 | nan | 0.7725 | 0.0 | 0.5195 | nan | 0.8915 | 0.5263 | 0.0 | 0.8368 | 0.9781 | 0.5332 | 0.5068 | 0.0 | 0.8552 | nan | 0.6382 | | 0.0867 | 2.57 | 360 | 0.2075 | 0.4959 | 0.6084 | 0.9540 | 0.9519 | 0.9540 | nan | 0.7118 | nan | 0.9593 | 0.5755 | 0.0 | 0.9876 | 0.9877 | 0.5359 | 0.6559 | 0.0 | 0.9294 | nan | 0.3497 | 0.0 | 0.5078 | nan | 0.8899 | 0.4787 | 0.0 | 0.8304 | 0.9798 | 0.5084 | 0.5592 | 0.0 | 0.8595 | nan | 0.3374 | | 0.1218 | 2.71 | 380 | 0.1914 | 0.4755 | 0.6710 | 0.9543 | 0.9522 | 0.9543 | nan | 0.8130 | nan | 0.9677 | 0.6875 | 0.0 | 0.9766 | 0.9900 | 0.5854 | 0.7143 | 0.0 | 0.8904 | nan | 0.7561 | 0.0 | 0.3606 | nan | 0.8900 | 0.5450 | 0.0 | 0.8465 | 0.9804 | 0.5273 | 0.5377 | 0.0 | 0.8528 | 0.0 | 0.6410 | | 0.1099 | 2.86 | 400 | 0.1739 | 0.4733 | 0.6947 | 0.9546 | 0.9525 | 0.9546 | nan | 0.8077 | nan | 0.9444 | 0.6638 | 0.0 | 0.9604 | 0.9905 | 0.6154 | 0.9198 | 0.0 | 0.9320 | nan | 0.8073 | 0.0 | 0.3583 | nan | 0.8892 | 0.5367 | 0.0 | 0.8454 | 0.9802 | 0.5502 | 0.4749 | 0.0 | 0.8589 | 0.0 | 0.6594 | | 0.1922 | 3.0 | 420 | 0.1904 | 0.4837 | 0.6783 | 0.9554 | 0.9533 | 0.9554 | nan | 0.7767 | nan | 0.9596 | 0.5982 | 0.0 | 0.9842 | 0.9901 | 0.5913 | 0.8147 | 0.0 | 0.9115 | nan | 0.8354 | 0.0 | 0.4004 | nan | 0.8927 | 0.5073 | 0.0 | 0.8433 | 0.9802 | 0.5487 | 0.5935 | 0.0 | 0.8588 | 0.0 | 0.6637 | | 0.0941 | 3.14 | 440 | 0.1820 | 0.4758 | 0.6974 | 0.9542 | 0.9521 | 0.9542 | nan | 0.7557 | nan | 0.9322 | 0.6624 | 0.0 | 0.9709 | 0.9913 | 0.6045 | 0.9613 | 0.0 | 0.9429 | nan | 0.8498 | 0.0 | 0.4154 | nan | 0.8851 | 0.5460 | 0.0 | 0.8462 | 0.9797 | 0.5555 | 0.4396 | 0.0 | 0.8551 | 0.0 | 0.6631 | | 0.0983 | 3.29 | 460 | 0.1907 | 0.4810 | 0.6923 | 0.9536 | 0.9515 | 0.9536 | nan | 0.7156 | nan | 0.9263 | 0.6772 | 0.0 | 0.9721 | 0.9923 | 0.5996 | 0.9495 | 0.0 | 0.9453 | nan | 0.8379 | 0.0 | 0.4286 | nan | 0.8822 | 0.5540 | 0.0 | 0.8471 | 0.9785 | 0.5604 | 0.4903 | 0.0 | 0.8528 | 0.0 | 0.6585 | | 0.0589 | 3.43 | 480 | 0.1832 | 0.4927 | 0.6872 | 0.9560 | 0.9540 | 0.9560 | nan | 0.7509 | nan | 0.9640 | 0.7787 | 0.0 | 0.9683 | 0.9909 | 0.5709 | 0.7922 | 0.0 | 0.9051 | nan | 0.8386 | 0.0 | 0.4347 | nan | 0.8930 | 0.5749 | 0.0 | 0.8475 | 0.9799 | 0.5378 | 0.6150 | 0.0 | 0.8625 | 0.0 | 0.6602 | | 0.0964 | 3.57 | 500 | 0.1713 | 0.4748 | 0.6507 | 0.9558 | 0.9539 | 0.9558 | nan | 0.7073 | nan | 0.9572 | 0.7304 | 0.0 | 0.9712 | 0.9915 | 0.6100 | 0.4556 | 0.0 | 0.9104 | nan | 0.8238 | 0.0 | 0.3591 | nan | 0.8934 | 0.5850 | 0.0 | 0.8478 | 0.9794 | 0.5529 | 0.4341 | 0.0 | 0.8636 | 0.0 | 0.6570 | | 0.0604 | 3.71 | 520 | 0.1790 | 0.5221 | 0.6642 | 0.9559 | 0.9539 | 0.9559 | nan | 0.6887 | nan | 0.9492 | 0.6794 | 0.0 | 0.9849 | 0.9903 | 0.5868 | 0.6243 | 0.0 | 0.9293 | nan | 0.8731 | 0.0 | 0.3787 | nan | 0.8923 | 0.5744 | 0.0 | 0.8516 | 0.9789 | 0.5619 | 0.5545 | 0.0 | 0.8634 | nan | 0.6095 | | 0.091 | 3.86 | 540 | 0.1887 | 0.4969 | 0.6433 | 0.9546 | 0.9525 | 0.9546 | nan | 0.6514 | nan | 0.9553 | 0.6431 | 0.0 | 0.9621 | 0.9891 | 0.6353 | 0.4031 | 0.0 | 0.9180 | nan | 0.9186 | 0.0 | 0.3946 | nan | 0.8887 | 0.5341 | 0.0 | 0.8399 | 0.9803 | 0.5420 | 0.3886 | 0.0 | 0.8644 | nan | 0.5307 | | 0.0795 | 4.0 | 560 | 0.1960 | 0.5306 | 0.6780 | 0.9559 | 0.9538 | 0.9559 | nan | 0.7581 | nan | 0.9581 | 0.6978 | 0.0 | 0.9821 | 0.9913 | 0.5824 | 0.7028 | 0.0 | 0.9097 | nan | 0.8760 | 0.0 | 0.4304 | nan | 0.8898 | 0.5677 | 0.0 | 0.8496 | 0.9806 | 0.5443 | 0.5932 | 0.0 | 0.8621 | nan | 0.6490 | | 1.2009 | 4.14 | 580 | 0.1781 | 0.4985 | 0.7064 | 0.9563 | 0.9542 | 0.9563 | nan | 0.7099 | nan | 0.9630 | 0.8161 | 0.0 | 0.9627 | 0.9904 | 0.6064 | 0.8922 | 0.0 | 0.9048 | nan | 0.9245 | 0.0 | 0.4839 | nan | 0.8923 | 0.6171 | 0.0 | 0.8448 | 0.9810 | 0.5458 | 0.6238 | 0.0 | 0.8614 | 0.0 | 0.6309 | | 0.049 | 4.29 | 600 | 0.1779 | 0.4986 | 0.7036 | 0.9556 | 0.9534 | 0.9556 | nan | 0.7855 | nan | 0.9386 | 0.7962 | 0.0 | 0.9692 | 0.9893 | 0.6214 | 0.8813 | 0.0004 | 0.9426 | nan | 0.8153 | 0.0 | 0.4824 | nan | 0.8878 | 0.6085 | 0.0 | 0.8499 | 0.9802 | 0.5528 | 0.5875 | 0.0004 | 0.8604 | 0.0 | 0.6723 | | 0.0661 | 4.43 | 620 | 0.1874 | 0.4917 | 0.6885 | 0.9564 | 0.9543 | 0.9564 | nan | 0.7829 | nan | 0.9513 | 0.6299 | 0.0 | 0.9862 | 0.9892 | 0.5996 | 0.9116 | 0.0003 | 0.9336 | nan | 0.7886 | 0.0 | 0.4658 | nan | 0.8936 | 0.5266 | 0.0 | 0.8358 | 0.9811 | 0.5565 | 0.6014 | 0.0003 | 0.8658 | 0.0 | 0.6649 | | 0.1259 | 4.57 | 640 | 0.1725 | 0.4843 | 0.6953 | 0.9556 | 0.9535 | 0.9556 | nan | 0.7834 | nan | 0.9484 | 0.5612 | 0.0811 | 0.9748 | 0.9907 | 0.6112 | 0.9559 | 0.0002 | 0.9320 | nan | 0.8095 | 0.0 | 0.4431 | nan | 0.8918 | 0.5018 | 0.0811 | 0.8413 | 0.9791 | 0.5582 | 0.4742 | 0.0002 | 0.8652 | 0.0 | 0.6596 | | 0.101 | 4.71 | 660 | 0.1851 | 0.5289 | 0.6826 | 0.9568 | 0.9547 | 0.9568 | nan | 0.9097 | nan | 0.9603 | 0.7000 | 0.0215 | 0.9842 | 0.9920 | 0.5871 | 0.5960 | 0.0 | 0.9063 | nan | 0.8516 | 0.0 | 0.4309 | nan | 0.8950 | 0.5846 | 0.0215 | 0.8513 | 0.9798 | 0.5622 | 0.5316 | 0.0 | 0.8646 | nan | 0.6253 | | 0.0806 | 4.86 | 680 | 0.1952 | 0.4873 | 0.6794 | 0.9569 | 0.9548 | 0.9569 | nan | 0.7609 | nan | 0.9559 | 0.7098 | 0.0047 | 0.9814 | 0.9883 | 0.6040 | 0.6374 | 0.0 | 0.9291 | nan | 0.9015 | 0.0 | 0.4580 | nan | 0.8935 | 0.5796 | 0.0047 | 0.8522 | 0.9808 | 0.5536 | 0.5630 | 0.0 | 0.8684 | 0.0 | 0.5813 | | 0.0689 | 5.0 | 700 | 0.1934 | 0.4882 | 0.6885 | 0.9564 | 0.9542 | 0.9564 | nan | 0.7503 | nan | 0.9536 | 0.7353 | 0.0015 | 0.9713 | 0.9894 | 0.5981 | 0.7526 | 0.0000 | 0.9278 | nan | 0.8936 | 0.0 | 0.4339 | nan | 0.8932 | 0.5673 | 0.0015 | 0.8492 | 0.9804 | 0.5525 | 0.6185 | 0.0000 | 0.8667 | 0.0 | 0.5839 | | 0.2621 | 5.14 | 720 | 0.1921 | 0.4880 | 0.7045 | 0.9549 | 0.9529 | 0.9549 | nan | 0.8517 | nan | 0.9415 | 0.6411 | 0.0009 | 0.9794 | 0.9900 | 0.6149 | 0.9225 | 0.0001 | 0.9334 | nan | 0.8735 | 0.0 | 0.3993 | nan | 0.8902 | 0.5361 | 0.0009 | 0.8460 | 0.9795 | 0.5413 | 0.6305 | 0.0001 | 0.8633 | 0.0 | 0.6571 | | 0.0771 | 5.29 | 740 | 0.2048 | 0.4762 | 0.7096 | 0.9551 | 0.9531 | 0.9551 | nan | 0.8850 | nan | 0.9553 | 0.6894 | 0.0005 | 0.9791 | 0.9921 | 0.5684 | 0.9453 | 0.0 | 0.9054 | nan | 0.8854 | 0.0 | 0.3503 | nan | 0.8927 | 0.5552 | 0.0005 | 0.8436 | 0.9797 | 0.5400 | 0.5534 | 0.0 | 0.8625 | 0.0 | 0.6122 | | 0.0927 | 5.43 | 760 | 0.1964 | 0.4842 | 0.6984 | 0.9558 | 0.9539 | 0.9558 | nan | 0.8641 | nan | 0.9515 | 0.6566 | 0.0 | 0.9722 | 0.9906 | 0.6323 | 0.8082 | 0.0 | 0.9196 | nan | 0.8871 | 0.0 | 0.3379 | nan | 0.8926 | 0.5515 | 0.0 | 0.8526 | 0.9810 | 0.5575 | 0.6654 | 0.0 | 0.8658 | 0.0 | 0.5903 | | 0.0874 | 5.57 | 780 | 0.1929 | 0.5327 | 0.6899 | 0.9562 | 0.9542 | 0.9562 | nan | 0.8016 | nan | 0.9549 | 0.6584 | 0.0642 | 0.9791 | 0.9926 | 0.6010 | 0.7623 | 0.0001 | 0.9120 | nan | 0.8626 | 0.0 | 0.3798 | nan | 0.8931 | 0.5569 | 0.0642 | 0.8487 | 0.9804 | 0.5483 | 0.6011 | 0.0001 | 0.8653 | nan | 0.6548 | | 0.1107 | 5.71 | 800 | 0.1989 | 0.5067 | 0.7362 | 0.9563 | 0.9543 | 0.9563 | nan | 0.8191 | nan | 0.9541 | 0.7669 | 0.3163 | 0.9814 | 0.9892 | 0.5746 | 0.8985 | 0.0 | 0.9227 | nan | 0.8758 | 0.0 | 0.3502 | nan | 0.8913 | 0.6085 | 0.3009 | 0.8537 | 0.9813 | 0.5508 | 0.5468 | 0.0 | 0.8640 | 0.0 | 0.6394 | | 0.069 | 5.86 | 820 | 0.1860 | 0.5259 | 0.7126 | 0.9569 | 0.9549 | 0.9569 | nan | 0.7448 | nan | 0.9410 | 0.7272 | 0.3448 | 0.9765 | 0.9911 | 0.5935 | 0.6884 | 0.0029 | 0.9440 | nan | 0.8839 | 0.0 | 0.4783 | nan | 0.8911 | 0.6027 | 0.3342 | 0.8539 | 0.9809 | 0.5592 | 0.5945 | 0.0029 | 0.8627 | 0.0 | 0.6760 | | 0.0889 | 6.0 | 840 | 0.1927 | 0.5557 | 0.6961 | 0.9575 | 0.9554 | 0.9575 | nan | 0.7134 | nan | 0.9659 | 0.6771 | 0.3121 | 0.9861 | 0.9919 | 0.5881 | 0.6678 | 0.0044 | 0.9042 | nan | 0.8460 | 0.0 | 0.5059 | nan | 0.8951 | 0.5845 | 0.3059 | 0.8459 | 0.9807 | 0.5628 | 0.4276 | 0.0043 | 0.8645 | nan | 0.6911 | | 0.0855 | 6.14 | 860 | 0.1944 | 0.5262 | 0.6728 | 0.9550 | 0.9530 | 0.9550 | nan | 0.7040 | nan | 0.9712 | 0.6959 | 0.1082 | 0.9844 | 0.9904 | 0.5940 | 0.5091 | 0.0063 | 0.8815 | nan | 0.9561 | 0.0 | 0.4511 | nan | 0.8888 | 0.5778 | 0.1059 | 0.8471 | 0.9811 | 0.5518 | 0.4769 | 0.0063 | 0.8516 | nan | 0.5765 | | 0.0871 | 6.29 | 880 | 0.1782 | 0.4919 | 0.6982 | 0.9542 | 0.9522 | 0.9542 | nan | 0.7176 | nan | 0.9266 | 0.7054 | 0.0720 | 0.9664 | 0.9917 | 0.6439 | 0.7423 | 0.0106 | 0.9434 | nan | 0.9601 | 0.0 | 0.4957 | nan | 0.8841 | 0.5773 | 0.0605 | 0.8507 | 0.9800 | 0.5512 | 0.5979 | 0.0106 | 0.8582 | 0.0 | 0.5287 | | 0.05 | 6.43 | 900 | 0.1869 | 0.4979 | 0.7097 | 0.9577 | 0.9556 | 0.9577 | nan | 0.7764 | nan | 0.9580 | 0.6921 | 0.0839 | 0.9712 | 0.9904 | 0.6182 | 0.8965 | 0.0060 | 0.9243 | nan | 0.8897 | 0.0 | 0.4832 | nan | 0.8954 | 0.5795 | 0.0754 | 0.8524 | 0.9815 | 0.5570 | 0.4955 | 0.0060 | 0.8687 | 0.0 | 0.6774 | | 0.0673 | 6.57 | 920 | 0.2078 | 0.5546 | 0.7108 | 0.9576 | 0.9556 | 0.9576 | nan | 0.7932 | nan | 0.9681 | 0.7337 | 0.0742 | 0.9846 | 0.9900 | 0.5976 | 0.9106 | 0.0058 | 0.9046 | nan | 0.8564 | 0.0 | 0.4602 | nan | 0.8943 | 0.6050 | 0.0723 | 0.8489 | 0.9820 | 0.5664 | 0.6666 | 0.0057 | 0.8646 | nan | 0.6895 | | 0.0506 | 6.71 | 940 | 0.1878 | 0.5134 | 0.7179 | 0.9577 | 0.9556 | 0.9577 | nan | 0.7828 | nan | 0.9581 | 0.7223 | 0.1221 | 0.9749 | 0.9876 | 0.6224 | 0.9403 | 0.0069 | 0.9325 | nan | 0.8471 | 0.0 | 0.5021 | nan | 0.8946 | 0.6014 | 0.1175 | 0.8525 | 0.9813 | 0.5670 | 0.5957 | 0.0068 | 0.8670 | 0.0 | 0.6879 | | 0.0533 | 6.86 | 960 | 0.1903 | 0.5499 | 0.7203 | 0.9573 | 0.9555 | 0.9573 | nan | 0.8534 | nan | 0.9552 | 0.7882 | 0.0229 | 0.9823 | 0.9916 | 0.5963 | 0.8918 | 0.0147 | 0.9137 | nan | 0.9135 | 0.0 | 0.5133 | nan | 0.8949 | 0.6198 | 0.0228 | 0.8532 | 0.9805 | 0.5537 | 0.6572 | 0.0146 | 0.8676 | nan | 0.6217 | | 0.0684 | 7.0 | 980 | 0.1815 | 0.5110 | 0.7069 | 0.9581 | 0.9561 | 0.9581 | nan | 0.8260 | nan | 0.9462 | 0.7846 | 0.0577 | 0.9844 | 0.9904 | 0.5948 | 0.7778 | 0.0114 | 0.9411 | nan | 0.8615 | 0.0 | 0.4680 | nan | 0.8939 | 0.6317 | 0.0572 | 0.8553 | 0.9819 | 0.5613 | 0.6453 | 0.0114 | 0.8702 | 0.0 | 0.6668 | | 0.0444 | 7.14 | 1000 | 0.1836 | 0.5113 | 0.7053 | 0.9586 | 0.9565 | 0.9586 | nan | 0.7531 | nan | 0.9619 | 0.8198 | 0.0227 | 0.9757 | 0.9903 | 0.5975 | 0.9121 | 0.0087 | 0.9214 | nan | 0.7948 | 0.0 | 0.4720 | nan | 0.8958 | 0.6335 | 0.0227 | 0.8546 | 0.9821 | 0.5608 | 0.6632 | 0.0087 | 0.8710 | 0.0 | 0.6830 | | 0.073 | 7.29 | 1020 | 0.1877 | 0.5078 | 0.6952 | 0.9580 | 0.9560 | 0.9580 | nan | 0.7885 | nan | 0.9519 | 0.7334 | 0.0341 | 0.9869 | 0.9915 | 0.6038 | 0.7566 | 0.0116 | 0.9272 | nan | 0.8612 | 0.0 | 0.4754 | nan | 0.8951 | 0.6045 | 0.0335 | 0.8529 | 0.9815 | 0.5572 | 0.6434 | 0.0116 | 0.8706 | 0.0 | 0.6762 | | 0.079 | 7.43 | 1040 | 0.1818 | 0.4972 | 0.7106 | 0.9572 | 0.9551 | 0.9572 | nan | 0.7972 | nan | 0.9612 | 0.6923 | 0.0727 | 0.9756 | 0.9907 | 0.6204 | 0.8668 | 0.0159 | 0.9108 | nan | 0.9134 | 0.0 | 0.3744 | nan | 0.8946 | 0.5879 | 0.0727 | 0.8552 | 0.9819 | 0.5629 | 0.6122 | 0.0156 | 0.8650 | 0.0 | 0.6415 | | 0.1293 | 7.57 | 1060 | 0.1765 | 0.4972 | 0.7013 | 0.9585 | 0.9564 | 0.9585 | nan | 0.6747 | nan | 0.9600 | 0.7461 | 0.0293 | 0.9711 | 0.9902 | 0.6057 | 0.9498 | 0.0147 | 0.9285 | nan | 0.8445 | 0.0 | 0.5382 | nan | 0.8966 | 0.6104 | 0.0293 | 0.8506 | 0.9818 | 0.5668 | 0.4120 | 0.0146 | 0.8697 | 0.0 | 0.6930 | | 0.0997 | 7.71 | 1080 | 0.1821 | 0.5055 | 0.7214 | 0.9583 | 0.9564 | 0.9583 | nan | 0.7610 | nan | 0.9687 | 0.8081 | 0.0763 | 0.9717 | 0.9888 | 0.5998 | 0.9471 | 0.0201 | 0.9131 | nan | 0.8812 | 0.0 | 0.5417 | nan | 0.8952 | 0.6424 | 0.0763 | 0.8514 | 0.9822 | 0.5721 | 0.4459 | 0.0199 | 0.8678 | 0.0 | 0.6763 | | 0.0642 | 7.86 | 1100 | 0.1776 | 0.5626 | 0.7142 | 0.9587 | 0.9568 | 0.9587 | nan | 0.7905 | nan | 0.9553 | 0.7126 | 0.1255 | 0.9853 | 0.9905 | 0.6010 | 0.8611 | 0.0321 | 0.9310 | nan | 0.8712 | 0.0 | 0.5220 | nan | 0.8973 | 0.6018 | 0.1255 | 0.8515 | 0.9819 | 0.5668 | 0.6292 | 0.0319 | 0.8712 | nan | 0.6722 | | 0.0885 | 8.0 | 1120 | 0.1735 | 0.5459 | 0.7133 | 0.9586 | 0.9567 | 0.9586 | nan | 0.7928 | nan | 0.9576 | 0.7771 | 0.0267 | 0.9736 | 0.9902 | 0.5986 | 0.9324 | 0.0267 | 0.9295 | nan | 0.8408 | 0.0 | 0.5299 | nan | 0.8977 | 0.6192 | 0.0267 | 0.8524 | 0.9816 | 0.5646 | 0.5025 | 0.0265 | 0.8710 | nan | 0.6785 | | 0.0733 | 8.14 | 1140 | 0.1885 | 0.5195 | 0.7379 | 0.9568 | 0.9548 | 0.9568 | nan | 0.8960 | nan | 0.9555 | 0.7290 | 0.1476 | 0.9668 | 0.9911 | 0.6035 | 0.9970 | 0.0292 | 0.9178 | nan | 0.8837 | 0.0 | 0.4289 | nan | 0.8958 | 0.6001 | 0.1473 | 0.8362 | 0.9820 | 0.5614 | 0.2523 | 0.0288 | 0.8681 | nan | 0.6333 | | 0.1013 | 8.29 | 1160 | 0.1858 | 0.4905 | 0.6758 | 0.9573 | 0.9552 | 0.9573 | nan | 0.8392 | nan | 0.9556 | 0.7065 | 0.1215 | 0.9801 | 0.9915 | 0.6126 | 0.3806 | 0.0513 | 0.9164 | nan | 0.8780 | 0.0 | 0.4198 | nan | 0.8962 | 0.5930 | 0.1210 | 0.8496 | 0.9813 | 0.5625 | 0.368 | 0.0467 | 0.8654 | 0.0 | 0.6728 | | 0.1106 | 8.43 | 1180 | 0.1901 | 0.4884 | 0.6664 | 0.9576 | 0.9556 | 0.9576 | nan | 0.8285 | nan | 0.9607 | 0.7183 | 0.1046 | 0.9827 | 0.9891 | 0.6080 | 0.3045 | 0.0626 | 0.9193 | nan | 0.8519 | 0.0 | 0.4406 | nan | 0.8967 | 0.6019 | 0.1046 | 0.8520 | 0.9811 | 0.5646 | 0.2993 | 0.0552 | 0.8679 | 0.0 | 0.6852 | | 0.048 | 8.57 | 1200 | 0.1850 | 0.5147 | 0.7050 | 0.9581 | 0.9561 | 0.9581 | nan | 0.8221 | nan | 0.9547 | 0.7417 | 0.1030 | 0.9834 | 0.9910 | 0.5972 | 0.7130 | 0.0613 | 0.9240 | nan | 0.8639 | 0.0 | 0.4530 | nan | 0.8962 | 0.6125 | 0.1030 | 0.8556 | 0.9812 | 0.5685 | 0.6192 | 0.0552 | 0.8686 | 0.0 | 0.6780 | | 0.0432 | 8.71 | 1220 | 0.1882 | 0.5532 | 0.7060 | 0.9582 | 0.9562 | 0.9582 | nan | 0.7624 | nan | 0.9642 | 0.7647 | 0.0827 | 0.9820 | 0.9908 | 0.5941 | 0.7796 | 0.0378 | 0.9106 | nan | 0.8968 | 0.0 | 0.4294 | nan | 0.8960 | 0.6209 | 0.0827 | 0.8571 | 0.9819 | 0.5676 | 0.6324 | 0.0352 | 0.8681 | nan | 0.6671 | | 0.055 | 8.86 | 1240 | 0.1945 | 0.5064 | 0.7067 | 0.9573 | 0.9556 | 0.9573 | nan | 0.7673 | nan | 0.9567 | 0.7340 | 0.1114 | 0.9864 | 0.9896 | 0.5925 | 0.7657 | 0.0369 | 0.9211 | nan | 0.9121 | 0.0 | 0.3911 | nan | 0.8946 | 0.6083 | 0.1114 | 0.8544 | 0.9813 | 0.5641 | 0.6321 | 0.0343 | 0.8695 | 0.0 | 0.6420 | | 0.059 | 9.0 | 1260 | 0.1973 | 0.5038 | 0.7024 | 0.9570 | 0.9552 | 0.9570 | nan | 0.7658 | nan | 0.9533 | 0.6882 | 0.1303 | 0.9873 | 0.9898 | 0.5932 | 0.7265 | 0.0412 | 0.9257 | nan | 0.9251 | 0.0 | 0.3931 | nan | 0.8943 | 0.5851 | 0.1303 | 0.8496 | 0.9815 | 0.5635 | 0.6269 | 0.0385 | 0.8683 | 0.0 | 0.6181 | | 0.0475 | 9.14 | 1280 | 0.1914 | 0.4995 | 0.7204 | 0.9576 | 0.9557 | 0.9576 | nan | 0.7538 | nan | 0.9685 | 0.7243 | 0.1251 | 0.9707 | 0.9907 | 0.6172 | 0.9415 | 0.0338 | 0.9019 | nan | 0.8966 | 0.0 | 0.4433 | nan | 0.8957 | 0.6008 | 0.1251 | 0.8535 | 0.9818 | 0.5719 | 0.4568 | 0.0322 | 0.8641 | 0.0 | 0.6684 | | 0.0587 | 9.29 | 1300 | 0.1891 | 0.5230 | 0.7096 | 0.9578 | 0.9558 | 0.9578 | nan | 0.7424 | nan | 0.9458 | 0.6665 | 0.1591 | 0.9857 | 0.9914 | 0.6099 | 0.8553 | 0.0419 | 0.9382 | nan | 0.8694 | 0.0 | 0.5250 | nan | 0.8940 | 0.5750 | 0.1590 | 0.8516 | 0.9812 | 0.5693 | 0.6475 | 0.0408 | 0.8675 | 0.0 | 0.6875 | | 0.3326 | 9.43 | 1320 | 0.1884 | 0.5222 | 0.6943 | 0.9584 | 0.9563 | 0.9584 | nan | 0.7328 | nan | 0.9658 | 0.6679 | 0.1602 | 0.9856 | 0.9913 | 0.6074 | 0.7231 | 0.0326 | 0.9102 | nan | 0.8604 | 0.0 | 0.5361 | nan | 0.8975 | 0.5742 | 0.1602 | 0.8503 | 0.9812 | 0.5670 | 0.6299 | 0.0318 | 0.8681 | 0.0 | 0.6919 | | 0.0831 | 9.57 | 1340 | 0.1839 | 0.5198 | 0.6966 | 0.9580 | 0.9562 | 0.9580 | nan | 0.7412 | nan | 0.9479 | 0.7875 | 0.1256 | 0.9837 | 0.9898 | 0.5832 | 0.6430 | 0.0461 | 0.9406 | nan | 0.8739 | 0.0 | 0.5293 | nan | 0.8948 | 0.6254 | 0.1256 | 0.8549 | 0.9811 | 0.5608 | 0.5866 | 0.0441 | 0.8685 | 0.0 | 0.6862 | | 0.1516 | 9.71 | 1360 | 0.1842 | 0.5201 | 0.6960 | 0.9587 | 0.9567 | 0.9587 | nan | 0.7305 | nan | 0.9594 | 0.7370 | 0.1114 | 0.9850 | 0.9918 | 0.5987 | 0.6895 | 0.0327 | 0.9186 | nan | 0.9011 | 0.0 | 0.5407 | nan | 0.8975 | 0.6112 | 0.1114 | 0.8557 | 0.9810 | 0.5665 | 0.6164 | 0.0319 | 0.8702 | 0.0 | 0.6783 | | 0.0939 | 9.86 | 1380 | 0.1761 | 0.5088 | 0.7189 | 0.9586 | 0.9566 | 0.9586 | nan | 0.7373 | nan | 0.9616 | 0.6987 | 0.1289 | 0.9774 | 0.9911 | 0.6072 | 0.9474 | 0.0306 | 0.9195 | nan | 0.9085 | 0.0 | 0.5297 | nan | 0.8978 | 0.5948 | 0.1289 | 0.8534 | 0.9813 | 0.5698 | 0.4878 | 0.0300 | 0.8705 | 0.0 | 0.6702 | | 0.0428 | 10.0 | 1400 | 0.1825 | 0.5133 | 0.7102 | 0.9583 | 0.9563 | 0.9583 | nan | 0.7538 | nan | 0.9589 | 0.6829 | 0.1150 | 0.9833 | 0.9902 | 0.6136 | 0.8040 | 0.0502 | 0.9227 | nan | 0.9372 | 0.0 | 0.4877 | nan | 0.8961 | 0.5878 | 0.1150 | 0.8555 | 0.9817 | 0.5722 | 0.6442 | 0.0475 | 0.8710 | 0.0 | 0.6139 | | 0.2342 | 10.14 | 1420 | 0.1831 | 0.5146 | 0.7101 | 0.9578 | 0.9559 | 0.9578 | nan | 0.7597 | nan | 0.9611 | 0.7441 | 0.1643 | 0.9848 | 0.9914 | 0.6014 | 0.6750 | 0.0780 | 0.9071 | nan | 0.9444 | 0.0 | 0.4734 | nan | 0.8959 | 0.6148 | 0.1640 | 0.8524 | 0.9815 | 0.5709 | 0.6038 | 0.0738 | 0.8660 | 0.0 | 0.5927 | | 0.0848 | 10.29 | 1440 | 0.1801 | 0.5109 | 0.7277 | 0.9581 | 0.9561 | 0.9581 | nan | 0.8531 | nan | 0.9517 | 0.7690 | 0.1595 | 0.9814 | 0.9901 | 0.6018 | 0.7569 | 0.1006 | 0.9284 | nan | 0.9125 | 0.0 | 0.4039 | nan | 0.8959 | 0.6328 | 0.1590 | 0.8535 | 0.9820 | 0.5718 | 0.5806 | 0.0945 | 0.8697 | 0.0 | 0.5975 | | 0.0382 | 10.43 | 1460 | 0.1833 | 0.5058 | 0.7327 | 0.9580 | 0.9560 | 0.9580 | nan | 0.8265 | nan | 0.9511 | 0.7649 | 0.1593 | 0.9766 | 0.9907 | 0.6082 | 0.9090 | 0.0556 | 0.9291 | nan | 0.8889 | 0.0 | 0.3872 | nan | 0.8955 | 0.6347 | 0.1590 | 0.8532 | 0.9819 | 0.5744 | 0.5306 | 0.0525 | 0.8699 | 0.0 | 0.6366 | | 0.062 | 10.57 | 1480 | 0.1888 | 0.5106 | 0.7297 | 0.9572 | 0.9555 | 0.9572 | nan | 0.8167 | nan | 0.9548 | 0.7308 | 0.1964 | 0.9830 | 0.9913 | 0.5969 | 0.8945 | 0.0683 | 0.9156 | nan | 0.8778 | 0.0 | 0.3599 | nan | 0.8952 | 0.6182 | 0.1958 | 0.8518 | 0.9814 | 0.5686 | 0.5930 | 0.0642 | 0.8663 | 0.0 | 0.6437 | | 0.5888 | 10.71 | 1500 | 0.1851 | 0.5182 | 0.7056 | 0.9582 | 0.9563 | 0.9582 | nan | 0.7915 | nan | 0.9569 | 0.6846 | 0.2095 | 0.9871 | 0.9924 | 0.6027 | 0.7381 | 0.0279 | 0.9184 | nan | 0.8522 | 0.0 | 0.4238 | nan | 0.8975 | 0.5945 | 0.2091 | 0.8512 | 0.9815 | 0.5688 | 0.6333 | 0.0275 | 0.8684 | 0.0 | 0.6816 | | 0.0494 | 10.86 | 1520 | 0.1839 | 0.5138 | 0.7198 | 0.9586 | 0.9567 | 0.9586 | nan | 0.8061 | nan | 0.9551 | 0.7461 | 0.2026 | 0.9810 | 0.9900 | 0.6078 | 0.7339 | 0.0852 | 0.9287 | nan | 0.8809 | 0.0 | 0.4216 | nan | 0.8978 | 0.6244 | 0.2020 | 0.8546 | 0.9822 | 0.5717 | 0.5105 | 0.0809 | 0.8690 | 0.0 | 0.6643 | | 0.2025 | 11.0 | 1540 | 0.1805 | 0.5165 | 0.7038 | 0.9588 | 0.9568 | 0.9588 | nan | 0.7773 | nan | 0.9518 | 0.7327 | 0.1523 | 0.9834 | 0.9920 | 0.6106 | 0.6694 | 0.0683 | 0.9288 | nan | 0.8754 | 0.0 | 0.4676 | nan | 0.8971 | 0.6160 | 0.1522 | 0.8550 | 0.9817 | 0.5746 | 0.5562 | 0.0657 | 0.8705 | 0.0 | 0.6778 | | 0.0745 | 11.14 | 1560 | 0.1835 | 0.5154 | 0.7111 | 0.9590 | 0.9570 | 0.9590 | nan | 0.7899 | nan | 0.9593 | 0.7523 | 0.1406 | 0.9825 | 0.9902 | 0.6086 | 0.7256 | 0.0625 | 0.9245 | nan | 0.8865 | 0.0 | 0.4703 | nan | 0.8968 | 0.6292 | 0.1404 | 0.8555 | 0.9823 | 0.5738 | 0.5568 | 0.0610 | 0.8717 | 0.0 | 0.6622 | | 0.0415 | 11.29 | 1580 | 0.1871 | 0.5177 | 0.7087 | 0.9590 | 0.9571 | 0.9590 | nan | 0.8002 | nan | 0.9587 | 0.7620 | 0.1336 | 0.9837 | 0.9913 | 0.6072 | 0.6837 | 0.0697 | 0.9204 | nan | 0.8854 | 0.0 | 0.4682 | nan | 0.8970 | 0.6321 | 0.1336 | 0.8554 | 0.9823 | 0.5751 | 0.5888 | 0.0684 | 0.8708 | 0.0 | 0.6581 | | 0.0656 | 11.43 | 1600 | 0.1883 | 0.5130 | 0.7104 | 0.9581 | 0.9562 | 0.9581 | nan | 0.8059 | nan | 0.9499 | 0.7875 | 0.1272 | 0.9816 | 0.9907 | 0.6133 | 0.6534 | 0.0681 | 0.9286 | nan | 0.9080 | 0.0 | 0.4337 | nan | 0.8942 | 0.6338 | 0.1272 | 0.8553 | 0.9824 | 0.5745 | 0.5952 | 0.0653 | 0.8676 | 0.0 | 0.6396 | | 0.0552 | 11.57 | 1620 | 0.1961 | 0.5168 | 0.7154 | 0.9583 | 0.9563 | 0.9583 | nan | 0.8002 | nan | 0.9552 | 0.7861 | 0.1349 | 0.9852 | 0.9911 | 0.5995 | 0.7359 | 0.0527 | 0.9209 | nan | 0.9076 | 0.0 | 0.4303 | nan | 0.8952 | 0.6386 | 0.1349 | 0.8557 | 0.9825 | 0.5714 | 0.6445 | 0.0497 | 0.8680 | 0.0 | 0.6481 | | 0.0589 | 11.71 | 1640 | 0.1937 | 0.5181 | 0.7359 | 0.9579 | 0.9560 | 0.9579 | nan | 0.7957 | nan | 0.9468 | 0.7688 | 0.2089 | 0.9811 | 0.9899 | 0.5968 | 0.8999 | 0.0647 | 0.9384 | nan | 0.9044 | 0.0 | 0.4236 | nan | 0.8935 | 0.6368 | 0.2078 | 0.8562 | 0.9822 | 0.5699 | 0.5887 | 0.0607 | 0.8673 | 0.0 | 0.6487 | | 0.0536 | 11.86 | 1660 | 0.1889 | 0.5271 | 0.7351 | 0.9586 | 0.9567 | 0.9586 | nan | 0.7943 | nan | 0.9618 | 0.7502 | 0.2350 | 0.9801 | 0.9911 | 0.6077 | 0.8713 | 0.0740 | 0.9129 | nan | 0.9080 | 0.0 | 0.4264 | nan | 0.8972 | 0.6320 | 0.2327 | 0.8573 | 0.9820 | 0.5757 | 0.6639 | 0.0691 | 0.8686 | 0.0 | 0.6480 | | 0.0737 | 12.0 | 1680 | 0.1841 | 0.5331 | 0.7214 | 0.9591 | 0.9571 | 0.9591 | nan | 0.7813 | nan | 0.9567 | 0.7034 | 0.3268 | 0.9820 | 0.9920 | 0.6093 | 0.7264 | 0.0534 | 0.9243 | nan | 0.8795 | 0.0 | 0.4470 | nan | 0.8978 | 0.6115 | 0.3221 | 0.8568 | 0.9819 | 0.5743 | 0.6380 | 0.0518 | 0.8711 | 0.0 | 0.6782 | | 0.108 | 12.14 | 1700 | 0.1763 | 0.5322 | 0.7202 | 0.9591 | 0.9572 | 0.9591 | nan | 0.7773 | nan | 0.9578 | 0.7362 | 0.3114 | 0.9828 | 0.9914 | 0.6018 | 0.7096 | 0.0489 | 0.9243 | nan | 0.8804 | 0.0 | 0.4503 | nan | 0.8976 | 0.6256 | 0.3081 | 0.8565 | 0.9822 | 0.5729 | 0.6303 | 0.0479 | 0.8704 | 0.0 | 0.6765 | | 0.0687 | 12.29 | 1720 | 0.1843 | 0.5354 | 0.7149 | 0.9590 | 0.9572 | 0.9590 | nan | 0.7551 | nan | 0.9620 | 0.7318 | 0.2955 | 0.9849 | 0.9913 | 0.6057 | 0.6933 | 0.0755 | 0.9162 | nan | 0.8527 | 0.0 | 0.4865 | nan | 0.8980 | 0.6216 | 0.2925 | 0.8554 | 0.9819 | 0.5733 | 0.6197 | 0.0717 | 0.8699 | 0.0 | 0.6899 | | 0.172 | 12.43 | 1740 | 0.1871 | 0.5306 | 0.7118 | 0.9589 | 0.9570 | 0.9589 | nan | 0.7587 | nan | 0.9553 | 0.7040 | 0.2450 | 0.9845 | 0.9918 | 0.6109 | 0.7122 | 0.0647 | 0.9256 | nan | 0.8768 | 0.0 | 0.4929 | nan | 0.8971 | 0.6076 | 0.2432 | 0.8548 | 0.9818 | 0.5738 | 0.6302 | 0.0620 | 0.8709 | 0.0 | 0.6835 | | 0.0372 | 12.57 | 1760 | 0.1903 | 0.5255 | 0.7084 | 0.9591 | 0.9573 | 0.9591 | nan | 0.7597 | nan | 0.9588 | 0.7591 | 0.2464 | 0.9854 | 0.9898 | 0.6058 | 0.5902 | 0.0727 | 0.9261 | nan | 0.8984 | 0.0 | 0.4919 | nan | 0.8976 | 0.6378 | 0.2403 | 0.8540 | 0.9823 | 0.5732 | 0.5445 | 0.0686 | 0.8719 | 0.0 | 0.6697 | | 0.064 | 12.71 | 1780 | 0.1862 | 0.5316 | 0.7163 | 0.9595 | 0.9575 | 0.9595 | nan | 0.7656 | nan | 0.9545 | 0.7551 | 0.2885 | 0.9833 | 0.9917 | 0.6102 | 0.6238 | 0.0758 | 0.9284 | nan | 0.9026 | 0.0 | 0.4961 | nan | 0.8975 | 0.6395 | 0.2820 | 0.8556 | 0.9825 | 0.5757 | 0.5715 | 0.0733 | 0.8722 | 0.0 | 0.6654 | | 0.0509 | 12.86 | 1800 | 0.1905 | 0.5254 | 0.7113 | 0.9594 | 0.9574 | 0.9594 | nan | 0.7642 | nan | 0.9569 | 0.7918 | 0.2705 | 0.9850 | 0.9913 | 0.5996 | 0.5671 | 0.0696 | 0.9245 | nan | 0.9038 | 0.0 | 0.4820 | nan | 0.8975 | 0.6497 | 0.2643 | 0.8549 | 0.9827 | 0.5722 | 0.5254 | 0.0676 | 0.8720 | 0.0 | 0.6619 | | 0.0535 | 13.0 | 1820 | 0.1879 | 0.5296 | 0.7377 | 0.9592 | 0.9572 | 0.9592 | nan | 0.7719 | nan | 0.9573 | 0.7868 | 0.3083 | 0.9829 | 0.9904 | 0.6028 | 0.8184 | 0.0684 | 0.9256 | nan | 0.9021 | 0.0 | 0.4738 | nan | 0.8968 | 0.6491 | 0.3021 | 0.8548 | 0.9827 | 0.5719 | 0.5557 | 0.0664 | 0.8711 | 0.0 | 0.6602 | | 0.1704 | 13.14 | 1840 | 0.1896 | 0.5270 | 0.7349 | 0.9593 | 0.9573 | 0.9593 | nan | 0.7642 | nan | 0.9551 | 0.7636 | 0.2854 | 0.9829 | 0.9914 | 0.5982 | 0.8710 | 0.0559 | 0.9290 | nan | 0.8873 | 0.0 | 0.4942 | nan | 0.8975 | 0.6378 | 0.2822 | 0.8531 | 0.9826 | 0.5689 | 0.5329 | 0.0546 | 0.8722 | 0.0 | 0.6752 | | 0.0337 | 13.29 | 1860 | 0.1888 | 0.5350 | 0.7358 | 0.9593 | 0.9573 | 0.9593 | nan | 0.7763 | nan | 0.9604 | 0.7543 | 0.2904 | 0.9836 | 0.9905 | 0.6066 | 0.8228 | 0.0788 | 0.9216 | nan | 0.9084 | 0.0 | 0.4906 | nan | 0.8978 | 0.6359 | 0.2870 | 0.8553 | 0.9825 | 0.5712 | 0.6353 | 0.0751 | 0.8720 | 0.0 | 0.6525 | | 0.0598 | 13.43 | 1880 | 0.1862 | 0.5378 | 0.7311 | 0.9592 | 0.9572 | 0.9592 | nan | 0.7700 | nan | 0.9551 | 0.7367 | 0.3160 | 0.9848 | 0.9914 | 0.6077 | 0.7778 | 0.0761 | 0.9262 | nan | 0.8999 | 0.0 | 0.4963 | nan | 0.8968 | 0.6290 | 0.3121 | 0.8551 | 0.9823 | 0.5720 | 0.6438 | 0.0731 | 0.8714 | 0.0 | 0.6594 | | 0.0543 | 13.57 | 1900 | 0.1777 | 0.5310 | 0.7236 | 0.9592 | 0.9572 | 0.9592 | nan | 0.7702 | nan | 0.9570 | 0.7543 | 0.2327 | 0.9801 | 0.9918 | 0.6077 | 0.7906 | 0.0611 | 0.9239 | nan | 0.8905 | 0.0 | 0.4936 | nan | 0.8968 | 0.6330 | 0.2309 | 0.8573 | 0.9824 | 0.5732 | 0.6366 | 0.0594 | 0.8709 | 0.0 | 0.6688 | | 0.1649 | 13.71 | 1920 | 0.1830 | 0.5302 | 0.7181 | 0.9591 | 0.9572 | 0.9591 | nan | 0.7749 | nan | 0.9594 | 0.7293 | 0.2575 | 0.9846 | 0.9921 | 0.6001 | 0.7317 | 0.0574 | 0.9189 | nan | 0.8938 | 0.0 | 0.4759 | nan | 0.8971 | 0.6256 | 0.2550 | 0.8548 | 0.9824 | 0.5719 | 0.6386 | 0.0562 | 0.8707 | 0.0 | 0.6640 | | 0.051 | 13.86 | 1940 | 0.1895 | 0.5307 | 0.7279 | 0.9588 | 0.9569 | 0.9588 | nan | 0.7783 | nan | 0.9530 | 0.7308 | 0.2663 | 0.9851 | 0.9907 | 0.6096 | 0.7884 | 0.0730 | 0.9301 | nan | 0.9017 | 0.0 | 0.4625 | nan | 0.8961 | 0.6243 | 0.2638 | 0.8531 | 0.9825 | 0.5727 | 0.6491 | 0.0703 | 0.8710 | 0.0 | 0.6540 | | 0.0796 | 14.0 | 1960 | 0.1881 | 0.5299 | 0.7261 | 0.9590 | 0.9570 | 0.9590 | nan | 0.7763 | nan | 0.9573 | 0.7416 | 0.2513 | 0.9844 | 0.9916 | 0.6071 | 0.8030 | 0.0627 | 0.9211 | nan | 0.8908 | 0.0 | 0.4613 | nan | 0.8968 | 0.6276 | 0.2491 | 0.8542 | 0.9824 | 0.5734 | 0.6488 | 0.0606 | 0.8708 | 0.0 | 0.6637 | | 0.0571 | 14.14 | 1980 | 0.1903 | 0.5310 | 0.7228 | 0.9590 | 0.9571 | 0.9590 | nan | 0.7754 | nan | 0.9557 | 0.7423 | 0.2426 | 0.9851 | 0.9908 | 0.6076 | 0.7664 | 0.0701 | 0.9272 | nan | 0.8874 | 0.0 | 0.4698 | nan | 0.8969 | 0.6280 | 0.2404 | 0.8541 | 0.9825 | 0.5727 | 0.6478 | 0.0671 | 0.8714 | 0.0 | 0.6718 | | 0.0965 | 14.29 | 2000 | 0.1890 | 0.5311 | 0.7291 | 0.9590 | 0.9571 | 0.9590 | nan | 0.7785 | nan | 0.9557 | 0.7374 | 0.2705 | 0.9841 | 0.9915 | 0.6105 | 0.8095 | 0.0671 | 0.9246 | nan | 0.8905 | 0.0 | 0.4598 | nan | 0.8971 | 0.6268 | 0.2679 | 0.8548 | 0.9824 | 0.5739 | 0.6419 | 0.0647 | 0.8712 | 0.0 | 0.6640 | | 0.0781 | 14.43 | 2020 | 0.1806 | 0.5320 | 0.7290 | 0.9592 | 0.9572 | 0.9592 | nan | 0.7752 | nan | 0.9569 | 0.7442 | 0.2698 | 0.9829 | 0.9919 | 0.6053 | 0.8162 | 0.0660 | 0.9230 | nan | 0.8871 | 0.0 | 0.4712 | nan | 0.8972 | 0.6308 | 0.2673 | 0.8557 | 0.9824 | 0.5735 | 0.6342 | 0.0641 | 0.8711 | 0.0 | 0.6682 | | 0.0625 | 14.57 | 2040 | 0.1852 | 0.5321 | 0.7265 | 0.9593 | 0.9573 | 0.9593 | nan | 0.7666 | nan | 0.9577 | 0.7435 | 0.2507 | 0.9826 | 0.9909 | 0.6107 | 0.7996 | 0.0713 | 0.9253 | nan | 0.8927 | 0.0 | 0.4812 | nan | 0.8973 | 0.6299 | 0.2484 | 0.8556 | 0.9825 | 0.5740 | 0.6401 | 0.0687 | 0.8716 | 0.0 | 0.6683 | | 0.0627 | 14.71 | 2060 | 0.1850 | 0.5271 | 0.7204 | 0.9592 | 0.9572 | 0.9592 | nan | 0.7686 | nan | 0.9563 | 0.7341 | 0.2154 | 0.9828 | 0.9918 | 0.6091 | 0.7934 | 0.0510 | 0.9252 | nan | 0.8966 | 0.0 | 0.4815 | nan | 0.8971 | 0.6240 | 0.2142 | 0.8556 | 0.9824 | 0.5746 | 0.6394 | 0.0500 | 0.8717 | 0.0 | 0.6623 | | 0.0814 | 14.86 | 2080 | 0.1874 | 0.5309 | 0.7238 | 0.9592 | 0.9572 | 0.9592 | nan | 0.7710 | nan | 0.9556 | 0.7394 | 0.2437 | 0.9849 | 0.9917 | 0.6064 | 0.7751 | 0.0718 | 0.9251 | nan | 0.8967 | 0.0 | 0.4741 | nan | 0.8971 | 0.6281 | 0.2416 | 0.8543 | 0.9825 | 0.5741 | 0.6483 | 0.0696 | 0.8717 | 0.0 | 0.6606 | | 0.0574 | 15.0 | 2100 | 0.1841 | 0.5314 | 0.7218 | 0.9593 | 0.9573 | 0.9593 | nan | 0.7654 | nan | 0.9576 | 0.7387 | 0.2407 | 0.9835 | 0.9917 | 0.6095 | 0.7820 | 0.0621 | 0.9230 | nan | 0.8854 | 0.0 | 0.4810 | nan | 0.8973 | 0.6272 | 0.2386 | 0.8552 | 0.9824 | 0.5743 | 0.6470 | 0.0603 | 0.8715 | 0.0 | 0.6733 | ### Framework versions - Transformers 4.33.2 - Pytorch 2.0.1 - Datasets 3.0.0 - Tokenizers 0.13.3