File size: 36,045 Bytes
140b2e6 3317176 140b2e6 3317176 5f78ce6 3317176 5f78ce6 3317176 5f78ce6 3317176 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 |
---
library_name: transformers
license: other
base_model: nvidia/mit-b0
tags:
- vision
- image-segmentation
- generated_from_trainer
model-index:
- name: custom-object-masking_v4-windows
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# custom-object-masking_v4-windows
This model is a fine-tuned version of [nvidia/mit-b0](https://huggingface.co/nvidia/mit-b0) on the sungile/custom-object-masking_v4_windows dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0683
- Mean Iou: 0.8920
- Mean Accuracy: 0.9387
- Overall Accuracy: 0.9781
- Accuracy Unknown: nan
- Accuracy Background: 0.9894
- Accuracy Windows: 0.9326
- Accuracy Doors: 0.8941
- Iou Unknown: nan
- Iou Background: 0.9766
- Iou Windows: 0.8664
- Iou Doors: 0.8330
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 6e-05
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 13
### Training results
| Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Unknown | Accuracy Background | Accuracy Windows | Accuracy Doors | Iou Unknown | Iou Background | Iou Windows | Iou Doors |
|:-------------:|:-------:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:----------------:|:-------------------:|:----------------:|:--------------:|:-----------:|:--------------:|:-----------:|:---------:|
| 1.1123 | 0.0889 | 20 | 1.2340 | 0.3693 | 0.7755 | 0.7972 | nan | 0.8019 | 0.7161 | 0.8085 | 0.0 | 0.7971 | 0.3814 | 0.2986 |
| 0.8576 | 0.1778 | 40 | 0.8315 | 0.4604 | 0.7890 | 0.8964 | nan | 0.9248 | 0.6823 | 0.7599 | 0.0 | 0.9086 | 0.5196 | 0.4135 |
| 0.6731 | 0.2667 | 60 | 0.6788 | 0.4918 | 0.8207 | 0.9163 | nan | 0.9450 | 0.8512 | 0.6659 | 0.0 | 0.9246 | 0.5809 | 0.4618 |
| 0.6596 | 0.3556 | 80 | 0.5392 | 0.6508 | 0.8229 | 0.9103 | nan | 0.9352 | 0.7984 | 0.7351 | nan | 0.9185 | 0.5802 | 0.4539 |
| 0.6217 | 0.4444 | 100 | 0.4434 | 0.6832 | 0.8085 | 0.9291 | nan | 0.9635 | 0.7790 | 0.6831 | nan | 0.9383 | 0.6202 | 0.4909 |
| 0.4555 | 0.5333 | 120 | 0.3915 | 0.6932 | 0.8107 | 0.9327 | nan | 0.9688 | 0.8269 | 0.6364 | nan | 0.9405 | 0.6506 | 0.4885 |
| 0.4429 | 0.6222 | 140 | 0.3746 | 0.6948 | 0.8375 | 0.9266 | nan | 0.9516 | 0.8020 | 0.7591 | nan | 0.9344 | 0.6549 | 0.4951 |
| 0.3978 | 0.7111 | 160 | 0.3440 | 0.6987 | 0.8443 | 0.9318 | nan | 0.9585 | 0.8851 | 0.6895 | nan | 0.9398 | 0.6426 | 0.5138 |
| 0.5 | 0.8 | 180 | 0.3016 | 0.7152 | 0.8231 | 0.9397 | nan | 0.9738 | 0.8225 | 0.6731 | nan | 0.9468 | 0.6642 | 0.5345 |
| 0.2722 | 0.8889 | 200 | 0.3163 | 0.7193 | 0.8670 | 0.9353 | nan | 0.9553 | 0.8699 | 0.7760 | nan | 0.9423 | 0.6688 | 0.5467 |
| 0.327 | 0.9778 | 220 | 0.2595 | 0.7225 | 0.8337 | 0.9399 | nan | 0.9701 | 0.8042 | 0.7270 | nan | 0.9464 | 0.6715 | 0.5498 |
| 0.3964 | 1.0667 | 240 | 0.2516 | 0.7305 | 0.8162 | 0.9458 | nan | 0.9834 | 0.8069 | 0.6582 | nan | 0.9516 | 0.6757 | 0.5643 |
| 0.2407 | 1.1556 | 260 | 0.2199 | 0.7422 | 0.8589 | 0.9458 | nan | 0.9715 | 0.8708 | 0.7343 | nan | 0.9526 | 0.6906 | 0.5833 |
| 0.3972 | 1.2444 | 280 | 0.2210 | 0.7424 | 0.8679 | 0.9442 | nan | 0.9667 | 0.8737 | 0.7634 | nan | 0.9511 | 0.6975 | 0.5786 |
| 0.1568 | 1.3333 | 300 | 0.2047 | 0.7442 | 0.8495 | 0.9465 | nan | 0.9747 | 0.8460 | 0.7277 | nan | 0.9525 | 0.6979 | 0.5822 |
| 0.2474 | 1.4222 | 320 | 0.2032 | 0.7476 | 0.8592 | 0.9458 | nan | 0.9699 | 0.8170 | 0.7908 | nan | 0.9522 | 0.7013 | 0.5895 |
| 0.183 | 1.5111 | 340 | 0.2112 | 0.7454 | 0.8717 | 0.9423 | nan | 0.9618 | 0.8341 | 0.8193 | nan | 0.9480 | 0.7119 | 0.5762 |
| 0.2524 | 1.6 | 360 | 0.1827 | 0.7435 | 0.8450 | 0.9477 | nan | 0.9779 | 0.8526 | 0.7045 | nan | 0.9546 | 0.6965 | 0.5792 |
| 0.1665 | 1.6889 | 380 | 0.1746 | 0.7608 | 0.8626 | 0.9514 | nan | 0.9767 | 0.8368 | 0.7743 | nan | 0.9582 | 0.7052 | 0.6191 |
| 0.618 | 1.7778 | 400 | 0.1765 | 0.7565 | 0.8753 | 0.9486 | nan | 0.9696 | 0.8609 | 0.7955 | nan | 0.9556 | 0.7051 | 0.6088 |
| 0.3693 | 1.8667 | 420 | 0.1629 | 0.7653 | 0.8720 | 0.9505 | nan | 0.9727 | 0.8434 | 0.7999 | nan | 0.9563 | 0.7243 | 0.6152 |
| 0.2788 | 1.9556 | 440 | 0.1523 | 0.7681 | 0.8712 | 0.9526 | nan | 0.9757 | 0.8483 | 0.7897 | nan | 0.9591 | 0.7216 | 0.6235 |
| 0.09 | 2.0444 | 460 | 0.1746 | 0.7438 | 0.8712 | 0.9422 | nan | 0.9605 | 0.7828 | 0.8704 | nan | 0.9494 | 0.6970 | 0.5850 |
| 0.1173 | 2.1333 | 480 | 0.1417 | 0.7871 | 0.8677 | 0.9580 | nan | 0.9834 | 0.8333 | 0.7864 | nan | 0.9623 | 0.7330 | 0.6659 |
| 0.1552 | 2.2222 | 500 | 0.1581 | 0.7588 | 0.8610 | 0.9546 | nan | 0.9835 | 0.9186 | 0.6810 | nan | 0.9639 | 0.6937 | 0.6186 |
| 0.2021 | 2.3111 | 520 | 0.1400 | 0.7786 | 0.8658 | 0.9581 | nan | 0.9860 | 0.9008 | 0.7105 | nan | 0.9646 | 0.7254 | 0.6459 |
| 0.2156 | 2.4 | 540 | 0.1332 | 0.7945 | 0.8729 | 0.9596 | nan | 0.9849 | 0.8701 | 0.7638 | nan | 0.9638 | 0.7560 | 0.6636 |
| 0.3223 | 2.4889 | 560 | 0.1371 | 0.7754 | 0.8454 | 0.9579 | nan | 0.9919 | 0.8833 | 0.6609 | nan | 0.9636 | 0.7414 | 0.6213 |
| 0.1204 | 2.5778 | 580 | 0.1370 | 0.8055 | 0.9040 | 0.9582 | nan | 0.9733 | 0.8797 | 0.8589 | nan | 0.9602 | 0.7812 | 0.6750 |
| 0.1454 | 2.6667 | 600 | 0.1290 | 0.8106 | 0.8990 | 0.9602 | nan | 0.9775 | 0.8800 | 0.8395 | nan | 0.9621 | 0.7856 | 0.6842 |
| 0.2149 | 2.7556 | 620 | 0.1375 | 0.7664 | 0.8532 | 0.9559 | nan | 0.9869 | 0.8897 | 0.6830 | nan | 0.9639 | 0.7244 | 0.6110 |
| 0.0912 | 2.8444 | 640 | 0.1251 | 0.7898 | 0.8694 | 0.9594 | nan | 0.9854 | 0.8598 | 0.7631 | nan | 0.9648 | 0.7437 | 0.6609 |
| 0.0827 | 2.9333 | 660 | 0.1242 | 0.7959 | 0.8868 | 0.9584 | nan | 0.9789 | 0.8726 | 0.8088 | nan | 0.9625 | 0.7624 | 0.6628 |
| 0.1986 | 3.0222 | 680 | 0.1324 | 0.7794 | 0.8818 | 0.9568 | nan | 0.9800 | 0.9269 | 0.7387 | nan | 0.9633 | 0.7294 | 0.6456 |
| 0.0993 | 3.1111 | 700 | 0.1158 | 0.8141 | 0.8824 | 0.9643 | nan | 0.9875 | 0.8582 | 0.8014 | nan | 0.9677 | 0.7681 | 0.7065 |
| 0.1709 | 3.2 | 720 | 0.1128 | 0.8159 | 0.9045 | 0.9629 | nan | 0.9800 | 0.9043 | 0.8293 | nan | 0.9657 | 0.7750 | 0.7070 |
| 0.1923 | 3.2889 | 740 | 0.1125 | 0.8201 | 0.8913 | 0.9651 | nan | 0.9865 | 0.8874 | 0.7998 | nan | 0.9680 | 0.7802 | 0.7120 |
| 0.0559 | 3.3778 | 760 | 0.1138 | 0.8247 | 0.9117 | 0.9635 | nan | 0.9780 | 0.8874 | 0.8696 | nan | 0.9652 | 0.7963 | 0.7127 |
| 0.2231 | 3.4667 | 780 | 0.1084 | 0.8270 | 0.9147 | 0.9642 | nan | 0.9782 | 0.9006 | 0.8654 | nan | 0.9659 | 0.7969 | 0.7184 |
| 0.0587 | 3.5556 | 800 | 0.1042 | 0.8296 | 0.9132 | 0.9662 | nan | 0.9817 | 0.9159 | 0.8419 | nan | 0.9687 | 0.7893 | 0.7309 |
| 0.0754 | 3.6444 | 820 | 0.1063 | 0.8324 | 0.8984 | 0.9669 | nan | 0.9858 | 0.8566 | 0.8530 | nan | 0.9689 | 0.7947 | 0.7336 |
| 0.2001 | 3.7333 | 840 | 0.1188 | 0.8069 | 0.9188 | 0.9595 | nan | 0.9716 | 0.9253 | 0.8594 | nan | 0.9635 | 0.7752 | 0.6820 |
| 0.0732 | 3.8222 | 860 | 0.1036 | 0.8321 | 0.8903 | 0.9669 | nan | 0.9894 | 0.8944 | 0.7872 | nan | 0.9681 | 0.8110 | 0.7172 |
| 0.1668 | 3.9111 | 880 | 0.1343 | 0.7993 | 0.9242 | 0.9515 | nan | 0.9588 | 0.9001 | 0.9138 | nan | 0.9518 | 0.8042 | 0.6419 |
| 0.1307 | 4.0 | 900 | 0.1041 | 0.8276 | 0.8938 | 0.9658 | nan | 0.9870 | 0.8990 | 0.7954 | nan | 0.9676 | 0.8055 | 0.7099 |
| 0.0929 | 4.0889 | 920 | 0.1091 | 0.8127 | 0.8989 | 0.9643 | nan | 0.9843 | 0.9304 | 0.7819 | nan | 0.9690 | 0.7628 | 0.7062 |
| 0.0936 | 4.1778 | 940 | 0.0985 | 0.8428 | 0.9230 | 0.9680 | nan | 0.9808 | 0.9077 | 0.8804 | nan | 0.9695 | 0.8142 | 0.7448 |
| 0.0645 | 4.2667 | 960 | 0.1019 | 0.8312 | 0.9123 | 0.9665 | nan | 0.9824 | 0.9162 | 0.8382 | nan | 0.9691 | 0.7985 | 0.7259 |
| 0.1122 | 4.3556 | 980 | 0.1075 | 0.8140 | 0.9010 | 0.9643 | nan | 0.9836 | 0.9308 | 0.7886 | nan | 0.9687 | 0.7659 | 0.7073 |
| 0.3607 | 4.4444 | 1000 | 0.1186 | 0.7965 | 0.8587 | 0.9619 | nan | 0.9932 | 0.8998 | 0.6830 | nan | 0.9658 | 0.7641 | 0.6595 |
| 0.0704 | 4.5333 | 1020 | 0.0950 | 0.8454 | 0.9081 | 0.9694 | nan | 0.9873 | 0.9105 | 0.8265 | nan | 0.9700 | 0.8137 | 0.7524 |
| 0.0472 | 4.6222 | 1040 | 0.1128 | 0.8245 | 0.9303 | 0.9609 | nan | 0.9697 | 0.9247 | 0.8965 | nan | 0.9610 | 0.8096 | 0.7029 |
| 0.1245 | 4.7111 | 1060 | 0.0963 | 0.8363 | 0.8919 | 0.9684 | nan | 0.9911 | 0.9038 | 0.7808 | nan | 0.9700 | 0.8114 | 0.7275 |
| 0.0474 | 4.8 | 1080 | 0.0948 | 0.8379 | 0.9114 | 0.9686 | nan | 0.9861 | 0.9408 | 0.8074 | nan | 0.9711 | 0.8092 | 0.7335 |
| 0.0584 | 4.8889 | 1100 | 0.0835 | 0.8650 | 0.9217 | 0.9734 | nan | 0.9887 | 0.9271 | 0.8494 | nan | 0.9736 | 0.8367 | 0.7847 |
| 0.0584 | 4.9778 | 1120 | 0.0965 | 0.8343 | 0.9248 | 0.9669 | nan | 0.9796 | 0.9366 | 0.8583 | nan | 0.9693 | 0.7901 | 0.7436 |
| 0.3062 | 5.0667 | 1140 | 0.0948 | 0.8471 | 0.8990 | 0.9698 | nan | 0.9912 | 0.9240 | 0.7819 | nan | 0.9698 | 0.8270 | 0.7445 |
| 0.0905 | 5.1556 | 1160 | 0.0866 | 0.8609 | 0.9318 | 0.9719 | nan | 0.9839 | 0.9407 | 0.8709 | nan | 0.9721 | 0.8302 | 0.7804 |
| 0.0655 | 5.2444 | 1180 | 0.0855 | 0.8616 | 0.9268 | 0.9730 | nan | 0.9870 | 0.9435 | 0.8500 | nan | 0.9740 | 0.8257 | 0.7852 |
| 0.0897 | 5.3333 | 1200 | 0.0820 | 0.8718 | 0.9249 | 0.9741 | nan | 0.9886 | 0.9286 | 0.8576 | nan | 0.9731 | 0.8442 | 0.7981 |
| 0.1252 | 5.4222 | 1220 | 0.0859 | 0.8590 | 0.9322 | 0.9714 | nan | 0.9830 | 0.9375 | 0.8759 | nan | 0.9716 | 0.8288 | 0.7767 |
| 0.0787 | 5.5111 | 1240 | 0.0942 | 0.8528 | 0.9303 | 0.9687 | nan | 0.9796 | 0.9162 | 0.8952 | nan | 0.9687 | 0.8424 | 0.7472 |
| 0.1752 | 5.6 | 1260 | 0.0880 | 0.8530 | 0.9197 | 0.9710 | nan | 0.9861 | 0.9240 | 0.8490 | nan | 0.9718 | 0.8143 | 0.7728 |
| 0.12 | 5.6889 | 1280 | 0.0856 | 0.8568 | 0.9222 | 0.9705 | nan | 0.9837 | 0.8913 | 0.8914 | nan | 0.9700 | 0.8290 | 0.7715 |
| 0.0789 | 5.7778 | 1300 | 0.0836 | 0.8612 | 0.9284 | 0.9716 | nan | 0.9837 | 0.9101 | 0.8913 | nan | 0.9713 | 0.8310 | 0.7814 |
| 0.1557 | 5.8667 | 1320 | 0.0829 | 0.8664 | 0.9300 | 0.9722 | nan | 0.9841 | 0.9136 | 0.8925 | nan | 0.9708 | 0.8366 | 0.7918 |
| 0.1868 | 5.9556 | 1340 | 0.0839 | 0.8640 | 0.9222 | 0.9722 | nan | 0.9870 | 0.9259 | 0.8537 | nan | 0.9711 | 0.8349 | 0.7859 |
| 0.1028 | 6.0444 | 1360 | 0.0835 | 0.8647 | 0.9297 | 0.9725 | nan | 0.9851 | 0.9320 | 0.8720 | nan | 0.9719 | 0.8302 | 0.7919 |
| 0.1021 | 6.1333 | 1380 | 0.0860 | 0.8572 | 0.9267 | 0.9717 | nan | 0.9847 | 0.9233 | 0.8722 | nan | 0.9724 | 0.8194 | 0.7796 |
| 0.116 | 6.2222 | 1400 | 0.0883 | 0.8487 | 0.9263 | 0.9704 | nan | 0.9838 | 0.9442 | 0.8508 | nan | 0.9720 | 0.8029 | 0.7712 |
| 0.0726 | 6.3111 | 1420 | 0.0856 | 0.8669 | 0.9392 | 0.9718 | nan | 0.9809 | 0.9245 | 0.9122 | nan | 0.9705 | 0.8425 | 0.7878 |
| 0.0746 | 6.4 | 1440 | 0.0902 | 0.8406 | 0.9123 | 0.9699 | nan | 0.9873 | 0.9347 | 0.8149 | nan | 0.9726 | 0.7909 | 0.7584 |
| 0.0596 | 6.4889 | 1460 | 0.0823 | 0.8620 | 0.9262 | 0.9724 | nan | 0.9860 | 0.9285 | 0.8641 | nan | 0.9725 | 0.8303 | 0.7832 |
| 0.127 | 6.5778 | 1480 | 0.0830 | 0.8667 | 0.9384 | 0.9722 | nan | 0.9821 | 0.9397 | 0.8933 | nan | 0.9711 | 0.8394 | 0.7896 |
| 0.0511 | 6.6667 | 1500 | 0.0800 | 0.8746 | 0.9345 | 0.9744 | nan | 0.9862 | 0.9391 | 0.8783 | nan | 0.9733 | 0.8470 | 0.8037 |
| 0.1304 | 6.7556 | 1520 | 0.0829 | 0.8658 | 0.9339 | 0.9723 | nan | 0.9834 | 0.9275 | 0.8907 | nan | 0.9717 | 0.8382 | 0.7875 |
| 0.0768 | 6.8444 | 1540 | 0.0850 | 0.8595 | 0.9074 | 0.9724 | nan | 0.9915 | 0.9135 | 0.8173 | nan | 0.9722 | 0.8349 | 0.7714 |
| 0.2556 | 6.9333 | 1560 | 0.0792 | 0.8681 | 0.9243 | 0.9738 | nan | 0.9883 | 0.9252 | 0.8594 | nan | 0.9737 | 0.8408 | 0.7899 |
| 0.0446 | 7.0222 | 1580 | 0.0819 | 0.8497 | 0.9251 | 0.9712 | nan | 0.9853 | 0.9505 | 0.8394 | nan | 0.9732 | 0.7965 | 0.7795 |
| 0.0593 | 7.1111 | 1600 | 0.0791 | 0.8774 | 0.9290 | 0.9747 | nan | 0.9881 | 0.9297 | 0.8691 | nan | 0.9726 | 0.8486 | 0.8110 |
| 0.0997 | 7.2 | 1620 | 0.0786 | 0.8763 | 0.9426 | 0.9743 | nan | 0.9837 | 0.9473 | 0.8969 | nan | 0.9727 | 0.8386 | 0.8176 |
| 0.2284 | 7.2889 | 1640 | 0.0815 | 0.8654 | 0.9390 | 0.9724 | nan | 0.9819 | 0.9316 | 0.9034 | nan | 0.9719 | 0.8306 | 0.7937 |
| 0.0501 | 7.3778 | 1660 | 0.0833 | 0.8658 | 0.9416 | 0.9726 | nan | 0.9820 | 0.9518 | 0.8912 | nan | 0.9723 | 0.8280 | 0.7972 |
| 0.0553 | 7.4667 | 1680 | 0.0754 | 0.8819 | 0.9420 | 0.9755 | nan | 0.9849 | 0.9251 | 0.9160 | nan | 0.9741 | 0.8524 | 0.8191 |
| 0.1392 | 7.5556 | 1700 | 0.0739 | 0.8882 | 0.9416 | 0.9772 | nan | 0.9879 | 0.9538 | 0.8831 | nan | 0.9756 | 0.8611 | 0.8278 |
| 0.0422 | 7.6444 | 1720 | 0.0753 | 0.8764 | 0.9408 | 0.9749 | nan | 0.9850 | 0.9460 | 0.8915 | nan | 0.9739 | 0.8377 | 0.8176 |
| 0.0591 | 7.7333 | 1740 | 0.0766 | 0.8744 | 0.9346 | 0.9744 | nan | 0.9863 | 0.9436 | 0.8741 | nan | 0.9731 | 0.8402 | 0.8100 |
| 0.0515 | 7.8222 | 1760 | 0.0766 | 0.8725 | 0.9392 | 0.9738 | nan | 0.9836 | 0.9255 | 0.9084 | nan | 0.9730 | 0.8395 | 0.8051 |
| 0.025 | 7.9111 | 1780 | 0.0750 | 0.8770 | 0.9358 | 0.9751 | nan | 0.9861 | 0.9211 | 0.9003 | nan | 0.9742 | 0.8442 | 0.8126 |
| 0.2387 | 8.0 | 1800 | 0.0771 | 0.8714 | 0.9332 | 0.9737 | nan | 0.9850 | 0.9144 | 0.9003 | nan | 0.9731 | 0.8443 | 0.7969 |
| 0.1592 | 8.0889 | 1820 | 0.0772 | 0.8734 | 0.9327 | 0.9744 | nan | 0.9859 | 0.9113 | 0.9008 | nan | 0.9741 | 0.8491 | 0.7969 |
| 0.0835 | 8.1778 | 1840 | 0.0764 | 0.8705 | 0.9377 | 0.9742 | nan | 0.9850 | 0.9435 | 0.8846 | nan | 0.9745 | 0.8396 | 0.7972 |
| 0.0639 | 8.2667 | 1860 | 0.0743 | 0.8828 | 0.9303 | 0.9765 | nan | 0.9898 | 0.9249 | 0.8762 | nan | 0.9758 | 0.8624 | 0.8103 |
| 0.0841 | 8.3556 | 1880 | 0.0735 | 0.8812 | 0.9328 | 0.9762 | nan | 0.9883 | 0.9149 | 0.8952 | nan | 0.9754 | 0.8522 | 0.8159 |
| 0.0946 | 8.4444 | 1900 | 0.0784 | 0.8643 | 0.9344 | 0.9737 | nan | 0.9856 | 0.9495 | 0.8682 | nan | 0.9749 | 0.8236 | 0.7946 |
| 0.3774 | 8.5333 | 1920 | 0.0726 | 0.8799 | 0.9349 | 0.9761 | nan | 0.9875 | 0.9119 | 0.9054 | nan | 0.9757 | 0.8478 | 0.8162 |
| 0.0636 | 8.6222 | 1940 | 0.0745 | 0.8739 | 0.9375 | 0.9747 | nan | 0.9856 | 0.9378 | 0.8892 | nan | 0.9744 | 0.8392 | 0.8081 |
| 0.0278 | 8.7111 | 1960 | 0.0804 | 0.8627 | 0.9189 | 0.9736 | nan | 0.9898 | 0.9295 | 0.8373 | nan | 0.9744 | 0.8272 | 0.7864 |
| 0.147 | 8.8 | 1980 | 0.0780 | 0.8670 | 0.9356 | 0.9735 | nan | 0.9848 | 0.9443 | 0.8778 | nan | 0.9736 | 0.8280 | 0.7996 |
| 0.0254 | 8.8889 | 2000 | 0.0734 | 0.8792 | 0.9338 | 0.9756 | nan | 0.9876 | 0.9245 | 0.8894 | nan | 0.9747 | 0.8488 | 0.8140 |
| 0.0302 | 8.9778 | 2020 | 0.0750 | 0.8792 | 0.9436 | 0.9753 | nan | 0.9849 | 0.9549 | 0.8910 | nan | 0.9740 | 0.8433 | 0.8204 |
| 0.0245 | 9.0667 | 2040 | 0.0744 | 0.8834 | 0.9357 | 0.9764 | nan | 0.9886 | 0.9488 | 0.8698 | nan | 0.9750 | 0.8559 | 0.8193 |
| 0.1541 | 9.1556 | 2060 | 0.0733 | 0.8835 | 0.9418 | 0.9759 | nan | 0.9858 | 0.9406 | 0.8988 | nan | 0.9743 | 0.8581 | 0.8181 |
| 0.0589 | 9.2444 | 2080 | 0.0740 | 0.8764 | 0.9425 | 0.9745 | nan | 0.9835 | 0.9304 | 0.9137 | nan | 0.9733 | 0.8434 | 0.8123 |
| 0.0289 | 9.3333 | 2100 | 0.0750 | 0.8771 | 0.9321 | 0.9754 | nan | 0.9884 | 0.9408 | 0.8671 | nan | 0.9747 | 0.8456 | 0.8111 |
| 0.1783 | 9.4222 | 2120 | 0.0756 | 0.8711 | 0.9326 | 0.9746 | nan | 0.9872 | 0.9455 | 0.8652 | nan | 0.9746 | 0.8368 | 0.8018 |
| 0.0317 | 9.5111 | 2140 | 0.0733 | 0.8812 | 0.9345 | 0.9761 | nan | 0.9884 | 0.9375 | 0.8775 | nan | 0.9753 | 0.8561 | 0.8122 |
| 0.0838 | 9.6 | 2160 | 0.0720 | 0.8839 | 0.9408 | 0.9764 | nan | 0.9867 | 0.9380 | 0.8978 | nan | 0.9754 | 0.8576 | 0.8187 |
| 0.0384 | 9.6889 | 2180 | 0.0710 | 0.8858 | 0.9383 | 0.9770 | nan | 0.9879 | 0.9249 | 0.9021 | nan | 0.9763 | 0.8626 | 0.8186 |
| 0.0713 | 9.7778 | 2200 | 0.0705 | 0.8875 | 0.9338 | 0.9776 | nan | 0.9901 | 0.9261 | 0.8853 | nan | 0.9768 | 0.8640 | 0.8216 |
| 0.033 | 9.8667 | 2220 | 0.0695 | 0.8869 | 0.9405 | 0.9772 | nan | 0.9875 | 0.9279 | 0.9061 | nan | 0.9762 | 0.8586 | 0.8260 |
| 0.0204 | 9.9556 | 2240 | 0.0705 | 0.8894 | 0.9422 | 0.9775 | nan | 0.9878 | 0.9414 | 0.8972 | nan | 0.9762 | 0.8632 | 0.8288 |
| 0.3245 | 10.0444 | 2260 | 0.0690 | 0.8900 | 0.9355 | 0.9780 | nan | 0.9901 | 0.9254 | 0.8910 | nan | 0.9770 | 0.8653 | 0.8275 |
| 0.0184 | 10.1333 | 2280 | 0.0679 | 0.8922 | 0.9441 | 0.9781 | nan | 0.9878 | 0.9395 | 0.9049 | nan | 0.9767 | 0.8646 | 0.8353 |
| 0.0205 | 10.2222 | 2300 | 0.0710 | 0.8867 | 0.9450 | 0.9768 | nan | 0.9861 | 0.9444 | 0.9044 | nan | 0.9753 | 0.8526 | 0.8322 |
| 0.0526 | 10.3111 | 2320 | 0.0726 | 0.8875 | 0.9395 | 0.9770 | nan | 0.9881 | 0.9461 | 0.8841 | nan | 0.9753 | 0.8605 | 0.8266 |
| 0.0489 | 10.4 | 2340 | 0.0709 | 0.8892 | 0.9355 | 0.9774 | nan | 0.9896 | 0.9321 | 0.8847 | nan | 0.9758 | 0.8616 | 0.8303 |
| 0.0243 | 10.4889 | 2360 | 0.0693 | 0.8908 | 0.9393 | 0.9777 | nan | 0.9887 | 0.9326 | 0.8965 | nan | 0.9761 | 0.8640 | 0.8324 |
| 0.0283 | 10.5778 | 2380 | 0.0704 | 0.8927 | 0.9382 | 0.9781 | nan | 0.9898 | 0.9399 | 0.8849 | nan | 0.9764 | 0.8723 | 0.8294 |
| 0.0422 | 10.6667 | 2400 | 0.0698 | 0.8904 | 0.9416 | 0.9775 | nan | 0.9878 | 0.9351 | 0.9020 | nan | 0.9759 | 0.8636 | 0.8316 |
| 0.0571 | 10.7556 | 2420 | 0.0706 | 0.8883 | 0.9488 | 0.9768 | nan | 0.9848 | 0.9423 | 0.9194 | nan | 0.9753 | 0.8606 | 0.8290 |
| 0.0175 | 10.8444 | 2440 | 0.0687 | 0.8933 | 0.9401 | 0.9782 | nan | 0.9892 | 0.9322 | 0.8989 | nan | 0.9766 | 0.8678 | 0.8355 |
| 0.0684 | 10.9333 | 2460 | 0.0681 | 0.8930 | 0.9464 | 0.9780 | nan | 0.9873 | 0.9478 | 0.9040 | nan | 0.9764 | 0.8660 | 0.8365 |
| 0.0248 | 11.0222 | 2480 | 0.0693 | 0.8920 | 0.9473 | 0.9778 | nan | 0.9868 | 0.9527 | 0.9024 | nan | 0.9761 | 0.8638 | 0.8362 |
| 0.0499 | 11.1111 | 2500 | 0.0725 | 0.8840 | 0.9326 | 0.9769 | nan | 0.9902 | 0.9451 | 0.8625 | nan | 0.9760 | 0.8568 | 0.8193 |
| 0.072 | 11.2 | 2520 | 0.0706 | 0.8901 | 0.9404 | 0.9775 | nan | 0.9884 | 0.9432 | 0.8895 | nan | 0.9758 | 0.8625 | 0.8318 |
| 0.0304 | 11.2889 | 2540 | 0.0696 | 0.8899 | 0.9450 | 0.9773 | nan | 0.9866 | 0.9415 | 0.9069 | nan | 0.9755 | 0.8602 | 0.8340 |
| 0.0397 | 11.3778 | 2560 | 0.0695 | 0.8902 | 0.9425 | 0.9774 | nan | 0.9876 | 0.9400 | 0.8999 | nan | 0.9757 | 0.8606 | 0.8343 |
| 0.1503 | 11.4667 | 2580 | 0.0709 | 0.8892 | 0.9462 | 0.9771 | nan | 0.9863 | 0.9492 | 0.9031 | nan | 0.9753 | 0.8584 | 0.8339 |
| 0.0692 | 11.5556 | 2600 | 0.0708 | 0.8899 | 0.9454 | 0.9772 | nan | 0.9866 | 0.9456 | 0.9040 | nan | 0.9755 | 0.8624 | 0.8319 |
| 0.0771 | 11.6444 | 2620 | 0.0710 | 0.8864 | 0.9399 | 0.9771 | nan | 0.9881 | 0.9458 | 0.8857 | nan | 0.9759 | 0.8555 | 0.8277 |
| 0.0751 | 11.7333 | 2640 | 0.0692 | 0.8897 | 0.9395 | 0.9776 | nan | 0.9884 | 0.9280 | 0.9020 | nan | 0.9762 | 0.8608 | 0.8320 |
| 0.0356 | 11.8222 | 2660 | 0.0716 | 0.8855 | 0.9430 | 0.9767 | nan | 0.9867 | 0.9485 | 0.8939 | nan | 0.9755 | 0.8545 | 0.8266 |
| 0.0707 | 11.9111 | 2680 | 0.0705 | 0.8908 | 0.9405 | 0.9777 | nan | 0.9886 | 0.9422 | 0.8909 | nan | 0.9761 | 0.8669 | 0.8293 |
| 0.015 | 12.0 | 2700 | 0.0687 | 0.8915 | 0.9390 | 0.9780 | nan | 0.9891 | 0.9297 | 0.8981 | nan | 0.9766 | 0.8657 | 0.8321 |
| 0.0334 | 12.0889 | 2720 | 0.0691 | 0.8862 | 0.9417 | 0.9769 | nan | 0.9868 | 0.9258 | 0.9124 | nan | 0.9759 | 0.8552 | 0.8274 |
| 0.0161 | 12.1778 | 2740 | 0.0690 | 0.8897 | 0.9456 | 0.9774 | nan | 0.9866 | 0.9415 | 0.9089 | nan | 0.9759 | 0.8593 | 0.8340 |
| 0.0728 | 12.2667 | 2760 | 0.0686 | 0.8917 | 0.9406 | 0.9780 | nan | 0.9888 | 0.9357 | 0.8974 | nan | 0.9765 | 0.8646 | 0.8339 |
| 0.0517 | 12.3556 | 2780 | 0.0696 | 0.8918 | 0.9398 | 0.9780 | nan | 0.9892 | 0.9419 | 0.8884 | nan | 0.9764 | 0.8661 | 0.8328 |
| 0.0445 | 12.4444 | 2800 | 0.0689 | 0.8916 | 0.9444 | 0.9778 | nan | 0.9874 | 0.9403 | 0.9055 | nan | 0.9762 | 0.8641 | 0.8344 |
| 0.0376 | 12.5333 | 2820 | 0.0696 | 0.8907 | 0.9454 | 0.9775 | nan | 0.9869 | 0.9438 | 0.9055 | nan | 0.9759 | 0.8621 | 0.8341 |
| 0.0233 | 12.6222 | 2840 | 0.0688 | 0.8911 | 0.9436 | 0.9777 | nan | 0.9875 | 0.9380 | 0.9054 | nan | 0.9762 | 0.8632 | 0.8338 |
| 0.2039 | 12.7111 | 2860 | 0.0684 | 0.8919 | 0.9383 | 0.9781 | nan | 0.9895 | 0.9317 | 0.8937 | nan | 0.9766 | 0.8659 | 0.8332 |
| 0.1103 | 12.8 | 2880 | 0.0679 | 0.8921 | 0.9386 | 0.9781 | nan | 0.9894 | 0.9283 | 0.8980 | nan | 0.9767 | 0.8659 | 0.8336 |
| 0.0528 | 12.8889 | 2900 | 0.0686 | 0.8918 | 0.9409 | 0.9780 | nan | 0.9887 | 0.9380 | 0.8959 | nan | 0.9765 | 0.8652 | 0.8337 |
| 0.0323 | 12.9778 | 2920 | 0.0683 | 0.8920 | 0.9387 | 0.9781 | nan | 0.9894 | 0.9326 | 0.8941 | nan | 0.9766 | 0.8664 | 0.8330 |
### Framework versions
- Transformers 4.47.1
- Pytorch 2.5.1+cu124
- Datasets 3.2.0
- Tokenizers 0.21.0
|