--- library_name: transformers license: apache-2.0 base_model: PekingU/rtdetr_r50vd tags: - object-detection - vision - generated_from_trainer model-index: - name: suas-2025-rtdetr-finetuned-e50-b16-lr1e-5 results: [] --- # suas-2025-rtdetr-finetuned-e50-b16-lr1e-5 This model is a fine-tuned version of [PekingU/rtdetr_r50vd](https://huggingface.co/PekingU/rtdetr_r50vd) on the mfly-auton/suas-2025-synthetic-data dataset. It achieves the following results on the evaluation set: - Loss: 5.1922 - Map: 0.848 - Map 50: 0.9654 - Map 75: 0.9497 - Map Small: 0.7323 - Map Medium: 0.8702 - Map Large: 0.9603 - Mar 1: 0.7848 - Mar 10: 0.8983 - Mar 100: 0.9079 - Mar Small: 0.8094 - Mar Medium: 0.9289 - Mar Large: 0.9849 - Map Baseball-bat: 0.7866 - Mar 100 Baseball-bat: 0.906 - Map Basketball: 0.8183 - Mar 100 Basketball: 0.8576 - Map Car: -1.0 - Mar 100 Car: -1.0 - Map Football: 0.623 - Mar 100 Football: 0.7297 - Map Human: 0.9109 - Mar 100 Human: 0.9522 - Map Luggage: 0.826 - Mar 100 Luggage: 0.9096 - Map Mattress: 0.9878 - Mar 100 Mattress: 0.9977 - Map Motorcycle: 0.9319 - Mar 100 Motorcycle: 0.9564 - Map Skis: 0.9199 - Mar 100 Skis: 0.9703 - Map Snowboard: 0.9883 - Mar 100 Snowboard: 0.9951 - Map Soccer-ball: 0.7476 - Mar 100 Soccer-ball: 0.8144 - Map Stop-sign: 0.9339 - Mar 100 Stop-sign: 0.9612 - Map Tennis-racket: 0.7812 - Mar 100 Tennis-racket: 0.8845 - Map Umbrella: 0.9107 - Mar 100 Umbrella: 0.9553 - Map Volleyball: 0.7061 - Mar 100 Volleyball: 0.8208 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 1e-05 - train_batch_size: 16 - eval_batch_size: 32 - seed: 1337 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments - lr_scheduler_type: linear - num_epochs: 50.0 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Baseball-bat | Mar 100 Baseball-bat | Map Basketball | Mar 100 Basketball | Map Car | Mar 100 Car | Map Football | Mar 100 Football | Map Human | Mar 100 Human | Map Luggage | Mar 100 Luggage | Map Mattress | Mar 100 Mattress | Map Motorcycle | Mar 100 Motorcycle | Map Skis | Mar 100 Skis | Map Snowboard | Mar 100 Snowboard | Map Soccer-ball | Mar 100 Soccer-ball | Map Stop-sign | Mar 100 Stop-sign | Map Tennis-racket | Mar 100 Tennis-racket | Map Umbrella | Mar 100 Umbrella | Map Volleyball | Mar 100 Volleyball | |:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:----------------:|:--------------------:|:--------------:|:------------------:|:-------:|:-----------:|:------------:|:----------------:|:---------:|:-------------:|:-----------:|:---------------:|:------------:|:----------------:|:--------------:|:------------------:|:--------:|:------------:|:-------------:|:-----------------:|:---------------:|:-------------------:|:-------------:|:-----------------:|:-----------------:|:---------------------:|:------------:|:----------------:|:--------------:|:------------------:| | 35.8209 | 1.0 | 438 | 15.8634 | 0.0876 | 0.1207 | 0.0954 | 0.0341 | 0.0699 | 0.1699 | 0.1692 | 0.3326 | 0.351 | 0.1466 | 0.3498 | 0.5102 | 0.008 | 0.2188 | 0.0904 | 0.4045 | -1.0 | -1.0 | 0.0035 | 0.173 | 0.2131 | 0.5707 | 0.0186 | 0.3735 | 0.5333 | 0.8459 | 0.1433 | 0.563 | 0.0 | 0.0 | 0.1018 | 0.6519 | 0.0005 | 0.0609 | 0.0231 | 0.4522 | 0.0001 | 0.0642 | 0.0902 | 0.5279 | 0.0 | 0.0076 | | 18.2866 | 2.0 | 876 | 9.8698 | 0.5172 | 0.6033 | 0.5814 | 0.4216 | 0.4913 | 0.736 | 0.5753 | 0.7757 | 0.788 | 0.579 | 0.8343 | 0.9339 | 0.1171 | 0.7353 | 0.6 | 0.7434 | -1.0 | -1.0 | 0.3336 | 0.5407 | 0.7746 | 0.8705 | 0.7531 | 0.8718 | 0.9033 | 0.9978 | 0.7636 | 0.8722 | 0.0416 | 0.9446 | 0.9059 | 0.9818 | 0.2723 | 0.491 | 0.6344 | 0.8425 | 0.0891 | 0.6202 | 0.8002 | 0.9216 | 0.2522 | 0.5985 | | 11.1872 | 3.0 | 1314 | 9.9933 | 0.7022 | 0.7977 | 0.7831 | 0.5061 | 0.7248 | 0.7949 | 0.6809 | 0.8179 | 0.8252 | 0.622 | 0.8734 | 0.9592 | 0.5039 | 0.8168 | 0.6697 | 0.7486 | -1.0 | -1.0 | 0.4155 | 0.5517 | 0.7932 | 0.8865 | 0.8129 | 0.9082 | 0.9436 | 0.9951 | 0.8345 | 0.919 | 0.8335 | 0.9658 | 0.9638 | 0.9864 | 0.4472 | 0.5874 | 0.795 | 0.931 | 0.4851 | 0.6689 | 0.8576 | 0.9445 | 0.4748 | 0.6424 | | 9.4801 | 4.0 | 1752 | 9.8496 | 0.7498 | 0.8473 | 0.8302 | 0.5563 | 0.7902 | 0.9327 | 0.712 | 0.8431 | 0.8502 | 0.6738 | 0.8928 | 0.9778 | 0.6015 | 0.8549 | 0.7093 | 0.7945 | -1.0 | -1.0 | 0.4907 | 0.6149 | 0.8317 | 0.9066 | 0.8325 | 0.9251 | 0.9407 | 0.9977 | 0.8679 | 0.928 | 0.9228 | 0.9802 | 0.9647 | 0.9887 | 0.5159 | 0.6224 | 0.88 | 0.9525 | 0.5506 | 0.713 | 0.8407 | 0.9433 | 0.5486 | 0.6809 | | 8.6047 | 5.0 | 2190 | 9.9758 | 0.7961 | 0.8913 | 0.8761 | 0.6228 | 0.822 | 0.9407 | 0.7493 | 0.8766 | 0.8843 | 0.7328 | 0.9233 | 0.9855 | 0.6418 | 0.8738 | 0.7478 | 0.8289 | -1.0 | -1.0 | 0.5773 | 0.6964 | 0.8557 | 0.9283 | 0.8459 | 0.9353 | 0.9628 | 0.9994 | 0.9032 | 0.9506 | 0.9241 | 0.9866 | 0.9692 | 0.9869 | 0.6213 | 0.7185 | 0.9227 | 0.9701 | 0.6941 | 0.8145 | 0.8709 | 0.9505 | 0.6086 | 0.74 | | 8.0733 | 6.0 | 2628 | 8.9735 | 0.8271 | 0.9212 | 0.9062 | 0.6807 | 0.8423 | 0.955 | 0.7723 | 0.8966 | 0.903 | 0.7891 | 0.9315 | 0.9876 | 0.7286 | 0.9073 | 0.7845 | 0.8616 | -1.0 | -1.0 | 0.6145 | 0.7379 | 0.8907 | 0.9397 | 0.8647 | 0.9403 | 0.9649 | 0.9984 | 0.911 | 0.9537 | 0.9595 | 0.9866 | 0.9689 | 0.9877 | 0.6932 | 0.7815 | 0.9222 | 0.9779 | 0.7176 | 0.8187 | 0.8996 | 0.9654 | 0.6592 | 0.7858 | | 7.5839 | 7.0 | 3066 | 7.9987 | 0.8223 | 0.9186 | 0.9028 | 0.6633 | 0.8496 | 0.9498 | 0.7742 | 0.8987 | 0.9059 | 0.7739 | 0.9366 | 0.9893 | 0.7143 | 0.9003 | 0.7687 | 0.8564 | -1.0 | -1.0 | 0.6117 | 0.7344 | 0.8951 | 0.9527 | 0.8634 | 0.9432 | 0.9694 | 0.9992 | 0.9208 | 0.9569 | 0.9101 | 0.9782 | 0.9739 | 0.9943 | 0.661 | 0.7853 | 0.9409 | 0.9818 | 0.7701 | 0.8637 | 0.8874 | 0.9668 | 0.625 | 0.7696 | | 7.1392 | 8.0 | 3504 | 7.1608 | 0.8355 | 0.9256 | 0.9125 | 0.6879 | 0.8766 | 0.9497 | 0.7827 | 0.9047 | 0.9115 | 0.8008 | 0.9413 | 0.9748 | 0.7849 | 0.9196 | 0.7918 | 0.8806 | -1.0 | -1.0 | 0.6121 | 0.745 | 0.8968 | 0.9497 | 0.8698 | 0.9442 | 0.9603 | 0.9963 | 0.9181 | 0.9547 | 0.9387 | 0.9861 | 0.9729 | 0.9893 | 0.664 | 0.7835 | 0.9507 | 0.9751 | 0.8094 | 0.8886 | 0.8947 | 0.9652 | 0.6334 | 0.7833 | | 6.7601 | 9.0 | 3942 | 6.2561 | 0.8299 | 0.9249 | 0.9129 | 0.6819 | 0.8402 | 0.8921 | 0.774 | 0.8971 | 0.9048 | 0.7899 | 0.9314 | 0.9713 | 0.7324 | 0.917 | 0.7621 | 0.8533 | -1.0 | -1.0 | 0.6202 | 0.7347 | 0.8961 | 0.9481 | 0.8555 | 0.934 | 0.9717 | 0.9966 | 0.9125 | 0.9493 | 0.9039 | 0.9584 | 0.9783 | 0.9921 | 0.6866 | 0.7956 | 0.9331 | 0.9723 | 0.7984 | 0.8725 | 0.9043 | 0.9621 | 0.6631 | 0.7811 | | 6.4006 | 10.0 | 4380 | 5.8412 | 0.8448 | 0.9414 | 0.9317 | 0.6998 | 0.8692 | 0.9526 | 0.7849 | 0.9029 | 0.9103 | 0.8009 | 0.9361 | 0.9735 | 0.7928 | 0.9195 | 0.7756 | 0.8569 | -1.0 | -1.0 | 0.6622 | 0.7649 | 0.8988 | 0.9478 | 0.8512 | 0.9228 | 0.9712 | 0.9956 | 0.9167 | 0.9501 | 0.9128 | 0.9713 | 0.9824 | 0.9922 | 0.6962 | 0.7799 | 0.9632 | 0.9885 | 0.806 | 0.8865 | 0.9035 | 0.9634 | 0.6953 | 0.8049 | | 6.1178 | 11.0 | 4818 | 5.5940 | 0.845 | 0.9454 | 0.9347 | 0.71 | 0.8808 | 0.9531 | 0.7831 | 0.9049 | 0.9122 | 0.7997 | 0.9421 | 0.9756 | 0.7937 | 0.9242 | 0.7786 | 0.8569 | -1.0 | -1.0 | 0.6473 | 0.7514 | 0.9098 | 0.9538 | 0.8691 | 0.931 | 0.9736 | 0.9981 | 0.9145 | 0.9512 | 0.9076 | 0.9797 | 0.9805 | 0.9925 | 0.7181 | 0.8018 | 0.9571 | 0.9802 | 0.7853 | 0.8865 | 0.9027 | 0.9635 | 0.692 | 0.8 | | 5.9386 | 12.0 | 5256 | 5.3809 | 0.8534 | 0.9525 | 0.9444 | 0.7349 | 0.8539 | 0.9484 | 0.7875 | 0.9079 | 0.9155 | 0.8192 | 0.9334 | 0.9716 | 0.8116 | 0.9208 | 0.8033 | 0.8765 | -1.0 | -1.0 | 0.6798 | 0.7668 | 0.9081 | 0.9556 | 0.8555 | 0.9195 | 0.9766 | 0.9977 | 0.9123 | 0.9477 | 0.8838 | 0.9708 | 0.9792 | 0.9911 | 0.7488 | 0.8257 | 0.9397 | 0.9718 | 0.8181 | 0.885 | 0.9005 | 0.9612 | 0.7304 | 0.8267 | | 5.8369 | 13.0 | 5694 | 5.3334 | 0.853 | 0.9537 | 0.9441 | 0.7272 | 0.875 | 0.9533 | 0.7879 | 0.906 | 0.9115 | 0.806 | 0.9409 | 0.9737 | 0.8282 | 0.9229 | 0.7937 | 0.86 | -1.0 | -1.0 | 0.6648 | 0.75 | 0.9043 | 0.9555 | 0.8547 | 0.9184 | 0.9863 | 0.9983 | 0.92 | 0.9466 | 0.8883 | 0.9782 | 0.9794 | 0.9917 | 0.7238 | 0.7933 | 0.9617 | 0.9737 | 0.8238 | 0.8984 | 0.8977 | 0.9577 | 0.7156 | 0.8159 | | 5.7218 | 14.0 | 6132 | 5.4029 | 0.8396 | 0.9499 | 0.9341 | 0.6993 | 0.8734 | 0.9435 | 0.779 | 0.8927 | 0.9009 | 0.7897 | 0.9332 | 0.965 | 0.8068 | 0.9229 | 0.7721 | 0.8365 | -1.0 | -1.0 | 0.6141 | 0.722 | 0.8993 | 0.9558 | 0.8525 | 0.9165 | 0.9811 | 0.9978 | 0.9196 | 0.9482 | 0.9045 | 0.9431 | 0.9772 | 0.99 | 0.6888 | 0.7807 | 0.9418 | 0.967 | 0.8264 | 0.887 | 0.8873 | 0.9569 | 0.6837 | 0.788 | | 5.5868 | 15.0 | 6570 | 5.1404 | 0.8504 | 0.961 | 0.9514 | 0.7327 | 0.8765 | 0.9479 | 0.7852 | 0.8991 | 0.9073 | 0.8121 | 0.9349 | 0.9665 | 0.8254 | 0.9228 | 0.8061 | 0.8569 | -1.0 | -1.0 | 0.6472 | 0.7285 | 0.9169 | 0.9593 | 0.852 | 0.9188 | 0.978 | 0.9986 | 0.9107 | 0.946 | 0.9011 | 0.9515 | 0.978 | 0.9898 | 0.726 | 0.8134 | 0.9524 | 0.9723 | 0.7993 | 0.8829 | 0.8936 | 0.9491 | 0.7187 | 0.8125 | | 5.5623 | 16.0 | 7008 | 5.4438 | 0.855 | 0.96 | 0.952 | 0.7403 | 0.8612 | 0.9556 | 0.7904 | 0.9026 | 0.9087 | 0.8117 | 0.9247 | 0.9737 | 0.8242 | 0.918 | 0.8126 | 0.8562 | -1.0 | -1.0 | 0.6598 | 0.7473 | 0.8932 | 0.95 | 0.8311 | 0.8984 | 0.9843 | 0.9969 | 0.9204 | 0.9477 | 0.9329 | 0.9822 | 0.9848 | 0.9953 | 0.7209 | 0.7913 | 0.95 | 0.9704 | 0.8114 | 0.8834 | 0.9004 | 0.9622 | 0.744 | 0.8225 | | 5.4745 | 17.0 | 7446 | 5.1975 | 0.857 | 0.9606 | 0.9498 | 0.739 | 0.8749 | 0.8957 | 0.7922 | 0.9028 | 0.9088 | 0.8031 | 0.9328 | 0.9737 | 0.8173 | 0.905 | 0.8466 | 0.8839 | -1.0 | -1.0 | 0.6402 | 0.7255 | 0.9153 | 0.9556 | 0.8524 | 0.9213 | 0.9809 | 0.9976 | 0.9189 | 0.9504 | 0.9323 | 0.9723 | 0.9833 | 0.9937 | 0.735 | 0.8 | 0.9525 | 0.9782 | 0.7967 | 0.8746 | 0.9147 | 0.9653 | 0.7123 | 0.8002 | | 5.3515 | 18.0 | 7884 | 5.2381 | 0.8521 | 0.9594 | 0.9488 | 0.7312 | 0.88 | 0.9528 | 0.7895 | 0.901 | 0.9099 | 0.8097 | 0.9362 | 0.9698 | 0.7994 | 0.914 | 0.8113 | 0.8607 | -1.0 | -1.0 | 0.6394 | 0.7319 | 0.8967 | 0.9562 | 0.8352 | 0.9114 | 0.9828 | 0.9989 | 0.9102 | 0.9441 | 0.9371 | 0.9728 | 0.9781 | 0.9912 | 0.7338 | 0.8242 | 0.9528 | 0.9693 | 0.8038 | 0.8782 | 0.9258 | 0.9679 | 0.7228 | 0.8176 | | 5.3462 | 19.0 | 8322 | 5.3286 | 0.851 | 0.9598 | 0.9462 | 0.7365 | 0.8681 | 0.9496 | 0.7866 | 0.9 | 0.9078 | 0.8059 | 0.9304 | 0.9705 | 0.799 | 0.907 | 0.8204 | 0.8604 | -1.0 | -1.0 | 0.6415 | 0.7333 | 0.9 | 0.9558 | 0.8441 | 0.9066 | 0.9684 | 0.9965 | 0.91 | 0.9469 | 0.9073 | 0.9663 | 0.9839 | 0.9947 | 0.7415 | 0.8149 | 0.9418 | 0.9673 | 0.8066 | 0.8793 | 0.9161 | 0.9706 | 0.7334 | 0.8091 | | 5.2452 | 20.0 | 8760 | 5.0850 | 0.857 | 0.9632 | 0.9546 | 0.7492 | 0.8794 | 0.9493 | 0.7924 | 0.9039 | 0.9097 | 0.8145 | 0.933 | 0.9806 | 0.8174 | 0.909 | 0.8249 | 0.8685 | -1.0 | -1.0 | 0.6645 | 0.7505 | 0.9029 | 0.956 | 0.8472 | 0.9138 | 0.9749 | 0.9933 | 0.9102 | 0.9395 | 0.8949 | 0.9465 | 0.9772 | 0.9903 | 0.7612 | 0.8234 | 0.947 | 0.9763 | 0.8026 | 0.8741 | 0.9255 | 0.9682 | 0.7482 | 0.8265 | | 5.1599 | 21.0 | 9198 | 5.0505 | 0.8568 | 0.9668 | 0.9558 | 0.7365 | 0.8822 | 0.9564 | 0.7918 | 0.9023 | 0.9105 | 0.8092 | 0.9342 | 0.9733 | 0.8247 | 0.9204 | 0.8211 | 0.8649 | -1.0 | -1.0 | 0.6429 | 0.7373 | 0.914 | 0.9571 | 0.8436 | 0.9058 | 0.986 | 0.9988 | 0.9268 | 0.9521 | 0.9171 | 0.9698 | 0.9846 | 0.995 | 0.7372 | 0.8054 | 0.9478 | 0.9751 | 0.7906 | 0.8751 | 0.9252 | 0.9684 | 0.733 | 0.8218 | | 5.0265 | 22.0 | 9636 | 4.8772 | 0.8581 | 0.9631 | 0.9547 | 0.7454 | 0.87 | 0.9563 | 0.7918 | 0.9073 | 0.9153 | 0.8257 | 0.9336 | 0.973 | 0.8196 | 0.9196 | 0.8048 | 0.8519 | -1.0 | -1.0 | 0.66 | 0.7741 | 0.9118 | 0.9569 | 0.8538 | 0.9196 | 0.9842 | 0.9983 | 0.9285 | 0.9524 | 0.9115 | 0.9708 | 0.9812 | 0.9916 | 0.7524 | 0.8267 | 0.9298 | 0.9626 | 0.8163 | 0.8845 | 0.9245 | 0.9708 | 0.7354 | 0.8348 | | 5.0769 | 23.0 | 10074 | 5.1876 | 0.8503 | 0.9642 | 0.9532 | 0.7342 | 0.8729 | 0.9541 | 0.7829 | 0.8973 | 0.9037 | 0.8034 | 0.9289 | 0.9696 | 0.8139 | 0.9096 | 0.8207 | 0.8628 | -1.0 | -1.0 | 0.6232 | 0.7274 | 0.9103 | 0.9549 | 0.8375 | 0.9062 | 0.9795 | 0.9978 | 0.925 | 0.9507 | 0.9009 | 0.951 | 0.9882 | 0.9959 | 0.7227 | 0.7841 | 0.9521 | 0.976 | 0.7892 | 0.8596 | 0.9103 | 0.9615 | 0.7304 | 0.8145 | | 5.067 | 24.0 | 10512 | 5.0899 | 0.8576 | 0.9671 | 0.952 | 0.7386 | 0.8771 | 0.9618 | 0.793 | 0.9039 | 0.9131 | 0.8186 | 0.9318 | 0.9759 | 0.818 | 0.9098 | 0.8425 | 0.882 | -1.0 | -1.0 | 0.6195 | 0.7314 | 0.9078 | 0.9571 | 0.8446 | 0.9191 | 0.987 | 0.9974 | 0.9256 | 0.9491 | 0.9503 | 0.9812 | 0.9759 | 0.9895 | 0.7502 | 0.8265 | 0.9583 | 0.9835 | 0.8203 | 0.8829 | 0.9017 | 0.9588 | 0.705 | 0.8152 | | 5.0013 | 25.0 | 10950 | 4.9919 | 0.859 | 0.9682 | 0.9561 | 0.7454 | 0.8821 | 0.9619 | 0.7938 | 0.9056 | 0.9151 | 0.823 | 0.9392 | 0.9863 | 0.8247 | 0.9175 | 0.8513 | 0.8848 | -1.0 | -1.0 | 0.646 | 0.7475 | 0.9076 | 0.9545 | 0.855 | 0.9236 | 0.9822 | 0.9971 | 0.9112 | 0.946 | 0.9303 | 0.9683 | 0.9836 | 0.9912 | 0.7401 | 0.8147 | 0.9592 | 0.9832 | 0.8187 | 0.9 | 0.9109 | 0.9599 | 0.7058 | 0.8233 | | 4.9435 | 26.0 | 11388 | 5.1065 | 0.8611 | 0.9673 | 0.9552 | 0.7485 | 0.8803 | 0.9616 | 0.7957 | 0.9072 | 0.9151 | 0.8231 | 0.9334 | 0.9765 | 0.821 | 0.9233 | 0.8611 | 0.8912 | -1.0 | -1.0 | 0.624 | 0.7335 | 0.9133 | 0.9618 | 0.8513 | 0.9212 | 0.982 | 0.9972 | 0.9217 | 0.9488 | 0.9462 | 0.9792 | 0.983 | 0.9906 | 0.7556 | 0.8165 | 0.9506 | 0.9821 | 0.8198 | 0.886 | 0.9061 | 0.9588 | 0.7195 | 0.8216 | | 4.9063 | 27.0 | 11826 | 5.0362 | 0.8585 | 0.9699 | 0.9562 | 0.739 | 0.8799 | 0.9644 | 0.7938 | 0.9055 | 0.9147 | 0.8204 | 0.9375 | 0.9875 | 0.8074 | 0.9175 | 0.8362 | 0.8709 | -1.0 | -1.0 | 0.6333 | 0.7354 | 0.9101 | 0.9594 | 0.8425 | 0.9206 | 0.9866 | 0.9971 | 0.9228 | 0.9513 | 0.9549 | 0.9807 | 0.9849 | 0.994 | 0.7379 | 0.8231 | 0.9532 | 0.9765 | 0.824 | 0.8891 | 0.9139 | 0.9626 | 0.7116 | 0.8279 | | 4.8789 | 28.0 | 12264 | 5.0817 | 0.8545 | 0.9657 | 0.9503 | 0.734 | 0.8798 | 0.9582 | 0.7904 | 0.9021 | 0.9109 | 0.8139 | 0.9313 | 0.9728 | 0.7879 | 0.9033 | 0.8316 | 0.8709 | -1.0 | -1.0 | 0.6431 | 0.7484 | 0.917 | 0.9573 | 0.8387 | 0.9189 | 0.9877 | 0.9989 | 0.9271 | 0.9529 | 0.9354 | 0.9713 | 0.9763 | 0.9891 | 0.7376 | 0.8085 | 0.9447 | 0.9668 | 0.804 | 0.8741 | 0.9158 | 0.9634 | 0.7161 | 0.8289 | | 4.9181 | 29.0 | 12702 | 5.0919 | 0.8488 | 0.9673 | 0.948 | 0.7178 | 0.873 | 0.9605 | 0.7847 | 0.8949 | 0.9034 | 0.7972 | 0.9323 | 0.9847 | 0.7899 | 0.8981 | 0.8159 | 0.8578 | -1.0 | -1.0 | 0.6114 | 0.7131 | 0.9059 | 0.9516 | 0.8471 | 0.9168 | 0.9877 | 0.9977 | 0.9204 | 0.948 | 0.9492 | 0.9723 | 0.9855 | 0.9953 | 0.7195 | 0.7884 | 0.95 | 0.976 | 0.7906 | 0.8679 | 0.9115 | 0.9573 | 0.6994 | 0.8069 | | 4.8989 | 30.0 | 13140 | 5.1016 | 0.8507 | 0.9666 | 0.9511 | 0.7255 | 0.8813 | 0.9506 | 0.7864 | 0.8986 | 0.908 | 0.8065 | 0.9344 | 0.9873 | 0.7901 | 0.9063 | 0.8097 | 0.8536 | -1.0 | -1.0 | 0.6229 | 0.7297 | 0.9173 | 0.9586 | 0.8372 | 0.9172 | 0.9879 | 0.9983 | 0.9366 | 0.9561 | 0.9276 | 0.9723 | 0.984 | 0.9937 | 0.7253 | 0.7979 | 0.9454 | 0.9701 | 0.8037 | 0.8772 | 0.9131 | 0.9588 | 0.7095 | 0.8218 | | 4.8752 | 31.0 | 13578 | 5.1597 | 0.8528 | 0.9665 | 0.951 | 0.7308 | 0.8796 | 0.9064 | 0.7889 | 0.9006 | 0.9094 | 0.8122 | 0.9348 | 0.9864 | 0.8109 | 0.9149 | 0.8143 | 0.8571 | -1.0 | -1.0 | 0.6165 | 0.7272 | 0.912 | 0.9566 | 0.8388 | 0.9117 | 0.988 | 0.9975 | 0.9322 | 0.9537 | 0.9131 | 0.9693 | 0.9795 | 0.9885 | 0.7523 | 0.8249 | 0.9591 | 0.9791 | 0.8016 | 0.8736 | 0.9114 | 0.9608 | 0.7094 | 0.8174 | | 4.88 | 32.0 | 14016 | 5.1928 | 0.8506 | 0.9651 | 0.9484 | 0.7205 | 0.879 | 0.9698 | 0.787 | 0.8998 | 0.9082 | 0.802 | 0.9319 | 0.9859 | 0.8161 | 0.9115 | 0.7855 | 0.8301 | -1.0 | -1.0 | 0.6275 | 0.734 | 0.9035 | 0.9571 | 0.8431 | 0.9229 | 0.9863 | 0.9981 | 0.9287 | 0.9518 | 0.9446 | 0.9762 | 0.9857 | 0.9935 | 0.7377 | 0.8159 | 0.9426 | 0.974 | 0.8024 | 0.885 | 0.9096 | 0.9579 | 0.6951 | 0.8066 | | 4.8312 | 33.0 | 14454 | 5.1171 | 0.8519 | 0.9649 | 0.9485 | 0.7236 | 0.8715 | 0.9092 | 0.7882 | 0.9002 | 0.9094 | 0.8051 | 0.9355 | 0.9867 | 0.8064 | 0.915 | 0.8127 | 0.8545 | -1.0 | -1.0 | 0.6205 | 0.7302 | 0.916 | 0.9617 | 0.8272 | 0.9138 | 0.9875 | 0.9975 | 0.9385 | 0.964 | 0.93 | 0.9733 | 0.9806 | 0.9887 | 0.7479 | 0.8203 | 0.9445 | 0.9715 | 0.8113 | 0.886 | 0.9069 | 0.9543 | 0.6967 | 0.8005 | | 4.8807 | 34.0 | 14892 | 5.3542 | 0.8404 | 0.9617 | 0.943 | 0.707 | 0.8752 | 0.9566 | 0.7792 | 0.8921 | 0.9002 | 0.7871 | 0.9313 | 0.9836 | 0.7855 | 0.8946 | 0.7834 | 0.827 | -1.0 | -1.0 | 0.606 | 0.7162 | 0.911 | 0.9558 | 0.8249 | 0.9062 | 0.9872 | 0.9975 | 0.9283 | 0.9561 | 0.9189 | 0.9738 | 0.9808 | 0.9888 | 0.7295 | 0.8 | 0.9428 | 0.9665 | 0.7857 | 0.8777 | 0.9002 | 0.9505 | 0.6814 | 0.7924 | | 4.8605 | 35.0 | 15330 | 5.2119 | 0.8419 | 0.9631 | 0.9435 | 0.7118 | 0.8611 | 0.9584 | 0.7801 | 0.8937 | 0.9024 | 0.7951 | 0.9301 | 0.984 | 0.7704 | 0.899 | 0.7955 | 0.8391 | -1.0 | -1.0 | 0.6075 | 0.7112 | 0.9101 | 0.9542 | 0.8315 | 0.9119 | 0.9883 | 0.9978 | 0.927 | 0.9591 | 0.9161 | 0.9624 | 0.9831 | 0.9912 | 0.7368 | 0.8162 | 0.9422 | 0.969 | 0.7839 | 0.8715 | 0.912 | 0.957 | 0.6815 | 0.7939 | | 4.8117 | 36.0 | 15768 | 5.1740 | 0.8494 | 0.966 | 0.9498 | 0.7291 | 0.8765 | 0.9572 | 0.7855 | 0.8996 | 0.9089 | 0.8108 | 0.9322 | 0.9845 | 0.8005 | 0.9149 | 0.805 | 0.8481 | -1.0 | -1.0 | 0.618 | 0.7256 | 0.9143 | 0.9551 | 0.8306 | 0.9109 | 0.9893 | 0.9992 | 0.9307 | 0.9599 | 0.9281 | 0.9713 | 0.9845 | 0.9938 | 0.7541 | 0.8267 | 0.9342 | 0.9603 | 0.7892 | 0.8793 | 0.9081 | 0.9577 | 0.7051 | 0.8216 | | 4.7775 | 37.0 | 16206 | 5.1906 | 0.8508 | 0.9634 | 0.9476 | 0.7353 | 0.8685 | 0.9041 | 0.7879 | 0.9007 | 0.9088 | 0.8116 | 0.9269 | 0.9865 | 0.7837 | 0.9074 | 0.8018 | 0.8429 | -1.0 | -1.0 | 0.6357 | 0.7352 | 0.9186 | 0.958 | 0.8262 | 0.9122 | 0.9901 | 0.9993 | 0.9306 | 0.9545 | 0.9192 | 0.9683 | 0.9832 | 0.9934 | 0.7565 | 0.8262 | 0.9417 | 0.9687 | 0.7953 | 0.8777 | 0.9143 | 0.9634 | 0.7136 | 0.8162 | | 4.7134 | 38.0 | 16644 | 5.1609 | 0.8506 | 0.9624 | 0.9466 | 0.7367 | 0.8744 | 0.9591 | 0.7873 | 0.9012 | 0.9094 | 0.8137 | 0.9309 | 0.986 | 0.7943 | 0.9079 | 0.8112 | 0.8538 | -1.0 | -1.0 | 0.6252 | 0.7275 | 0.9138 | 0.9549 | 0.8253 | 0.9112 | 0.9886 | 0.9982 | 0.9295 | 0.9547 | 0.911 | 0.9668 | 0.9846 | 0.9927 | 0.7582 | 0.8278 | 0.9478 | 0.9687 | 0.7875 | 0.8777 | 0.9159 | 0.9628 | 0.7157 | 0.8265 | | 4.7257 | 39.0 | 17082 | 5.1242 | 0.8509 | 0.9641 | 0.9479 | 0.7398 | 0.8643 | 0.961 | 0.7861 | 0.8988 | 0.908 | 0.8145 | 0.9255 | 0.9822 | 0.7946 | 0.9008 | 0.8351 | 0.8694 | -1.0 | -1.0 | 0.6304 | 0.7366 | 0.919 | 0.9576 | 0.8292 | 0.9105 | 0.9872 | 0.9976 | 0.9327 | 0.9553 | 0.9121 | 0.9589 | 0.991 | 0.9964 | 0.7371 | 0.8134 | 0.938 | 0.9662 | 0.785 | 0.8751 | 0.9083 | 0.9523 | 0.713 | 0.8211 | | 4.7352 | 40.0 | 17520 | 5.2189 | 0.8524 | 0.9633 | 0.949 | 0.7443 | 0.8621 | 0.9017 | 0.7895 | 0.9018 | 0.911 | 0.82 | 0.9222 | 0.9721 | 0.7816 | 0.9083 | 0.8336 | 0.8656 | -1.0 | -1.0 | 0.629 | 0.7379 | 0.9119 | 0.9545 | 0.8305 | 0.9089 | 0.9902 | 0.9993 | 0.9302 | 0.9569 | 0.9272 | 0.9619 | 0.9844 | 0.9938 | 0.7543 | 0.8301 | 0.9357 | 0.9637 | 0.7949 | 0.8917 | 0.914 | 0.959 | 0.7165 | 0.823 | | 4.7245 | 41.0 | 17958 | 5.2015 | 0.8541 | 0.9663 | 0.9529 | 0.7408 | 0.8707 | 0.9638 | 0.7898 | 0.9023 | 0.9122 | 0.8165 | 0.9316 | 0.9863 | 0.8029 | 0.9049 | 0.8163 | 0.854 | -1.0 | -1.0 | 0.6416 | 0.748 | 0.9145 | 0.9586 | 0.8303 | 0.9136 | 0.9882 | 0.9977 | 0.9319 | 0.9564 | 0.9178 | 0.9713 | 0.9907 | 0.9956 | 0.7605 | 0.827 | 0.9392 | 0.9707 | 0.7957 | 0.8886 | 0.9085 | 0.9521 | 0.7191 | 0.8321 | | 4.7187 | 42.0 | 18396 | 5.2757 | 0.8493 | 0.9614 | 0.9469 | 0.7365 | 0.8665 | 0.9033 | 0.7869 | 0.8994 | 0.9085 | 0.8121 | 0.9261 | 0.9846 | 0.7967 | 0.9073 | 0.8228 | 0.8555 | -1.0 | -1.0 | 0.6198 | 0.733 | 0.9133 | 0.9558 | 0.8187 | 0.9087 | 0.988 | 0.9978 | 0.933 | 0.9547 | 0.9032 | 0.9619 | 0.9842 | 0.9921 | 0.7558 | 0.8213 | 0.9339 | 0.9631 | 0.7886 | 0.8855 | 0.9112 | 0.9562 | 0.7203 | 0.826 | | 4.7428 | 43.0 | 18834 | 5.2510 | 0.8499 | 0.964 | 0.9511 | 0.7396 | 0.8651 | 0.9026 | 0.788 | 0.9016 | 0.911 | 0.8192 | 0.9295 | 0.9837 | 0.7987 | 0.9076 | 0.8228 | 0.86 | -1.0 | -1.0 | 0.632 | 0.7421 | 0.9109 | 0.9533 | 0.8211 | 0.9086 | 0.9865 | 0.9974 | 0.9303 | 0.9536 | 0.9136 | 0.9743 | 0.984 | 0.9935 | 0.7499 | 0.8239 | 0.927 | 0.9575 | 0.7854 | 0.886 | 0.9116 | 0.9582 | 0.7244 | 0.838 | | 4.7277 | 44.0 | 19272 | 5.2467 | 0.8471 | 0.9653 | 0.9483 | 0.7293 | 0.8562 | 0.9586 | 0.7838 | 0.8977 | 0.9062 | 0.8063 | 0.9244 | 0.9847 | 0.7899 | 0.9018 | 0.8167 | 0.8566 | -1.0 | -1.0 | 0.6188 | 0.7297 | 0.9155 | 0.958 | 0.8224 | 0.9049 | 0.9868 | 0.9972 | 0.9337 | 0.9583 | 0.9203 | 0.9649 | 0.9842 | 0.9934 | 0.7376 | 0.808 | 0.928 | 0.9628 | 0.7852 | 0.8793 | 0.9106 | 0.9544 | 0.7091 | 0.8181 | | 4.73 | 45.0 | 19710 | 5.2441 | 0.8506 | 0.9648 | 0.9507 | 0.7359 | 0.8696 | 0.9583 | 0.7871 | 0.9003 | 0.9095 | 0.8127 | 0.933 | 0.9818 | 0.8011 | 0.9055 | 0.8126 | 0.8543 | -1.0 | -1.0 | 0.635 | 0.7429 | 0.9139 | 0.9555 | 0.8192 | 0.9112 | 0.9862 | 0.997 | 0.9262 | 0.9499 | 0.9094 | 0.9639 | 0.9839 | 0.9932 | 0.7511 | 0.8188 | 0.9321 | 0.9654 | 0.8072 | 0.8907 | 0.9146 | 0.9606 | 0.7157 | 0.8238 | | 4.736 | 46.0 | 20148 | 5.2361 | 0.8496 | 0.9639 | 0.9489 | 0.7344 | 0.8729 | 0.9005 | 0.7859 | 0.9 | 0.9087 | 0.8107 | 0.9323 | 0.9818 | 0.7925 | 0.9095 | 0.8179 | 0.8559 | -1.0 | -1.0 | 0.6265 | 0.7349 | 0.9139 | 0.9565 | 0.8268 | 0.9143 | 0.9882 | 0.9976 | 0.929 | 0.9499 | 0.9153 | 0.9678 | 0.9878 | 0.9947 | 0.7492 | 0.817 | 0.9266 | 0.9531 | 0.7903 | 0.8881 | 0.9167 | 0.9594 | 0.7142 | 0.8235 | | 4.728 | 47.0 | 20586 | 5.1929 | 0.8511 | 0.9652 | 0.9517 | 0.7374 | 0.8757 | 0.9602 | 0.7876 | 0.8998 | 0.9096 | 0.813 | 0.9325 | 0.9822 | 0.7964 | 0.9063 | 0.8261 | 0.8626 | -1.0 | -1.0 | 0.6323 | 0.7376 | 0.9123 | 0.9571 | 0.827 | 0.9141 | 0.9889 | 0.999 | 0.9309 | 0.9547 | 0.9144 | 0.9629 | 0.9891 | 0.9956 | 0.7397 | 0.8085 | 0.9329 | 0.962 | 0.7905 | 0.8876 | 0.917 | 0.9569 | 0.7173 | 0.8294 | | 4.711 | 48.0 | 21024 | 5.2107 | 0.8484 | 0.9642 | 0.9488 | 0.7342 | 0.8638 | 0.9613 | 0.787 | 0.8984 | 0.9081 | 0.8132 | 0.9274 | 0.9818 | 0.7948 | 0.9064 | 0.8215 | 0.8597 | -1.0 | -1.0 | 0.6242 | 0.7349 | 0.9094 | 0.9522 | 0.8193 | 0.9089 | 0.9885 | 0.999 | 0.9285 | 0.9491 | 0.9131 | 0.9604 | 0.9886 | 0.9953 | 0.7442 | 0.8149 | 0.932 | 0.9628 | 0.7869 | 0.8876 | 0.9117 | 0.9582 | 0.7148 | 0.8233 | | 4.7041 | 49.0 | 21462 | 5.1916 | 0.8502 | 0.9651 | 0.9509 | 0.7392 | 0.8734 | 0.9006 | 0.7877 | 0.9004 | 0.9093 | 0.8174 | 0.9323 | 0.9817 | 0.7997 | 0.9038 | 0.8277 | 0.8645 | -1.0 | -1.0 | 0.6368 | 0.7456 | 0.9105 | 0.9549 | 0.8167 | 0.9114 | 0.987 | 0.9976 | 0.9316 | 0.9506 | 0.9186 | 0.9624 | 0.9849 | 0.9937 | 0.7454 | 0.8203 | 0.9342 | 0.9573 | 0.7834 | 0.8845 | 0.9118 | 0.9548 | 0.7152 | 0.8294 | | 4.7133 | 50.0 | 21900 | 5.1922 | 0.848 | 0.9654 | 0.9497 | 0.7323 | 0.8702 | 0.9603 | 0.7848 | 0.8983 | 0.9079 | 0.8094 | 0.9289 | 0.9849 | 0.7866 | 0.906 | 0.8183 | 0.8576 | -1.0 | -1.0 | 0.623 | 0.7297 | 0.9109 | 0.9522 | 0.826 | 0.9096 | 0.9878 | 0.9977 | 0.9319 | 0.9564 | 0.9199 | 0.9703 | 0.9883 | 0.9951 | 0.7476 | 0.8144 | 0.9339 | 0.9612 | 0.7812 | 0.8845 | 0.9107 | 0.9553 | 0.7061 | 0.8208 | ### Framework versions - Transformers 4.47.0 - Pytorch 2.5.1+cu124 - Datasets 3.1.0 - Tokenizers 0.21.0