--- license: mit base_model: facebook/esm2_t6_8M_UR50D tags: - generated_from_trainer metrics: - precision - recall model-index: - name: esm_ft_Aerin_Yang_et_al_2023 results: [] --- # esm_ft_Aerin_Yang_et_al_2023 This model is a fine-tuned version of [facebook/esm2_t6_8M_UR50D](https://huggingface.co/facebook/esm2_t6_8M_UR50D) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 47.3436 - Rmse: 21.3763 - Mae: 15.1740 - Spearmanr Corr: 0.8503 - Spearmanr Corr P Value: 0.0000 - Pearsonr Corr: 0.8965 - Pearsonr Corr P Value: 0.0000 - Spearmanr Corr Of Deltas: 0.8677 - Spearmanr Corr Of Deltas P Value: 0.0 - Pearsonr Corr Of Deltas: 0.8960 - Pearsonr Corr Of Deltas P Value: 0.0 - Ranking F1 Score: 0.8086 - Ranking Mcc: 0.6729 - Rmse Enriched: 7.2264 - Mae Enriched: 1.8901 - Spearmanr Corr Enriched: 0.5019 - Spearmanr Corr Enriched P Value: 0.0000 - Pearsonr Corr Enriched: 0.0060 - Pearsonr Corr Enriched P Value: 0.9100 - Spearmanr Corr Of Deltas Enriched: 0.4626 - Spearmanr Corr Of Deltas Enriched P Value: 0.0 - Pearsonr Corr Of Deltas Enriched: 0.0076 - Pearsonr Corr Of Deltas Enriched P Value: 0.0536 - Ranking F1 Score Enriched: 0.6486 - Ranking Mcc Enriched: 0.3547 - Classification Thresh: 0.4 - Mcc: 0.8771 - F1 Score: 0.9425 - Acc: 0.9388 - Auc: 0.9676 - Precision: 0.9383 - Recall: 0.9388 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 1e-05 - train_batch_size: 8 - eval_batch_size: 8 - seed: 42 - distributed_type: not_parallel - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - lr_scheduler_warmup_steps: 200 - num_epochs: 100 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Rmse | Mae | Spearmanr Corr | Spearmanr Corr P Value | Pearsonr Corr | Pearsonr Corr P Value | Spearmanr Corr Of Deltas | Spearmanr Corr Of Deltas P Value | Pearsonr Corr Of Deltas | Pearsonr Corr Of Deltas P Value | Ranking F1 Score | Ranking Mcc | Rmse Enriched | Mae Enriched | Spearmanr Corr Enriched | Spearmanr Corr Enriched P Value | Pearsonr Corr Enriched | Pearsonr Corr Enriched P Value | Spearmanr Corr Of Deltas Enriched | Spearmanr Corr Of Deltas Enriched P Value | Pearsonr Corr Of Deltas Enriched | Pearsonr Corr Of Deltas Enriched P Value | Ranking F1 Score Enriched | Ranking Mcc Enriched | Classification Thresh | Mcc | F1 Score | Acc | Auc | Precision | Recall | |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:--------------:|:----------------------:|:-------------:|:---------------------:|:------------------------:|:--------------------------------:|:-----------------------:|:-------------------------------:|:----------------:|:-----------:|:-------------:|:------------:|:-----------------------:|:-------------------------------:|:----------------------:|:------------------------------:|:---------------------------------:|:-----------------------------------------:|:--------------------------------:|:----------------------------------------:|:-------------------------:|:--------------------:|:---------------------:|:------:|:--------:|:------:|:------:|:---------:|:------:| | 369.4768 | 1.0 | 335 | 309.3104 | 17.9851 | 14.2134 | 0.7652 | 0.0000 | 0.7721 | 0.0000 | 0.7596 | 0.0 | 0.7711 | 0.0 | 0.7246 | 0.5167 | 3.8124 | 3.7847 | 0.3897 | 0.0000 | 0.0085 | 0.8722 | 0.3062 | 0.0 | 0.0104 | 0.0086 | 0.5909 | 0.2595 | 0.5 | 0.0 | 0.0 | 0.4672 | 0.9295 | 0.2336 | 0.5 | | 348.3176 | 2.0 | 670 | 290.3025 | 18.2403 | 14.1929 | 0.7586 | 0.0000 | 0.7837 | 0.0000 | 0.7622 | 0.0 | 0.7827 | 0.0 | 0.7153 | 0.4989 | 2.7131 | 2.6103 | 0.2359 | 0.0000 | 0.0005 | 0.9921 | 0.2050 | 0.0 | 0.0019 | 0.6240 | 0.5377 | 0.1573 | 0.1 | 0.7794 | 0.9008 | 0.8896 | 0.9446 | 0.8935 | 0.8860 | | 285.4549 | 3.0 | 1005 | 246.7634 | 18.4829 | 14.2268 | 0.8340 | 0.0000 | 0.8599 | 0.0000 | 0.8481 | 0.0 | 0.8593 | 0.0 | 0.7740 | 0.6098 | 2.2592 | 1.1205 | 0.4911 | 0.0000 | 0.0179 | 0.7352 | 0.4085 | 0.0 | 0.0188 | 0.0000 | 0.6377 | 0.3352 | 0.01 | 0.8174 | 0.9142 | 0.9090 | 0.9667 | 0.9082 | 0.9092 | | 261.761 | 4.0 | 1340 | 223.3279 | 18.4437 | 14.2819 | 0.8369 | 0.0000 | 0.8756 | 0.0000 | 0.8491 | 0.0 | 0.8751 | 0.0 | 0.7781 | 0.6174 | 2.1556 | 0.9066 | 0.5069 | 0.0000 | 0.0162 | 0.7603 | 0.4102 | 0.0 | 0.0176 | 0.0000 | 0.6400 | 0.3421 | 0.2 | 0.8500 | 0.9311 | 0.9254 | 0.9670 | 0.9258 | 0.9241 | | 234.6825 | 5.0 | 1675 | 192.8761 | 17.8226 | 14.3821 | 0.8398 | 0.0000 | 0.8664 | 0.0000 | 0.8564 | 0.0 | 0.8659 | 0.0 | 0.7834 | 0.6271 | 3.4683 | 2.0139 | 0.5033 | 0.0000 | 0.0245 | 0.6441 | 0.4034 | 0.0 | 0.0228 | 0.0000 | 0.6391 | 0.3390 | 0.01 | 0.7977 | 0.8939 | 0.8940 | 0.9695 | 0.8989 | 0.8987 | | 202.2116 | 6.0 | 2010 | 172.1334 | 17.9694 | 14.4213 | 0.8554 | 0.0000 | 0.9027 | 0.0000 | 0.8648 | 0.0 | 0.9023 | 0.0 | 0.8153 | 0.6854 | 3.0619 | 1.4839 | 0.4866 | 0.0000 | 0.0241 | 0.6488 | 0.4006 | 0.0 | 0.0247 | 0.0000 | 0.6329 | 0.3262 | 0.2 | 0.8429 | 0.9213 | 0.9194 | 0.9702 | 0.9205 | 0.9224 | | 187.7496 | 7.0 | 2345 | 159.0955 | 18.1593 | 14.4489 | 0.8507 | 0.0000 | 0.8982 | 0.0000 | 0.8622 | 0.0 | 0.8978 | 0.0 | 0.8058 | 0.6683 | 2.9097 | 1.0672 | 0.4686 | 0.0000 | 0.0140 | 0.7922 | 0.3883 | 0.0 | 0.0163 | 0.0000 | 0.6247 | 0.3125 | 0.4 | 0.8830 | 0.9456 | 0.9418 | 0.9698 | 0.9416 | 0.9414 | | 175.2975 | 8.0 | 2680 | 148.1963 | 18.1536 | 14.4793 | 0.8486 | 0.0000 | 0.8872 | 0.0000 | 0.8586 | 0.0 | 0.8867 | 0.0 | 0.7988 | 0.6556 | 3.0788 | 1.1383 | 0.4657 | 0.0000 | 0.0123 | 0.8170 | 0.3897 | 0.0 | 0.0148 | 0.0002 | 0.6213 | 0.3064 | 0.2 | 0.8680 | 0.9394 | 0.9343 | 0.9723 | 0.9349 | 0.9331 | | 145.5657 | 9.0 | 3015 | 126.9086 | 17.9591 | 14.5346 | 0.8640 | 0.0000 | 0.9017 | 0.0000 | 0.8663 | 0.0 | 0.9013 | 0.0 | 0.8259 | 0.7045 | 3.6195 | 1.5544 | 0.5056 | 0.0000 | 0.0114 | 0.8298 | 0.4182 | 0.0 | 0.0134 | 0.0007 | 0.6434 | 0.3460 | 0.1 | 0.8714 | 0.9395 | 0.9358 | 0.9694 | 0.9351 | 0.9362 | | 143.0386 | 10.0 | 3350 | 113.5738 | 17.7073 | 14.6081 | 0.8751 | 0.0000 | 0.9018 | 0.0000 | 0.8747 | 0.0 | 0.9014 | 0.0 | 0.8360 | 0.7224 | 4.2095 | 2.3461 | 0.5327 | 0.0000 | 0.0124 | 0.8142 | 0.4317 | 0.0 | 0.0147 | 0.0002 | 0.6540 | 0.3666 | 0.01 | 0.8479 | 0.9246 | 0.9224 | 0.9719 | 0.9229 | 0.9250 | | 124.8125 | 11.0 | 3685 | 110.7778 | 18.4408 | 14.6773 | 0.8430 | 0.0000 | 0.8939 | 0.0000 | 0.8570 | 0.0 | 0.8935 | 0.0 | 0.7967 | 0.6520 | 3.6093 | 1.1550 | 0.4303 | 0.0000 | 0.0052 | 0.9216 | 0.3573 | 0.0 | 0.0081 | 0.0405 | 0.6089 | 0.2842 | 0.01 | 0.8830 | 0.9462 | 0.9418 | 0.9712 | 0.9423 | 0.9407 | | 108.0145 | 12.0 | 4020 | 107.6146 | 18.2662 | 14.6119 | 0.8153 | 0.0000 | 0.8758 | 0.0000 | 0.8373 | 0.0 | 0.8753 | 0.0 | 0.7782 | 0.6188 | 3.8224 | 1.4757 | 0.3161 | 0.0000 | 0.0083 | 0.8759 | 0.3035 | 0.0 | 0.0105 | 0.0080 | 0.5698 | 0.2096 | 0.2 | 0.8679 | 0.9391 | 0.9343 | 0.9635 | 0.9344 | 0.9336 | | 104.4241 | 13.0 | 4355 | 88.3598 | 18.2895 | 14.6767 | 0.8644 | 0.0000 | 0.9018 | 0.0000 | 0.8661 | 0.0 | 0.9014 | 0.0 | 0.8274 | 0.7081 | 4.1833 | 1.6079 | 0.4677 | 0.0000 | 0.0128 | 0.8096 | 0.4002 | 0.0 | 0.0154 | 0.0001 | 0.6250 | 0.3123 | 0.01 | 0.8920 | 0.9497 | 0.9463 | 0.9692 | 0.9458 | 0.9462 | | 96.8491 | 14.0 | 4690 | 80.2075 | 18.5707 | 14.7252 | 0.8666 | 0.0000 | 0.9020 | 0.0000 | 0.8677 | 0.0 | 0.9016 | 0.0 | 0.8324 | 0.7164 | 4.4905 | 1.3695 | 0.4673 | 0.0000 | 0.0082 | 0.8763 | 0.3966 | 0.0 | 0.0121 | 0.0022 | 0.6282 | 0.3176 | 0.1 | 0.8860 | 0.9471 | 0.9433 | 0.9727 | 0.9430 | 0.9430 | | 80.8575 | 15.0 | 5025 | 81.6362 | 18.1417 | 14.8864 | 0.8610 | 0.0000 | 0.8440 | 0.0000 | 0.8408 | 0.0 | 0.8433 | 0.0 | 0.8265 | 0.7062 | 7.7838 | 3.9018 | 0.4464 | 0.0000 | 0.0238 | 0.6534 | 0.3784 | 0.0 | 0.0199 | 0.0000 | 0.6129 | 0.2909 | 0.01 | 0.7789 | 0.8719 | 0.8776 | 0.9720 | 0.8936 | 0.8854 | | 80.7971 | 16.0 | 5360 | 73.6808 | 18.8265 | 14.7539 | 0.8511 | 0.0000 | 0.8909 | 0.0000 | 0.8587 | 0.0 | 0.8905 | 0.0 | 0.8130 | 0.6820 | 4.5753 | 1.3668 | 0.4417 | 0.0000 | 0.0070 | 0.8941 | 0.3749 | 0.0 | 0.0099 | 0.0118 | 0.6102 | 0.2887 | 0.1 | 0.8799 | 0.9446 | 0.9403 | 0.9692 | 0.9404 | 0.9396 | | 72.952 | 17.0 | 5695 | 65.0194 | 18.8186 | 14.8172 | 0.8758 | 0.0000 | 0.8953 | 0.0000 | 0.8718 | 0.0 | 0.8950 | 0.0 | 0.8388 | 0.7283 | 5.2193 | 1.8669 | 0.5261 | 0.0000 | 0.0095 | 0.8575 | 0.4276 | 0.0 | 0.0134 | 0.0007 | 0.6503 | 0.3618 | 0.2 | 0.8742 | 0.9412 | 0.9373 | 0.9684 | 0.9367 | 0.9374 | | 66.9172 | 18.0 | 6030 | 60.6609 | 19.2047 | 14.8782 | 0.8658 | 0.0000 | 0.9010 | 0.0000 | 0.8659 | 0.0 | 0.9006 | 0.0 | 0.8305 | 0.7133 | 4.9613 | 1.4022 | 0.4742 | 0.0000 | 0.0076 | 0.8862 | 0.3893 | 0.0 | 0.0105 | 0.0076 | 0.6297 | 0.3198 | 0.2 | 0.8799 | 0.9446 | 0.9403 | 0.9701 | 0.9404 | 0.9396 | | 62.2077 | 19.0 | 6365 | 56.4374 | 19.3805 | 14.8951 | 0.8088 | 0.0000 | 0.9006 | 0.0000 | 0.8387 | 0.0 | 0.9001 | 0.0 | 0.7684 | 0.5998 | 5.3365 | 1.4111 | 0.2738 | 0.0000 | 0.0048 | 0.9276 | 0.2357 | 0.0 | 0.0073 | 0.0658 | 0.5606 | 0.1887 | 0.2 | 0.8770 | 0.9428 | 0.9388 | 0.9711 | 0.9384 | 0.9386 | | 56.8277 | 20.0 | 6700 | 58.7119 | 19.4767 | 14.8582 | 0.8578 | 0.0000 | 0.8919 | 0.0000 | 0.8682 | 0.0 | 0.8915 | 0.0 | 0.8095 | 0.6746 | 4.9497 | 1.2669 | 0.4991 | 0.0000 | 0.0038 | 0.9435 | 0.4194 | 0.0 | 0.0075 | 0.0572 | 0.6406 | 0.3396 | 0.2 | 0.8801 | 0.9451 | 0.9403 | 0.9760 | 0.9412 | 0.9389 | | 54.5262 | 21.0 | 7035 | 62.3813 | 19.7067 | 14.8882 | 0.8480 | 0.0000 | 0.8803 | 0.0000 | 0.8515 | 0.0 | 0.8798 | 0.0 | 0.8147 | 0.6846 | 4.8119 | 1.1526 | 0.4677 | 0.0000 | 0.0023 | 0.9656 | 0.3986 | 0.0 | 0.0057 | 0.1482 | 0.6249 | 0.3116 | 0.01 | 0.8656 | 0.9388 | 0.9328 | 0.9652 | 0.9350 | 0.9307 | | 49.6793 | 22.0 | 7370 | 48.1350 | 19.7858 | 14.9826 | 0.8328 | 0.0000 | 0.9013 | 0.0000 | 0.8465 | 0.0 | 0.9009 | 0.0 | 0.8021 | 0.6622 | 6.0150 | 1.6723 | 0.3468 | 0.0000 | 0.0055 | 0.9173 | 0.3021 | 0.0 | 0.0082 | 0.0387 | 0.5826 | 0.2311 | 0.2 | 0.8774 | 0.9423 | 0.9388 | 0.9691 | 0.9381 | 0.9392 | | 46.8797 | 23.0 | 7705 | 47.1256 | 19.4271 | 14.9916 | 0.8482 | 0.0000 | 0.9009 | 0.0000 | 0.8579 | 0.0 | 0.9005 | 0.0 | 0.8124 | 0.6805 | 6.0228 | 2.7003 | 0.4275 | 0.0000 | 0.0182 | 0.7309 | 0.3703 | 0.0 | 0.0219 | 0.0000 | 0.6099 | 0.2839 | 0.1 | 0.8247 | 0.9099 | 0.9090 | 0.9707 | 0.9118 | 0.9129 | | 47.5216 | 24.0 | 8040 | 52.0719 | 19.9818 | 14.9435 | 0.8290 | 0.0000 | 0.8907 | 0.0000 | 0.8438 | 0.0 | 0.8903 | 0.0 | 0.7941 | 0.6475 | 5.4359 | 1.4249 | 0.3529 | 0.0000 | 0.0064 | 0.9043 | 0.3122 | 0.0 | 0.0106 | 0.0074 | 0.5861 | 0.2332 | 0.2 | 0.8740 | 0.9420 | 0.9373 | 0.9673 | 0.9376 | 0.9363 | | 45.7938 | 25.0 | 8375 | 58.8807 | 20.2165 | 15.0312 | 0.8456 | 0.0000 | 0.8770 | 0.0000 | 0.8548 | 0.0 | 0.8765 | 0.0 | 0.8027 | 0.6623 | 5.1704 | 1.3739 | 0.4375 | 0.0000 | 0.0067 | 0.8990 | 0.3757 | 0.0 | 0.0094 | 0.0168 | 0.6180 | 0.2933 | 0.01 | 0.8627 | 0.9375 | 0.9313 | 0.9734 | 0.9337 | 0.9291 | | 44.8508 | 26.0 | 8710 | 58.7849 | 19.8825 | 14.9498 | 0.8244 | 0.0000 | 0.8709 | 0.0000 | 0.8407 | 0.0 | 0.8703 | 0.0 | 0.7720 | 0.6060 | 5.0925 | 1.9843 | 0.4086 | 0.0000 | 0.0061 | 0.9089 | 0.3614 | 0.0 | 0.0082 | 0.0375 | 0.6093 | 0.2800 | 0.2 | 0.8504 | 0.9319 | 0.9254 | 0.9695 | 0.9272 | 0.9233 | | 45.6247 | 27.0 | 9045 | 46.7955 | 20.2897 | 15.0193 | 0.8255 | 0.0000 | 0.8953 | 0.0000 | 0.8372 | 0.0 | 0.8948 | 0.0 | 0.8058 | 0.6699 | 6.0373 | 1.8172 | 0.2721 | 0.0000 | 0.0074 | 0.8884 | 0.2716 | 0.0 | 0.0101 | 0.0104 | 0.5578 | 0.1833 | 0.1 | 0.8709 | 0.9405 | 0.9358 | 0.9670 | 0.9360 | 0.9350 | | 39.1753 | 28.0 | 9380 | 41.0914 | 20.5417 | 15.1406 | 0.8576 | 0.0000 | 0.9072 | 0.0000 | 0.8630 | 0.0 | 0.9068 | 0.0 | 0.8242 | 0.7016 | 6.6642 | 2.0166 | 0.4555 | 0.0000 | 0.0092 | 0.8616 | 0.3867 | 0.0 | 0.0106 | 0.0073 | 0.6257 | 0.3097 | 0.2 | 0.8754 | 0.9402 | 0.9373 | 0.9689 | 0.9367 | 0.9387 | | 43.4112 | 29.0 | 9715 | 40.4185 | 20.5776 | 15.0852 | 0.8293 | 0.0000 | 0.9081 | 0.0000 | 0.8492 | 0.0 | 0.9077 | 0.0 | 0.7968 | 0.6523 | 6.6227 | 1.9815 | 0.3055 | 0.0000 | 0.0050 | 0.9246 | 0.2826 | 0.0 | 0.0084 | 0.0338 | 0.5722 | 0.2046 | 0.2 | 0.8837 | 0.9448 | 0.9418 | 0.9734 | 0.9411 | 0.9427 | | 38.2707 | 30.0 | 10050 | 62.5598 | 20.8173 | 15.0316 | 0.8236 | 0.0000 | 0.8643 | 0.0000 | 0.8368 | 0.0 | 0.8637 | 0.0 | 0.7912 | 0.6418 | 5.0745 | 1.1496 | 0.4186 | 0.0000 | 0.0034 | 0.9484 | 0.3686 | 0.0 | 0.0049 | 0.2127 | 0.6094 | 0.2775 | 0.01 | 0.8393 | 0.9272 | 0.9194 | 0.9601 | 0.9230 | 0.9164 | | 38.1543 | 31.0 | 10385 | 39.7963 | 21.0407 | 15.2279 | 0.8319 | 0.0000 | 0.9114 | 0.0000 | 0.8456 | 0.0 | 0.9110 | 0.0 | 0.8080 | 0.6733 | 6.3704 | 1.7422 | 0.3041 | 0.0000 | 0.0038 | 0.9427 | 0.2811 | 0.0 | 0.0080 | 0.0414 | 0.5712 | 0.2045 | 0.4 | 0.8802 | 0.9438 | 0.9403 | 0.9679 | 0.9398 | 0.9404 | | 42.8516 | 32.0 | 10720 | 47.2133 | 20.9678 | 15.0749 | 0.8012 | 0.0000 | 0.8942 | 0.0000 | 0.8253 | 0.0 | 0.8938 | 0.0 | 0.7815 | 0.6256 | 6.0356 | 1.5292 | 0.2461 | 0.0000 | 0.0017 | 0.9740 | 0.2325 | 0.0 | 0.0047 | 0.2351 | 0.5484 | 0.1655 | 0.4 | 0.8650 | 0.9374 | 0.9328 | 0.9579 | 0.9328 | 0.9322 | | 39.1913 | 33.0 | 11055 | 43.6899 | 21.1907 | 15.1544 | 0.8333 | 0.0000 | 0.9029 | 0.0000 | 0.8433 | 0.0 | 0.9026 | 0.0 | 0.8113 | 0.6799 | 6.9763 | 1.8354 | 0.2940 | 0.0000 | 0.0046 | 0.9304 | 0.2785 | 0.0 | 0.0088 | 0.0261 | 0.5661 | 0.1967 | 0.2 | 0.8863 | 0.9466 | 0.9433 | 0.9678 | 0.9426 | 0.9436 | | 38.1537 | 34.0 | 11390 | 42.9613 | 21.2545 | 15.1299 | 0.8310 | 0.0000 | 0.9051 | 0.0000 | 0.8490 | 0.0 | 0.9048 | 0.0 | 0.8039 | 0.6660 | 6.3446 | 1.5218 | 0.3169 | 0.0000 | 0.0027 | 0.9592 | 0.2993 | 0.0 | 0.0077 | 0.0505 | 0.5731 | 0.2174 | 0.1 | 0.8889 | 0.9487 | 0.9448 | 0.9700 | 0.9448 | 0.9442 | | 37.3493 | 35.0 | 11725 | 38.6112 | 21.3607 | 15.2129 | 0.8185 | 0.0000 | 0.9169 | 0.0000 | 0.8503 | 0.0 | 0.9166 | 0.0 | 0.7816 | 0.6250 | 7.6285 | 2.2004 | 0.3052 | 0.0000 | 0.0044 | 0.9335 | 0.2863 | 0.0 | 0.0057 | 0.1520 | 0.5739 | 0.2188 | 0.2 | 0.8797 | 0.9410 | 0.9388 | 0.9712 | 0.9387 | 0.9410 | | 33.7528 | 36.0 | 12060 | 38.6323 | 21.3682 | 15.1603 | 0.8426 | 0.0000 | 0.9156 | 0.0000 | 0.8683 | 0.0 | 0.9153 | 0.0 | 0.7984 | 0.6546 | 6.8130 | 1.6994 | 0.4313 | 0.0000 | 0.0005 | 0.9929 | 0.3897 | 0.0 | 0.0043 | 0.2720 | 0.6175 | 0.2959 | 0.2 | 0.9012 | 0.9537 | 0.9507 | 0.9746 | 0.9502 | 0.9510 | | 41.6965 | 37.0 | 12395 | 38.3068 | 21.3550 | 15.1869 | 0.8450 | 0.0000 | 0.9169 | 0.0000 | 0.8672 | 0.0 | 0.9165 | 0.0 | 0.7996 | 0.6569 | 7.3289 | 2.0281 | 0.4395 | 0.0000 | 0.0033 | 0.9501 | 0.3784 | 0.0 | 0.0051 | 0.1992 | 0.6216 | 0.3097 | 0.2 | 0.8902 | 0.9474 | 0.9448 | 0.9749 | 0.9441 | 0.9461 | | 36.2383 | 38.0 | 12730 | 45.3013 | 21.3023 | 15.1144 | 0.8441 | 0.0000 | 0.9003 | 0.0000 | 0.8552 | 0.0 | 0.8998 | 0.0 | 0.8177 | 0.6903 | 6.2362 | 1.5103 | 0.4335 | 0.0000 | 0.0005 | 0.9924 | 0.4016 | 0.0 | 0.0037 | 0.3462 | 0.6162 | 0.2962 | 0.2 | 0.8800 | 0.9448 | 0.9403 | 0.9652 | 0.9406 | 0.9393 | | 35.4234 | 39.0 | 13065 | 45.0533 | 21.3658 | 15.1439 | 0.8570 | 0.0000 | 0.9014 | 0.0000 | 0.8634 | 0.0 | 0.9010 | 0.0 | 0.8220 | 0.6974 | 6.3186 | 1.4889 | 0.4809 | 0.0000 | 0.0021 | 0.9677 | 0.4335 | 0.0 | 0.0061 | 0.1195 | 0.6353 | 0.3305 | 0.2 | 0.8889 | 0.9487 | 0.9448 | 0.9692 | 0.9448 | 0.9442 | | 30.5131 | 40.0 | 13400 | 47.3436 | 21.3763 | 15.1740 | 0.8503 | 0.0000 | 0.8965 | 0.0000 | 0.8677 | 0.0 | 0.8960 | 0.0 | 0.8086 | 0.6729 | 7.2264 | 1.8901 | 0.5019 | 0.0000 | 0.0060 | 0.9100 | 0.4626 | 0.0 | 0.0076 | 0.0536 | 0.6486 | 0.3547 | 0.4 | 0.8771 | 0.9425 | 0.9388 | 0.9676 | 0.9383 | 0.9388 | ### Framework versions - Transformers 4.41.2 - Pytorch 2.5.1+cu118 - Datasets 3.1.0 - Tokenizers 0.19.1