elodiesune commited on
Commit
bc088fd
·
verified ·
1 Parent(s): 0cbf168

Model save

Browse files
Files changed (3) hide show
  1. README.md +67 -88
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -18,38 +18,38 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [facebook/esm2_t6_8M_UR50D](https://huggingface.co/facebook/esm2_t6_8M_UR50D) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 55.5735
22
- - Rmse: 21.3973
23
- - Mae: 15.1702
24
- - Spearmanr Corr: 0.8166
25
  - Spearmanr Corr P Value: 0.0000
26
- - Pearsonr Corr: 0.8790
27
  - Pearsonr Corr P Value: 0.0000
28
- - Spearmanr Corr Of Deltas: 0.8380
29
  - Spearmanr Corr Of Deltas P Value: 0.0
30
- - Pearsonr Corr Of Deltas: 0.8785
31
  - Pearsonr Corr Of Deltas P Value: 0.0
32
- - Ranking F1 Score: 0.7803
33
- - Ranking Mcc: 0.6230
34
- - Rmse Enriched: 8.0359
35
- - Mae Enriched: 2.2957
36
- - Spearmanr Corr Enriched: 0.3598
37
  - Spearmanr Corr Enriched P Value: 0.0000
38
- - Pearsonr Corr Enriched: 0.0053
39
- - Pearsonr Corr Enriched P Value: 0.9203
40
- - Spearmanr Corr Of Deltas Enriched: 0.3327
41
  - Spearmanr Corr Of Deltas Enriched P Value: 0.0
42
- - Pearsonr Corr Of Deltas Enriched: 0.0082
43
- - Pearsonr Corr Of Deltas Enriched P Value: 0.0369
44
- - Ranking F1 Score Enriched: 0.5801
45
- - Ranking Mcc Enriched: 0.2402
46
- - Classification Thresh: 0.2
47
- - Mcc: 0.8622
48
- - F1 Score: 0.9356
49
- - Acc: 0.9313
50
- - Auc: 0.9622
51
- - Precision: 0.9307
52
- - Recall: 0.9314
53
 
54
  ## Model description
55
 
@@ -68,7 +68,7 @@ More information needed
68
  ### Training hyperparameters
69
 
70
  The following hyperparameters were used during training:
71
- - learning_rate: 0.001
72
  - train_batch_size: 8
73
  - eval_batch_size: 8
74
  - seed: 42
@@ -83,67 +83,46 @@ The following hyperparameters were used during training:
83
 
84
  | Training Loss | Epoch | Step | Validation Loss | Rmse | Mae | Spearmanr Corr | Spearmanr Corr P Value | Pearsonr Corr | Pearsonr Corr P Value | Spearmanr Corr Of Deltas | Spearmanr Corr Of Deltas P Value | Pearsonr Corr Of Deltas | Pearsonr Corr Of Deltas P Value | Ranking F1 Score | Ranking Mcc | Rmse Enriched | Mae Enriched | Spearmanr Corr Enriched | Spearmanr Corr Enriched P Value | Pearsonr Corr Enriched | Pearsonr Corr Enriched P Value | Spearmanr Corr Of Deltas Enriched | Spearmanr Corr Of Deltas Enriched P Value | Pearsonr Corr Of Deltas Enriched | Pearsonr Corr Of Deltas Enriched P Value | Ranking F1 Score Enriched | Ranking Mcc Enriched | Classification Thresh | Mcc | F1 Score | Acc | Auc | Precision | Recall |
85
  |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:--------------:|:----------------------:|:-------------:|:---------------------:|:------------------------:|:--------------------------------:|:-----------------------:|:-------------------------------:|:----------------:|:-----------:|:-------------:|:------------:|:-----------------------:|:-------------------------------:|:----------------------:|:------------------------------:|:---------------------------------:|:-----------------------------------------:|:--------------------------------:|:----------------------------------------:|:-------------------------:|:--------------------:|:---------------------:|:------:|:--------:|:------:|:------:|:---------:|:------:|
86
- | 224.0103 | 1.0 | 335 | 100.8115 | 19.5017 | 14.8045 | 0.7907 | 0.0000 | 0.7819 | 0.0000 | 0.7702 | 0.0 | 0.7809 | 0.0 | 0.7381 | 0.5420 | 5.1786 | 2.0783 | 0.3933 | 0.0000 | 0.0080 | 0.8796 | 0.3608 | 0.0 | 0.0104 | 0.0082 | 0.6009 | 0.2662 | 0.4 | 0.8052 | 0.9088 | 0.9030 | 0.9493 | 0.9024 | 0.9028 |
87
- | 95.547 | 2.0 | 670 | 76.5516 | 20.5294 | 15.0615 | 0.7953 | 0.0000 | 0.8220 | 0.0000 | 0.8144 | 0.0 | 0.8212 | 0.0 | 0.7609 | 0.5856 | 6.8950 | 2.9921 | 0.4154 | 0.0000 | 0.0033 | 0.9500 | 0.3518 | 0.0 | 0.0051 | 0.1986 | 0.6112 | 0.2799 | 0.5 | 0.8026 | 0.9098 | 0.9015 | 0.9441 | 0.9033 | 0.8993 |
88
- | 80.5984 | 3.0 | 1005 | 70.0753 | 19.9252 | 15.0616 | 0.7402 | 0.0000 | 0.8339 | 0.0000 | 0.7752 | 0.0 | 0.8332 | 0.0 | 0.7302 | 0.5286 | 6.4551 | 3.7018 | 0.1691 | 0.0013 | 0.0079 | 0.8817 | 0.1941 | 0.0 | 0.0085 | 0.0308 | 0.5201 | 0.1085 | 0.2 | 0.6844 | 0.8237 | 0.8313 | 0.9414 | 0.8457 | 0.8387 |
89
- | 108.1741 | 4.0 | 1340 | 86.0766 | 21.0765 | 15.1628 | 0.7954 | 0.0000 | 0.8139 | 0.0000 | 0.8096 | 0.0 | 0.8132 | 0.0 | 0.7437 | 0.5529 | 5.8988 | 1.9061 | 0.3949 | 0.0000 | 0.0022 | 0.9670 | 0.3306 | 0.0 | 0.0046 | 0.2477 | 0.6029 | 0.2649 | 0.4 | 0.7991 | 0.9081 | 0.9 | 0.9491 | 0.9009 | 0.8982 |
90
- | 79.6387 | 5.0 | 1675 | 177.7269 | 20.4513 | 15.5801 | 0.7818 | 0.0000 | 0.6323 | 0.0000 | 0.7472 | 0.0 | 0.6304 | 0.0 | 0.7555 | 0.5761 | 16.9622 | 12.0254 | 0.4675 | 0.0000 | 0.0635 | 0.2304 | 0.4224 | 0.0 | 0.0612 | 0.0000 | 0.6266 | 0.3156 | 0.5 | 0.0 | 0.0 | 0.4672 | 0.9320 | 0.2336 | 0.5 |
91
- | 69.6553 | 6.0 | 2010 | 59.1365 | 21.1070 | 15.1476 | 0.8116 | 0.0000 | 0.8679 | 0.0000 | 0.8353 | 0.0 | 0.8673 | 0.0 | 0.7638 | 0.5911 | 7.7048 | 2.5730 | 0.4457 | 0.0000 | 0.0068 | 0.8975 | 0.3675 | 0.0 | 0.0071 | 0.0738 | 0.6222 | 0.3085 | 0.2 | 0.8501 | 0.9302 | 0.9254 | 0.9539 | 0.9249 | 0.9252 |
92
- | 72.0561 | 7.0 | 2345 | 57.6269 | 20.8379 | 15.1745 | 0.8040 | 0.0000 | 0.8699 | 0.0000 | 0.8338 | 0.0 | 0.8694 | 0.0 | 0.7570 | 0.5783 | 7.9188 | 3.2772 | 0.4100 | 0.0000 | 0.0074 | 0.8891 | 0.3498 | 0.0 | 0.0073 | 0.0631 | 0.6084 | 0.2853 | 0.0 | 0.8226 | 0.9138 | 0.9104 | 0.9555 | 0.9102 | 0.9124 |
93
- | 73.2246 | 8.0 | 2680 | 62.5203 | 21.2120 | 15.1762 | 0.8134 | 0.0000 | 0.8613 | 0.0000 | 0.8300 | 0.0 | 0.8608 | 0.0 | 0.7556 | 0.5754 | 7.5722 | 2.2013 | 0.4811 | 0.0000 | 0.1158 | 0.0283 | 0.4053 | 0.0 | 0.1183 | 0.0000 | 0.6348 | 0.3390 | 0.4 | 0.8470 | 0.9291 | 0.9239 | 0.9554 | 0.9238 | 0.9232 |
94
- | 66.5502 | 9.0 | 3015 | 66.5384 | 20.3044 | 15.0773 | 0.8090 | 0.0000 | 0.8442 | 0.0000 | 0.8269 | 0.0 | 0.8435 | 0.0 | 0.7622 | 0.5881 | 7.2770 | 3.1382 | 0.4538 | 0.0000 | 0.0227 | 0.6680 | 0.3815 | 0.0 | 0.0242 | 0.0000 | 0.6277 | 0.3228 | 0.5 | 0.8200 | 0.9167 | 0.9104 | 0.9536 | 0.9106 | 0.9095 |
95
- | 76.9662 | 10.0 | 3350 | 65.1644 | 20.8263 | 15.2132 | 0.8044 | 0.0000 | 0.8537 | 0.0000 | 0.8285 | 0.0 | 0.8530 | 0.0 | 0.7570 | 0.5786 | 8.5394 | 3.9154 | 0.4190 | 0.0000 | 0.1147 | 0.0297 | 0.3661 | 0.0 | 0.1159 | 0.0000 | 0.6101 | 0.2923 | 0.01 | 0.7908 | 0.8941 | 0.8925 | 0.9521 | 0.8947 | 0.8961 |
96
- | 69.4271 | 11.0 | 3685 | 63.9898 | 21.4740 | 15.2472 | 0.8117 | 0.0000 | 0.8615 | 0.0000 | 0.8397 | 0.0 | 0.8609 | 0.0 | 0.7593 | 0.5827 | 8.3251 | 2.4636 | 0.4294 | 0.0000 | 0.0038 | 0.9435 | 0.3708 | 0.0 | 0.0048 | 0.2201 | 0.6109 | 0.2924 | 0.2 | 0.8381 | 0.9246 | 0.9194 | 0.9574 | 0.9189 | 0.9192 |
97
- | 61.9077 | 12.0 | 4020 | 63.2704 | 20.9954 | 15.0853 | 0.7966 | 0.0000 | 0.8574 | 0.0000 | 0.8115 | 0.0 | 0.8568 | 0.0 | 0.7453 | 0.5561 | 6.5692 | 2.2048 | 0.3900 | 0.0000 | 0.0013 | 0.9807 | 0.3375 | 0.0 | 0.0047 | 0.2360 | 0.5928 | 0.2618 | 0.2 | 0.8384 | 0.9264 | 0.9194 | 0.9533 | 0.9211 | 0.9173 |
98
- | 75.7209 | 13.0 | 4355 | 75.1969 | 20.8680 | 15.1856 | 0.8156 | 0.0000 | 0.8299 | 0.0000 | 0.8252 | 0.0 | 0.8292 | 0.0 | 0.7661 | 0.5952 | 9.3473 | 3.8479 | 0.4809 | 0.0000 | 0.0107 | 0.8403 | 0.3821 | 0.0 | 0.0085 | 0.0303 | 0.6290 | 0.3251 | 0.2 | 0.7899 | 0.8978 | 0.8940 | 0.9554 | 0.8939 | 0.8960 |
99
- | 60.0703 | 14.0 | 4690 | 71.8442 | 21.2869 | 15.1907 | 0.7907 | 0.0000 | 0.8419 | 0.0000 | 0.8181 | 0.0 | 0.8412 | 0.0 | 0.7460 | 0.5580 | 7.7203 | 2.2978 | 0.3582 | 0.0000 | 0.0006 | 0.9904 | 0.3063 | 0.0 | 0.0026 | 0.5167 | 0.5855 | 0.2451 | 0.2 | 0.8260 | 0.9203 | 0.9134 | 0.9504 | 0.9141 | 0.9119 |
100
- | 57.1283 | 15.0 | 5025 | 66.1475 | 20.6187 | 15.2215 | 0.8060 | 0.0000 | 0.8516 | 0.0000 | 0.8299 | 0.0 | 0.8510 | 0.0 | 0.7612 | 0.5861 | 8.8640 | 4.4767 | 0.4045 | 0.0000 | 0.1060 | 0.0447 | 0.3700 | 0.0 | 0.1072 | 0.0000 | 0.5994 | 0.2699 | 0.3 | 0.8399 | 0.9226 | 0.9194 | 0.9580 | 0.9190 | 0.9209 |
101
- | 68.7772 | 16.0 | 5360 | 55.3751 | 21.4698 | 15.3605 | 0.8080 | 0.0000 | 0.8799 | 0.0000 | 0.8342 | 0.0 | 0.8794 | 0.0 | 0.7496 | 0.5641 | 7.1778 | 2.1977 | 0.4162 | 0.0000 | 0.0226 | 0.6696 | 0.3501 | 0.0 | 0.0256 | 0.0000 | 0.6071 | 0.2795 | 0.4 | 0.8442 | 0.9270 | 0.9224 | 0.9577 | 0.9218 | 0.9224 |
102
- | 64.244 | 17.0 | 5695 | 59.4161 | 20.8124 | 15.0616 | 0.8161 | 0.0000 | 0.8652 | 0.0000 | 0.8377 | 0.0 | 0.8647 | 0.0 | 0.7669 | 0.5968 | 6.5894 | 2.0309 | 0.4225 | 0.0000 | 0.0025 | 0.9627 | 0.3790 | 0.0 | 0.0038 | 0.3345 | 0.6105 | 0.2865 | 0.2 | 0.8532 | 0.9330 | 0.9269 | 0.9602 | 0.9281 | 0.9251 |
103
- | 58.6111 | 18.0 | 6030 | 50.4291 | 20.8603 | 15.0851 | 0.7912 | 0.0000 | 0.8858 | 0.0000 | 0.8275 | 0.0 | 0.8853 | 0.0 | 0.7385 | 0.5433 | 6.4605 | 1.9479 | 0.2849 | 0.0000 | 0.0389 | 0.4623 | 0.2834 | 0.0 | 0.0399 | 0.0000 | 0.5563 | 0.1931 | 0.4 | 0.8501 | 0.9300 | 0.9254 | 0.9604 | 0.9249 | 0.9252 |
104
- | 62.5104 | 19.0 | 6365 | 54.3700 | 20.5895 | 15.0961 | 0.8146 | 0.0000 | 0.8748 | 0.0000 | 0.8292 | 0.0 | 0.8743 | 0.0 | 0.7544 | 0.5732 | 7.6391 | 2.5536 | 0.4540 | 0.0000 | 0.0057 | 0.9149 | 0.3874 | 0.0 | 0.0084 | 0.0331 | 0.6207 | 0.3054 | 0.2 | 0.8503 | 0.9298 | 0.9254 | 0.9589 | 0.9247 | 0.9256 |
105
- | 53.3151 | 20.0 | 6700 | 65.4108 | 21.4303 | 15.1844 | 0.8122 | 0.0000 | 0.8576 | 0.0000 | 0.8363 | 0.0 | 0.8570 | 0.0 | 0.7601 | 0.5839 | 7.6817 | 2.0759 | 0.4253 | 0.0000 | 0.0023 | 0.9661 | 0.3851 | 0.0 | 0.0045 | 0.2524 | 0.6095 | 0.2875 | 0.2 | 0.8499 | 0.9307 | 0.9254 | 0.9607 | 0.9254 | 0.9246 |
106
- | 52.6326 | 21.0 | 7035 | 57.9247 | 21.3383 | 15.1738 | 0.8166 | 0.0000 | 0.8729 | 0.0000 | 0.8425 | 0.0 | 0.8724 | 0.0 | 0.7625 | 0.5885 | 8.0444 | 2.3165 | 0.4459 | 0.0000 | 0.0050 | 0.9250 | 0.3999 | 0.0 | 0.0070 | 0.0781 | 0.6232 | 0.3145 | 0.2 | 0.8532 | 0.9313 | 0.9269 | 0.9603 | 0.9262 | 0.9270 |
107
- | 50.0562 | 22.0 | 7370 | 62.0895 | 21.2894 | 15.2472 | 0.8221 | 0.0000 | 0.8641 | 0.0000 | 0.8416 | 0.0 | 0.8636 | 0.0 | 0.7700 | 0.6026 | 9.1599 | 3.1065 | 0.4554 | 0.0000 | 0.0081 | 0.8781 | 0.3989 | 0.0 | 0.0117 | 0.0030 | 0.6195 | 0.3043 | 0.2 | 0.8318 | 0.9180 | 0.9149 | 0.9607 | 0.9148 | 0.9170 |
108
- | 56.5999 | 23.0 | 7705 | 62.2215 | 21.1505 | 15.1814 | 0.8122 | 0.0000 | 0.8623 | 0.0000 | 0.8353 | 0.0 | 0.8618 | 0.0 | 0.7620 | 0.5878 | 8.4019 | 3.0942 | 0.4443 | 0.0000 | 0.0048 | 0.9284 | 0.3853 | 0.0 | 0.0082 | 0.0370 | 0.6164 | 0.3011 | 0.2 | 0.8383 | 0.9242 | 0.9194 | 0.9554 | 0.9187 | 0.9196 |
109
- | 53.7667 | 24.0 | 8040 | 55.6119 | 21.4199 | 15.2341 | 0.8200 | 0.0000 | 0.8806 | 0.0000 | 0.8447 | 0.0 | 0.8801 | 0.0 | 0.7721 | 0.6064 | 8.8041 | 2.7849 | 0.4185 | 0.0000 | 0.0055 | 0.9178 | 0.3628 | 0.0 | 0.0068 | 0.0860 | 0.6060 | 0.2736 | 0.2 | 0.8575 | 0.9316 | 0.9284 | 0.9638 | 0.9277 | 0.9297 |
110
- | 55.2874 | 25.0 | 8375 | 53.2994 | 21.4082 | 15.2728 | 0.8226 | 0.0000 | 0.8843 | 0.0000 | 0.8452 | 0.0 | 0.8838 | 0.0 | 0.7635 | 0.5902 | 8.3370 | 2.6529 | 0.4833 | 0.0000 | 0.0080 | 0.8800 | 0.4159 | 0.0 | 0.0102 | 0.0095 | 0.6346 | 0.3311 | 0.2 | 0.8486 | 0.9272 | 0.9239 | 0.9601 | 0.9233 | 0.9253 |
111
- | 52.7689 | 26.0 | 8710 | 56.1448 | 20.4735 | 15.1217 | 0.8102 | 0.0000 | 0.8700 | 0.0000 | 0.8414 | 0.0 | 0.8694 | 0.0 | 0.7544 | 0.5731 | 8.0914 | 3.1033 | 0.3771 | 0.0000 | 0.0246 | 0.6429 | 0.3468 | 0.0 | 0.0253 | 0.0000 | 0.5911 | 0.2470 | 0.4 | 0.8544 | 0.9301 | 0.9269 | 0.9637 | 0.9263 | 0.9281 |
112
- | 63.7246 | 27.0 | 9045 | 50.1195 | 20.9362 | 15.3379 | 0.8064 | 0.0000 | 0.8868 | 0.0000 | 0.8305 | 0.0 | 0.8863 | 0.0 | 0.7433 | 0.5522 | 7.6153 | 2.7437 | 0.4014 | 0.0000 | 0.0053 | 0.9210 | 0.3470 | 0.0 | 0.0079 | 0.0446 | 0.5963 | 0.2688 | 0.4 | 0.8434 | 0.9237 | 0.9209 | 0.9575 | 0.9207 | 0.9227 |
113
- | 54.7476 | 28.0 | 9380 | 54.0973 | 21.3115 | 15.1791 | 0.8024 | 0.0000 | 0.8816 | 0.0000 | 0.8283 | 0.0 | 0.8813 | 0.0 | 0.7629 | 0.5901 | 8.1671 | 2.4977 | 0.3366 | 0.0000 | 0.0703 | 0.1838 | 0.2930 | 0.0 | 0.0749 | 0.0000 | 0.5758 | 0.2231 | 0.4 | 0.8515 | 0.9286 | 0.9254 | 0.9587 | 0.9248 | 0.9267 |
114
- | 61.5874 | 29.0 | 9715 | 65.5835 | 21.4926 | 15.3861 | 0.8099 | 0.0000 | 0.8584 | 0.0000 | 0.8329 | 0.0 | 0.8578 | 0.0 | 0.7614 | 0.5865 | 9.1166 | 3.1876 | 0.3801 | 0.0000 | 0.0985 | 0.0622 | 0.3426 | 0.0 | 0.1006 | 0.0000 | 0.5929 | 0.2499 | 0.4 | 0.8390 | 0.9233 | 0.9194 | 0.9594 | 0.9187 | 0.9203 |
115
- | 51.6005 | 30.0 | 10050 | 56.6402 | 20.7856 | 15.1619 | 0.8152 | 0.0000 | 0.8713 | 0.0000 | 0.8409 | 0.0 | 0.8707 | 0.0 | 0.7646 | 0.5927 | 8.2733 | 3.1942 | 0.4333 | 0.0000 | 0.0048 | 0.9279 | 0.3937 | 0.0 | 0.0075 | 0.0561 | 0.6093 | 0.2853 | 0.4 | 0.8474 | 0.9281 | 0.9239 | 0.9589 | 0.9232 | 0.9242 |
116
- | 48.9879 | 31.0 | 10385 | 60.9067 | 21.2038 | 15.2413 | 0.8397 | 0.0000 | 0.8648 | 0.0000 | 0.8531 | 0.0 | 0.8642 | 0.0 | 0.7900 | 0.6394 | 8.3183 | 2.7079 | 0.4896 | 0.0000 | 0.0342 | 0.5183 | 0.4201 | 0.0 | 0.0365 | 0.0000 | 0.6372 | 0.3370 | 0.4 | 0.8333 | 0.9202 | 0.9164 | 0.9633 | 0.9158 | 0.9175 |
117
- | 55.7125 | 32.0 | 10720 | 57.9097 | 21.4193 | 15.2791 | 0.8273 | 0.0000 | 0.8741 | 0.0000 | 0.8497 | 0.0 | 0.8736 | 0.0 | 0.7715 | 0.6052 | 7.8629 | 2.3403 | 0.4635 | 0.0000 | 0.0572 | 0.2798 | 0.3974 | 0.0 | 0.0599 | 0.0000 | 0.6247 | 0.3155 | 0.4 | 0.8473 | 0.9283 | 0.9239 | 0.9628 | 0.9233 | 0.9240 |
118
- | 60.5285 | 33.0 | 11055 | 62.4735 | 21.3499 | 15.2429 | 0.8199 | 0.0000 | 0.8639 | 0.0000 | 0.8440 | 0.0 | 0.8634 | 0.0 | 0.7620 | 0.5875 | 9.1004 | 2.9950 | 0.4508 | 0.0000 | 0.0161 | 0.7614 | 0.3887 | 0.0 | 0.0183 | 0.0000 | 0.6166 | 0.2994 | 0.4 | 0.8342 | 0.9195 | 0.9164 | 0.9609 | 0.9161 | 0.9181 |
119
- | 55.3806 | 34.0 | 11390 | 56.5118 | 21.1548 | 15.1196 | 0.8325 | 0.0000 | 0.8740 | 0.0000 | 0.8551 | 0.0 | 0.8735 | 0.0 | 0.7791 | 0.6194 | 7.2966 | 2.1298 | 0.4622 | 0.0000 | 0.0063 | 0.9048 | 0.4122 | 0.0 | 0.0108 | 0.0060 | 0.6271 | 0.3140 | 0.4 | 0.8380 | 0.9248 | 0.9194 | 0.9664 | 0.9192 | 0.9188 |
120
- | 57.9875 | 35.0 | 11725 | 54.0233 | 21.2545 | 15.1622 | 0.8280 | 0.0000 | 0.8805 | 0.0000 | 0.8465 | 0.0 | 0.8800 | 0.0 | 0.7820 | 0.6250 | 7.6709 | 2.1446 | 0.4595 | 0.0000 | 0.0083 | 0.8749 | 0.3976 | 0.0 | 0.0112 | 0.0044 | 0.6215 | 0.3099 | 0.01 | 0.8622 | 0.9356 | 0.9313 | 0.9586 | 0.9307 | 0.9314 |
121
- | 43.8834 | 36.0 | 12060 | 59.9911 | 21.5559 | 15.3585 | 0.8213 | 0.0000 | 0.8720 | 0.0000 | 0.8417 | 0.0 | 0.8714 | 0.0 | 0.7760 | 0.6139 | 8.6112 | 2.6475 | 0.4539 | 0.0000 | 0.0081 | 0.8787 | 0.3966 | 0.0 | 0.0099 | 0.0117 | 0.6199 | 0.3065 | 0.2 | 0.8421 | 0.9248 | 0.9209 | 0.9579 | 0.9202 | 0.9219 |
122
- | 54.8968 | 37.0 | 12395 | 56.4211 | 21.2404 | 15.1435 | 0.8093 | 0.0000 | 0.8752 | 0.0000 | 0.8327 | 0.0 | 0.8747 | 0.0 | 0.7642 | 0.5922 | 7.6588 | 2.2992 | 0.4005 | 0.0000 | 0.0066 | 0.9009 | 0.3630 | 0.0 | 0.0106 | 0.0074 | 0.6031 | 0.2768 | 0.2 | 0.8620 | 0.9359 | 0.9313 | 0.9556 | 0.9310 | 0.9310 |
123
- | 54.412 | 38.0 | 12730 | 57.2339 | 20.9691 | 15.0649 | 0.7953 | 0.0000 | 0.8716 | 0.0000 | 0.8251 | 0.0 | 0.8711 | 0.0 | 0.7487 | 0.5627 | 6.5231 | 1.7568 | 0.3864 | 0.0000 | 0.0008 | 0.9884 | 0.3428 | 0.0 | 0.0023 | 0.5639 | 0.5941 | 0.2544 | 0.2 | 0.8559 | 0.9337 | 0.9284 | 0.9518 | 0.9286 | 0.9273 |
124
- | 60.8498 | 39.0 | 13065 | 52.4076 | 21.2492 | 15.1106 | 0.8097 | 0.0000 | 0.8841 | 0.0000 | 0.8395 | 0.0 | 0.8837 | 0.0 | 0.7617 | 0.5871 | 6.5086 | 1.7126 | 0.3704 | 0.0000 | 0.0035 | 0.9478 | 0.3378 | 0.0 | 0.0058 | 0.1442 | 0.5932 | 0.2482 | 0.2 | 0.8709 | 0.9404 | 0.9358 | 0.9607 | 0.9358 | 0.9352 |
125
- | 48.3597 | 40.0 | 13400 | 54.8752 | 21.3058 | 15.1845 | 0.8181 | 0.0000 | 0.8794 | 0.0000 | 0.8427 | 0.0 | 0.8789 | 0.0 | 0.7641 | 0.5915 | 8.1292 | 2.3713 | 0.4172 | 0.0000 | 0.0053 | 0.9207 | 0.3761 | 0.0 | 0.0066 | 0.0943 | 0.6075 | 0.2746 | 0.4 | 0.8505 | 0.9294 | 0.9254 | 0.9614 | 0.9247 | 0.9258 |
126
- | 53.7717 | 41.0 | 13735 | 58.1622 | 21.3681 | 15.1438 | 0.7944 | 0.0000 | 0.8726 | 0.0000 | 0.8227 | 0.0 | 0.8721 | 0.0 | 0.7543 | 0.5735 | 7.6811 | 2.0589 | 0.3558 | 0.0000 | 0.0085 | 0.8728 | 0.3328 | 0.0 | 0.0116 | 0.0032 | 0.5827 | 0.2335 | 0.4 | 0.8530 | 0.9318 | 0.9269 | 0.9516 | 0.9268 | 0.9262 |
127
- | 51.1347 | 42.0 | 14070 | 57.8927 | 21.2590 | 15.1577 | 0.8291 | 0.0000 | 0.8723 | 0.0000 | 0.8473 | 0.0 | 0.8718 | 0.0 | 0.7792 | 0.6196 | 7.9015 | 2.4843 | 0.4812 | 0.0000 | 0.0188 | 0.7226 | 0.4137 | 0.0 | 0.0222 | 0.0000 | 0.6367 | 0.3323 | 0.4 | 0.8474 | 0.9281 | 0.9239 | 0.9602 | 0.9232 | 0.9242 |
128
- | 45.1383 | 43.0 | 14405 | 59.8290 | 21.3138 | 15.1740 | 0.8233 | 0.0000 | 0.8684 | 0.0000 | 0.8433 | 0.0 | 0.8680 | 0.0 | 0.7673 | 0.5973 | 7.4846 | 2.0562 | 0.4710 | 0.0000 | 0.0054 | 0.9191 | 0.4050 | 0.0 | 0.0094 | 0.0171 | 0.6255 | 0.3149 | 0.2 | 0.8560 | 0.9331 | 0.9284 | 0.9619 | 0.9280 | 0.9280 |
129
- | 54.4437 | 44.0 | 14740 | 55.3867 | 21.3368 | 15.1603 | 0.8212 | 0.0000 | 0.8787 | 0.0000 | 0.8435 | 0.0 | 0.8782 | 0.0 | 0.7724 | 0.6074 | 7.9487 | 2.3050 | 0.4251 | 0.0000 | 0.0052 | 0.9216 | 0.3705 | 0.0 | 0.0084 | 0.0335 | 0.6052 | 0.2785 | 0.2 | 0.8625 | 0.9352 | 0.9313 | 0.9608 | 0.9306 | 0.9318 |
130
- | 46.0371 | 45.0 | 15075 | 61.9422 | 21.3452 | 15.1292 | 0.8327 | 0.0000 | 0.8641 | 0.0000 | 0.8512 | 0.0 | 0.8635 | 0.0 | 0.7761 | 0.6136 | 7.5795 | 2.0567 | 0.4948 | 0.0000 | 0.0086 | 0.8713 | 0.4496 | 0.0 | 0.0127 | 0.0013 | 0.6387 | 0.3348 | 0.2 | 0.8469 | 0.9295 | 0.9239 | 0.9638 | 0.9240 | 0.9230 |
131
- | 45.723 | 46.0 | 15410 | 54.7004 | 21.3022 | 15.2025 | 0.8226 | 0.0000 | 0.8800 | 0.0000 | 0.8444 | 0.0 | 0.8796 | 0.0 | 0.7779 | 0.6172 | 7.7464 | 2.4347 | 0.4591 | 0.0000 | 0.0091 | 0.8632 | 0.4005 | 0.0 | 0.0130 | 0.0010 | 0.6265 | 0.3150 | 0.2 | 0.8621 | 0.9358 | 0.9313 | 0.9588 | 0.9308 | 0.9312 |
132
- | 48.362 | 47.0 | 15745 | 52.9488 | 21.0985 | 15.1012 | 0.8297 | 0.0000 | 0.8815 | 0.0000 | 0.8536 | 0.0 | 0.8810 | 0.0 | 0.7790 | 0.6190 | 6.4260 | 1.9105 | 0.4534 | 0.0000 | 0.0005 | 0.9922 | 0.4034 | 0.0 | 0.0035 | 0.3754 | 0.6235 | 0.3062 | 0.4 | 0.8623 | 0.9368 | 0.9313 | 0.9675 | 0.9325 | 0.9298 |
133
- | 53.9849 | 48.0 | 16080 | 53.1998 | 21.3395 | 15.1990 | 0.8153 | 0.0000 | 0.8832 | 0.0000 | 0.8418 | 0.0 | 0.8827 | 0.0 | 0.7724 | 0.6071 | 7.0947 | 2.0143 | 0.3917 | 0.0000 | 0.0068 | 0.8972 | 0.3557 | 0.0 | 0.0106 | 0.0073 | 0.6019 | 0.2709 | 0.2 | 0.8443 | 0.9270 | 0.9224 | 0.9626 | 0.9217 | 0.9226 |
134
- | 48.5875 | 49.0 | 16415 | 54.1833 | 21.3392 | 15.1277 | 0.8076 | 0.0000 | 0.8813 | 0.0000 | 0.8372 | 0.0 | 0.8808 | 0.0 | 0.7658 | 0.5948 | 6.4988 | 1.5921 | 0.3855 | 0.0000 | -0.0007 | 0.9891 | 0.3548 | 0.0 | 0.0031 | 0.4358 | 0.5953 | 0.2564 | 0.4 | 0.8500 | 0.9307 | 0.9254 | 0.9592 | 0.9256 | 0.9244 |
135
- | 54.4781 | 50.0 | 16750 | 54.9035 | 21.2363 | 15.1108 | 0.8199 | 0.0000 | 0.8784 | 0.0000 | 0.8457 | 0.0 | 0.8779 | 0.0 | 0.7710 | 0.6045 | 6.7205 | 1.8740 | 0.4327 | 0.0000 | -0.0011 | 0.9832 | 0.3670 | 0.0 | 0.0012 | 0.7681 | 0.6131 | 0.2939 | 0.2 | 0.8620 | 0.9366 | 0.9313 | 0.9605 | 0.9319 | 0.9301 |
136
- | 46.4441 | 51.0 | 17085 | 51.6975 | 21.2116 | 15.1089 | 0.8241 | 0.0000 | 0.8855 | 0.0000 | 0.8515 | 0.0 | 0.8850 | 0.0 | 0.7733 | 0.6087 | 6.6038 | 1.6621 | 0.4420 | 0.0000 | 0.0012 | 0.9817 | 0.3875 | 0.0 | 0.0029 | 0.4639 | 0.6124 | 0.2912 | 0.2 | 0.8650 | 0.9379 | 0.9328 | 0.9631 | 0.9332 | 0.9317 |
137
- | 52.9561 | 52.0 | 17420 | 55.3174 | 21.2995 | 15.1694 | 0.8300 | 0.0000 | 0.8781 | 0.0000 | 0.8499 | 0.0 | 0.8776 | 0.0 | 0.7799 | 0.6210 | 7.8041 | 2.1723 | 0.4514 | 0.0000 | 0.0056 | 0.9152 | 0.4012 | 0.0 | 0.0097 | 0.0143 | 0.6184 | 0.3055 | 0.2 | 0.8683 | 0.9382 | 0.9343 | 0.9662 | 0.9337 | 0.9346 |
138
- | 43.4503 | 53.0 | 17755 | 53.4019 | 21.3574 | 15.1562 | 0.8361 | 0.0000 | 0.8835 | 0.0000 | 0.8521 | 0.0 | 0.8830 | 0.0 | 0.7926 | 0.6442 | 6.3885 | 1.5308 | 0.4666 | 0.0000 | 0.0000 | 0.9998 | 0.4003 | 0.0 | 0.0027 | 0.4890 | 0.6273 | 0.3210 | 0.4 | 0.8593 | 0.9355 | 0.9299 | 0.9651 | 0.9311 | 0.9282 |
139
- | 53.99 | 54.0 | 18090 | 57.4518 | 21.3820 | 15.1513 | 0.8124 | 0.0000 | 0.8744 | 0.0000 | 0.8362 | 0.0 | 0.8739 | 0.0 | 0.7712 | 0.6052 | 7.8466 | 2.1545 | 0.3688 | 0.0000 | 0.0042 | 0.9368 | 0.3206 | 0.0 | 0.0078 | 0.0471 | 0.5816 | 0.2366 | 0.2 | 0.8560 | 0.9331 | 0.9284 | 0.9628 | 0.9280 | 0.9280 |
140
- | 46.2877 | 55.0 | 18425 | 59.2798 | 21.4106 | 15.1777 | 0.8342 | 0.0000 | 0.8710 | 0.0000 | 0.8515 | 0.0 | 0.8705 | 0.0 | 0.7824 | 0.6256 | 8.1904 | 2.3667 | 0.4828 | 0.0000 | 0.0064 | 0.9040 | 0.4131 | 0.0 | 0.0087 | 0.0283 | 0.6318 | 0.3304 | 0.2 | 0.8502 | 0.9300 | 0.9254 | 0.9644 | 0.9247 | 0.9254 |
141
- | 43.7411 | 56.0 | 18760 | 55.2774 | 21.3905 | 15.1523 | 0.8287 | 0.0000 | 0.8793 | 0.0000 | 0.8469 | 0.0 | 0.8788 | 0.0 | 0.7872 | 0.6342 | 7.7173 | 2.1072 | 0.4709 | 0.0000 | 0.0042 | 0.9368 | 0.4150 | 0.0 | 0.0072 | 0.0680 | 0.6328 | 0.3270 | 0.2 | 0.8561 | 0.9330 | 0.9284 | 0.9607 | 0.9279 | 0.9282 |
142
- | 51.0225 | 57.0 | 19095 | 56.0989 | 21.2936 | 15.1495 | 0.8248 | 0.0000 | 0.8765 | 0.0000 | 0.8506 | 0.0 | 0.8759 | 0.0 | 0.7758 | 0.6132 | 7.9607 | 2.2493 | 0.4798 | 0.0000 | 0.0055 | 0.9177 | 0.4288 | 0.0 | 0.0087 | 0.0267 | 0.6323 | 0.3281 | 0.2 | 0.8622 | 0.9356 | 0.9313 | 0.9600 | 0.9307 | 0.9314 |
143
- | 38.2293 | 58.0 | 19430 | 87.0866 | 21.1988 | 15.2452 | 0.8091 | 0.0000 | 0.8098 | 0.0000 | 0.8199 | 0.0 | 0.8093 | 0.0 | 0.7728 | 0.6085 | 11.2443 | 4.4305 | 0.4437 | 0.0000 | 0.0072 | 0.8922 | 0.3890 | 0.0 | 0.0119 | 0.0027 | 0.6138 | 0.3032 | 0.2 | 0.7863 | 0.8934 | 0.8910 | 0.9507 | 0.8923 | 0.8940 |
144
- | 44.9381 | 59.0 | 19765 | 54.9032 | 21.3287 | 15.1651 | 0.8460 | 0.0000 | 0.8794 | 0.0000 | 0.8612 | 0.0 | 0.8789 | 0.0 | 0.7988 | 0.6556 | 7.9361 | 2.1865 | 0.5124 | 0.0000 | 0.0052 | 0.9213 | 0.4574 | 0.0 | 0.0082 | 0.0386 | 0.6453 | 0.3585 | 0.2 | 0.8652 | 0.9369 | 0.9328 | 0.9647 | 0.9322 | 0.9330 |
145
- | 44.8122 | 60.0 | 20100 | 55.1868 | 21.2936 | 15.2443 | 0.8282 | 0.0000 | 0.8805 | 0.0000 | 0.8504 | 0.0 | 0.8800 | 0.0 | 0.7818 | 0.6247 | 8.5772 | 2.9936 | 0.4476 | 0.0000 | 0.0061 | 0.9081 | 0.3908 | 0.0 | 0.0083 | 0.0360 | 0.6186 | 0.3065 | 0.4 | 0.8569 | 0.9318 | 0.9284 | 0.9631 | 0.9277 | 0.9293 |
146
- | 46.9528 | 61.0 | 20435 | 55.5735 | 21.3973 | 15.1702 | 0.8166 | 0.0000 | 0.8790 | 0.0000 | 0.8380 | 0.0 | 0.8785 | 0.0 | 0.7803 | 0.6230 | 8.0359 | 2.2957 | 0.3598 | 0.0000 | 0.0053 | 0.9203 | 0.3327 | 0.0 | 0.0082 | 0.0369 | 0.5801 | 0.2402 | 0.2 | 0.8622 | 0.9356 | 0.9313 | 0.9622 | 0.9307 | 0.9314 |
147
 
148
 
149
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [facebook/esm2_t6_8M_UR50D](https://huggingface.co/facebook/esm2_t6_8M_UR50D) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 47.3436
22
+ - Rmse: 21.3763
23
+ - Mae: 15.1740
24
+ - Spearmanr Corr: 0.8503
25
  - Spearmanr Corr P Value: 0.0000
26
+ - Pearsonr Corr: 0.8965
27
  - Pearsonr Corr P Value: 0.0000
28
+ - Spearmanr Corr Of Deltas: 0.8677
29
  - Spearmanr Corr Of Deltas P Value: 0.0
30
+ - Pearsonr Corr Of Deltas: 0.8960
31
  - Pearsonr Corr Of Deltas P Value: 0.0
32
+ - Ranking F1 Score: 0.8086
33
+ - Ranking Mcc: 0.6729
34
+ - Rmse Enriched: 7.2264
35
+ - Mae Enriched: 1.8901
36
+ - Spearmanr Corr Enriched: 0.5019
37
  - Spearmanr Corr Enriched P Value: 0.0000
38
+ - Pearsonr Corr Enriched: 0.0060
39
+ - Pearsonr Corr Enriched P Value: 0.9100
40
+ - Spearmanr Corr Of Deltas Enriched: 0.4626
41
  - Spearmanr Corr Of Deltas Enriched P Value: 0.0
42
+ - Pearsonr Corr Of Deltas Enriched: 0.0076
43
+ - Pearsonr Corr Of Deltas Enriched P Value: 0.0536
44
+ - Ranking F1 Score Enriched: 0.6486
45
+ - Ranking Mcc Enriched: 0.3547
46
+ - Classification Thresh: 0.4
47
+ - Mcc: 0.8771
48
+ - F1 Score: 0.9425
49
+ - Acc: 0.9388
50
+ - Auc: 0.9676
51
+ - Precision: 0.9383
52
+ - Recall: 0.9388
53
 
54
  ## Model description
55
 
 
68
  ### Training hyperparameters
69
 
70
  The following hyperparameters were used during training:
71
+ - learning_rate: 1e-05
72
  - train_batch_size: 8
73
  - eval_batch_size: 8
74
  - seed: 42
 
83
 
84
  | Training Loss | Epoch | Step | Validation Loss | Rmse | Mae | Spearmanr Corr | Spearmanr Corr P Value | Pearsonr Corr | Pearsonr Corr P Value | Spearmanr Corr Of Deltas | Spearmanr Corr Of Deltas P Value | Pearsonr Corr Of Deltas | Pearsonr Corr Of Deltas P Value | Ranking F1 Score | Ranking Mcc | Rmse Enriched | Mae Enriched | Spearmanr Corr Enriched | Spearmanr Corr Enriched P Value | Pearsonr Corr Enriched | Pearsonr Corr Enriched P Value | Spearmanr Corr Of Deltas Enriched | Spearmanr Corr Of Deltas Enriched P Value | Pearsonr Corr Of Deltas Enriched | Pearsonr Corr Of Deltas Enriched P Value | Ranking F1 Score Enriched | Ranking Mcc Enriched | Classification Thresh | Mcc | F1 Score | Acc | Auc | Precision | Recall |
85
  |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:--------------:|:----------------------:|:-------------:|:---------------------:|:------------------------:|:--------------------------------:|:-----------------------:|:-------------------------------:|:----------------:|:-----------:|:-------------:|:------------:|:-----------------------:|:-------------------------------:|:----------------------:|:------------------------------:|:---------------------------------:|:-----------------------------------------:|:--------------------------------:|:----------------------------------------:|:-------------------------:|:--------------------:|:---------------------:|:------:|:--------:|:------:|:------:|:---------:|:------:|
86
+ | 369.4768 | 1.0 | 335 | 309.3104 | 17.9851 | 14.2134 | 0.7652 | 0.0000 | 0.7721 | 0.0000 | 0.7596 | 0.0 | 0.7711 | 0.0 | 0.7246 | 0.5167 | 3.8124 | 3.7847 | 0.3897 | 0.0000 | 0.0085 | 0.8722 | 0.3062 | 0.0 | 0.0104 | 0.0086 | 0.5909 | 0.2595 | 0.5 | 0.0 | 0.0 | 0.4672 | 0.9295 | 0.2336 | 0.5 |
87
+ | 348.3176 | 2.0 | 670 | 290.3025 | 18.2403 | 14.1929 | 0.7586 | 0.0000 | 0.7837 | 0.0000 | 0.7622 | 0.0 | 0.7827 | 0.0 | 0.7153 | 0.4989 | 2.7131 | 2.6103 | 0.2359 | 0.0000 | 0.0005 | 0.9921 | 0.2050 | 0.0 | 0.0019 | 0.6240 | 0.5377 | 0.1573 | 0.1 | 0.7794 | 0.9008 | 0.8896 | 0.9446 | 0.8935 | 0.8860 |
88
+ | 285.4549 | 3.0 | 1005 | 246.7634 | 18.4829 | 14.2268 | 0.8340 | 0.0000 | 0.8599 | 0.0000 | 0.8481 | 0.0 | 0.8593 | 0.0 | 0.7740 | 0.6098 | 2.2592 | 1.1205 | 0.4911 | 0.0000 | 0.0179 | 0.7352 | 0.4085 | 0.0 | 0.0188 | 0.0000 | 0.6377 | 0.3352 | 0.01 | 0.8174 | 0.9142 | 0.9090 | 0.9667 | 0.9082 | 0.9092 |
89
+ | 261.761 | 4.0 | 1340 | 223.3279 | 18.4437 | 14.2819 | 0.8369 | 0.0000 | 0.8756 | 0.0000 | 0.8491 | 0.0 | 0.8751 | 0.0 | 0.7781 | 0.6174 | 2.1556 | 0.9066 | 0.5069 | 0.0000 | 0.0162 | 0.7603 | 0.4102 | 0.0 | 0.0176 | 0.0000 | 0.6400 | 0.3421 | 0.2 | 0.8500 | 0.9311 | 0.9254 | 0.9670 | 0.9258 | 0.9241 |
90
+ | 234.6825 | 5.0 | 1675 | 192.8761 | 17.8226 | 14.3821 | 0.8398 | 0.0000 | 0.8664 | 0.0000 | 0.8564 | 0.0 | 0.8659 | 0.0 | 0.7834 | 0.6271 | 3.4683 | 2.0139 | 0.5033 | 0.0000 | 0.0245 | 0.6441 | 0.4034 | 0.0 | 0.0228 | 0.0000 | 0.6391 | 0.3390 | 0.01 | 0.7977 | 0.8939 | 0.8940 | 0.9695 | 0.8989 | 0.8987 |
91
+ | 202.2116 | 6.0 | 2010 | 172.1334 | 17.9694 | 14.4213 | 0.8554 | 0.0000 | 0.9027 | 0.0000 | 0.8648 | 0.0 | 0.9023 | 0.0 | 0.8153 | 0.6854 | 3.0619 | 1.4839 | 0.4866 | 0.0000 | 0.0241 | 0.6488 | 0.4006 | 0.0 | 0.0247 | 0.0000 | 0.6329 | 0.3262 | 0.2 | 0.8429 | 0.9213 | 0.9194 | 0.9702 | 0.9205 | 0.9224 |
92
+ | 187.7496 | 7.0 | 2345 | 159.0955 | 18.1593 | 14.4489 | 0.8507 | 0.0000 | 0.8982 | 0.0000 | 0.8622 | 0.0 | 0.8978 | 0.0 | 0.8058 | 0.6683 | 2.9097 | 1.0672 | 0.4686 | 0.0000 | 0.0140 | 0.7922 | 0.3883 | 0.0 | 0.0163 | 0.0000 | 0.6247 | 0.3125 | 0.4 | 0.8830 | 0.9456 | 0.9418 | 0.9698 | 0.9416 | 0.9414 |
93
+ | 175.2975 | 8.0 | 2680 | 148.1963 | 18.1536 | 14.4793 | 0.8486 | 0.0000 | 0.8872 | 0.0000 | 0.8586 | 0.0 | 0.8867 | 0.0 | 0.7988 | 0.6556 | 3.0788 | 1.1383 | 0.4657 | 0.0000 | 0.0123 | 0.8170 | 0.3897 | 0.0 | 0.0148 | 0.0002 | 0.6213 | 0.3064 | 0.2 | 0.8680 | 0.9394 | 0.9343 | 0.9723 | 0.9349 | 0.9331 |
94
+ | 145.5657 | 9.0 | 3015 | 126.9086 | 17.9591 | 14.5346 | 0.8640 | 0.0000 | 0.9017 | 0.0000 | 0.8663 | 0.0 | 0.9013 | 0.0 | 0.8259 | 0.7045 | 3.6195 | 1.5544 | 0.5056 | 0.0000 | 0.0114 | 0.8298 | 0.4182 | 0.0 | 0.0134 | 0.0007 | 0.6434 | 0.3460 | 0.1 | 0.8714 | 0.9395 | 0.9358 | 0.9694 | 0.9351 | 0.9362 |
95
+ | 143.0386 | 10.0 | 3350 | 113.5738 | 17.7073 | 14.6081 | 0.8751 | 0.0000 | 0.9018 | 0.0000 | 0.8747 | 0.0 | 0.9014 | 0.0 | 0.8360 | 0.7224 | 4.2095 | 2.3461 | 0.5327 | 0.0000 | 0.0124 | 0.8142 | 0.4317 | 0.0 | 0.0147 | 0.0002 | 0.6540 | 0.3666 | 0.01 | 0.8479 | 0.9246 | 0.9224 | 0.9719 | 0.9229 | 0.9250 |
96
+ | 124.8125 | 11.0 | 3685 | 110.7778 | 18.4408 | 14.6773 | 0.8430 | 0.0000 | 0.8939 | 0.0000 | 0.8570 | 0.0 | 0.8935 | 0.0 | 0.7967 | 0.6520 | 3.6093 | 1.1550 | 0.4303 | 0.0000 | 0.0052 | 0.9216 | 0.3573 | 0.0 | 0.0081 | 0.0405 | 0.6089 | 0.2842 | 0.01 | 0.8830 | 0.9462 | 0.9418 | 0.9712 | 0.9423 | 0.9407 |
97
+ | 108.0145 | 12.0 | 4020 | 107.6146 | 18.2662 | 14.6119 | 0.8153 | 0.0000 | 0.8758 | 0.0000 | 0.8373 | 0.0 | 0.8753 | 0.0 | 0.7782 | 0.6188 | 3.8224 | 1.4757 | 0.3161 | 0.0000 | 0.0083 | 0.8759 | 0.3035 | 0.0 | 0.0105 | 0.0080 | 0.5698 | 0.2096 | 0.2 | 0.8679 | 0.9391 | 0.9343 | 0.9635 | 0.9344 | 0.9336 |
98
+ | 104.4241 | 13.0 | 4355 | 88.3598 | 18.2895 | 14.6767 | 0.8644 | 0.0000 | 0.9018 | 0.0000 | 0.8661 | 0.0 | 0.9014 | 0.0 | 0.8274 | 0.7081 | 4.1833 | 1.6079 | 0.4677 | 0.0000 | 0.0128 | 0.8096 | 0.4002 | 0.0 | 0.0154 | 0.0001 | 0.6250 | 0.3123 | 0.01 | 0.8920 | 0.9497 | 0.9463 | 0.9692 | 0.9458 | 0.9462 |
99
+ | 96.8491 | 14.0 | 4690 | 80.2075 | 18.5707 | 14.7252 | 0.8666 | 0.0000 | 0.9020 | 0.0000 | 0.8677 | 0.0 | 0.9016 | 0.0 | 0.8324 | 0.7164 | 4.4905 | 1.3695 | 0.4673 | 0.0000 | 0.0082 | 0.8763 | 0.3966 | 0.0 | 0.0121 | 0.0022 | 0.6282 | 0.3176 | 0.1 | 0.8860 | 0.9471 | 0.9433 | 0.9727 | 0.9430 | 0.9430 |
100
+ | 80.8575 | 15.0 | 5025 | 81.6362 | 18.1417 | 14.8864 | 0.8610 | 0.0000 | 0.8440 | 0.0000 | 0.8408 | 0.0 | 0.8433 | 0.0 | 0.8265 | 0.7062 | 7.7838 | 3.9018 | 0.4464 | 0.0000 | 0.0238 | 0.6534 | 0.3784 | 0.0 | 0.0199 | 0.0000 | 0.6129 | 0.2909 | 0.01 | 0.7789 | 0.8719 | 0.8776 | 0.9720 | 0.8936 | 0.8854 |
101
+ | 80.7971 | 16.0 | 5360 | 73.6808 | 18.8265 | 14.7539 | 0.8511 | 0.0000 | 0.8909 | 0.0000 | 0.8587 | 0.0 | 0.8905 | 0.0 | 0.8130 | 0.6820 | 4.5753 | 1.3668 | 0.4417 | 0.0000 | 0.0070 | 0.8941 | 0.3749 | 0.0 | 0.0099 | 0.0118 | 0.6102 | 0.2887 | 0.1 | 0.8799 | 0.9446 | 0.9403 | 0.9692 | 0.9404 | 0.9396 |
102
+ | 72.952 | 17.0 | 5695 | 65.0194 | 18.8186 | 14.8172 | 0.8758 | 0.0000 | 0.8953 | 0.0000 | 0.8718 | 0.0 | 0.8950 | 0.0 | 0.8388 | 0.7283 | 5.2193 | 1.8669 | 0.5261 | 0.0000 | 0.0095 | 0.8575 | 0.4276 | 0.0 | 0.0134 | 0.0007 | 0.6503 | 0.3618 | 0.2 | 0.8742 | 0.9412 | 0.9373 | 0.9684 | 0.9367 | 0.9374 |
103
+ | 66.9172 | 18.0 | 6030 | 60.6609 | 19.2047 | 14.8782 | 0.8658 | 0.0000 | 0.9010 | 0.0000 | 0.8659 | 0.0 | 0.9006 | 0.0 | 0.8305 | 0.7133 | 4.9613 | 1.4022 | 0.4742 | 0.0000 | 0.0076 | 0.8862 | 0.3893 | 0.0 | 0.0105 | 0.0076 | 0.6297 | 0.3198 | 0.2 | 0.8799 | 0.9446 | 0.9403 | 0.9701 | 0.9404 | 0.9396 |
104
+ | 62.2077 | 19.0 | 6365 | 56.4374 | 19.3805 | 14.8951 | 0.8088 | 0.0000 | 0.9006 | 0.0000 | 0.8387 | 0.0 | 0.9001 | 0.0 | 0.7684 | 0.5998 | 5.3365 | 1.4111 | 0.2738 | 0.0000 | 0.0048 | 0.9276 | 0.2357 | 0.0 | 0.0073 | 0.0658 | 0.5606 | 0.1887 | 0.2 | 0.8770 | 0.9428 | 0.9388 | 0.9711 | 0.9384 | 0.9386 |
105
+ | 56.8277 | 20.0 | 6700 | 58.7119 | 19.4767 | 14.8582 | 0.8578 | 0.0000 | 0.8919 | 0.0000 | 0.8682 | 0.0 | 0.8915 | 0.0 | 0.8095 | 0.6746 | 4.9497 | 1.2669 | 0.4991 | 0.0000 | 0.0038 | 0.9435 | 0.4194 | 0.0 | 0.0075 | 0.0572 | 0.6406 | 0.3396 | 0.2 | 0.8801 | 0.9451 | 0.9403 | 0.9760 | 0.9412 | 0.9389 |
106
+ | 54.5262 | 21.0 | 7035 | 62.3813 | 19.7067 | 14.8882 | 0.8480 | 0.0000 | 0.8803 | 0.0000 | 0.8515 | 0.0 | 0.8798 | 0.0 | 0.8147 | 0.6846 | 4.8119 | 1.1526 | 0.4677 | 0.0000 | 0.0023 | 0.9656 | 0.3986 | 0.0 | 0.0057 | 0.1482 | 0.6249 | 0.3116 | 0.01 | 0.8656 | 0.9388 | 0.9328 | 0.9652 | 0.9350 | 0.9307 |
107
+ | 49.6793 | 22.0 | 7370 | 48.1350 | 19.7858 | 14.9826 | 0.8328 | 0.0000 | 0.9013 | 0.0000 | 0.8465 | 0.0 | 0.9009 | 0.0 | 0.8021 | 0.6622 | 6.0150 | 1.6723 | 0.3468 | 0.0000 | 0.0055 | 0.9173 | 0.3021 | 0.0 | 0.0082 | 0.0387 | 0.5826 | 0.2311 | 0.2 | 0.8774 | 0.9423 | 0.9388 | 0.9691 | 0.9381 | 0.9392 |
108
+ | 46.8797 | 23.0 | 7705 | 47.1256 | 19.4271 | 14.9916 | 0.8482 | 0.0000 | 0.9009 | 0.0000 | 0.8579 | 0.0 | 0.9005 | 0.0 | 0.8124 | 0.6805 | 6.0228 | 2.7003 | 0.4275 | 0.0000 | 0.0182 | 0.7309 | 0.3703 | 0.0 | 0.0219 | 0.0000 | 0.6099 | 0.2839 | 0.1 | 0.8247 | 0.9099 | 0.9090 | 0.9707 | 0.9118 | 0.9129 |
109
+ | 47.5216 | 24.0 | 8040 | 52.0719 | 19.9818 | 14.9435 | 0.8290 | 0.0000 | 0.8907 | 0.0000 | 0.8438 | 0.0 | 0.8903 | 0.0 | 0.7941 | 0.6475 | 5.4359 | 1.4249 | 0.3529 | 0.0000 | 0.0064 | 0.9043 | 0.3122 | 0.0 | 0.0106 | 0.0074 | 0.5861 | 0.2332 | 0.2 | 0.8740 | 0.9420 | 0.9373 | 0.9673 | 0.9376 | 0.9363 |
110
+ | 45.7938 | 25.0 | 8375 | 58.8807 | 20.2165 | 15.0312 | 0.8456 | 0.0000 | 0.8770 | 0.0000 | 0.8548 | 0.0 | 0.8765 | 0.0 | 0.8027 | 0.6623 | 5.1704 | 1.3739 | 0.4375 | 0.0000 | 0.0067 | 0.8990 | 0.3757 | 0.0 | 0.0094 | 0.0168 | 0.6180 | 0.2933 | 0.01 | 0.8627 | 0.9375 | 0.9313 | 0.9734 | 0.9337 | 0.9291 |
111
+ | 44.8508 | 26.0 | 8710 | 58.7849 | 19.8825 | 14.9498 | 0.8244 | 0.0000 | 0.8709 | 0.0000 | 0.8407 | 0.0 | 0.8703 | 0.0 | 0.7720 | 0.6060 | 5.0925 | 1.9843 | 0.4086 | 0.0000 | 0.0061 | 0.9089 | 0.3614 | 0.0 | 0.0082 | 0.0375 | 0.6093 | 0.2800 | 0.2 | 0.8504 | 0.9319 | 0.9254 | 0.9695 | 0.9272 | 0.9233 |
112
+ | 45.6247 | 27.0 | 9045 | 46.7955 | 20.2897 | 15.0193 | 0.8255 | 0.0000 | 0.8953 | 0.0000 | 0.8372 | 0.0 | 0.8948 | 0.0 | 0.8058 | 0.6699 | 6.0373 | 1.8172 | 0.2721 | 0.0000 | 0.0074 | 0.8884 | 0.2716 | 0.0 | 0.0101 | 0.0104 | 0.5578 | 0.1833 | 0.1 | 0.8709 | 0.9405 | 0.9358 | 0.9670 | 0.9360 | 0.9350 |
113
+ | 39.1753 | 28.0 | 9380 | 41.0914 | 20.5417 | 15.1406 | 0.8576 | 0.0000 | 0.9072 | 0.0000 | 0.8630 | 0.0 | 0.9068 | 0.0 | 0.8242 | 0.7016 | 6.6642 | 2.0166 | 0.4555 | 0.0000 | 0.0092 | 0.8616 | 0.3867 | 0.0 | 0.0106 | 0.0073 | 0.6257 | 0.3097 | 0.2 | 0.8754 | 0.9402 | 0.9373 | 0.9689 | 0.9367 | 0.9387 |
114
+ | 43.4112 | 29.0 | 9715 | 40.4185 | 20.5776 | 15.0852 | 0.8293 | 0.0000 | 0.9081 | 0.0000 | 0.8492 | 0.0 | 0.9077 | 0.0 | 0.7968 | 0.6523 | 6.6227 | 1.9815 | 0.3055 | 0.0000 | 0.0050 | 0.9246 | 0.2826 | 0.0 | 0.0084 | 0.0338 | 0.5722 | 0.2046 | 0.2 | 0.8837 | 0.9448 | 0.9418 | 0.9734 | 0.9411 | 0.9427 |
115
+ | 38.2707 | 30.0 | 10050 | 62.5598 | 20.8173 | 15.0316 | 0.8236 | 0.0000 | 0.8643 | 0.0000 | 0.8368 | 0.0 | 0.8637 | 0.0 | 0.7912 | 0.6418 | 5.0745 | 1.1496 | 0.4186 | 0.0000 | 0.0034 | 0.9484 | 0.3686 | 0.0 | 0.0049 | 0.2127 | 0.6094 | 0.2775 | 0.01 | 0.8393 | 0.9272 | 0.9194 | 0.9601 | 0.9230 | 0.9164 |
116
+ | 38.1543 | 31.0 | 10385 | 39.7963 | 21.0407 | 15.2279 | 0.8319 | 0.0000 | 0.9114 | 0.0000 | 0.8456 | 0.0 | 0.9110 | 0.0 | 0.8080 | 0.6733 | 6.3704 | 1.7422 | 0.3041 | 0.0000 | 0.0038 | 0.9427 | 0.2811 | 0.0 | 0.0080 | 0.0414 | 0.5712 | 0.2045 | 0.4 | 0.8802 | 0.9438 | 0.9403 | 0.9679 | 0.9398 | 0.9404 |
117
+ | 42.8516 | 32.0 | 10720 | 47.2133 | 20.9678 | 15.0749 | 0.8012 | 0.0000 | 0.8942 | 0.0000 | 0.8253 | 0.0 | 0.8938 | 0.0 | 0.7815 | 0.6256 | 6.0356 | 1.5292 | 0.2461 | 0.0000 | 0.0017 | 0.9740 | 0.2325 | 0.0 | 0.0047 | 0.2351 | 0.5484 | 0.1655 | 0.4 | 0.8650 | 0.9374 | 0.9328 | 0.9579 | 0.9328 | 0.9322 |
118
+ | 39.1913 | 33.0 | 11055 | 43.6899 | 21.1907 | 15.1544 | 0.8333 | 0.0000 | 0.9029 | 0.0000 | 0.8433 | 0.0 | 0.9026 | 0.0 | 0.8113 | 0.6799 | 6.9763 | 1.8354 | 0.2940 | 0.0000 | 0.0046 | 0.9304 | 0.2785 | 0.0 | 0.0088 | 0.0261 | 0.5661 | 0.1967 | 0.2 | 0.8863 | 0.9466 | 0.9433 | 0.9678 | 0.9426 | 0.9436 |
119
+ | 38.1537 | 34.0 | 11390 | 42.9613 | 21.2545 | 15.1299 | 0.8310 | 0.0000 | 0.9051 | 0.0000 | 0.8490 | 0.0 | 0.9048 | 0.0 | 0.8039 | 0.6660 | 6.3446 | 1.5218 | 0.3169 | 0.0000 | 0.0027 | 0.9592 | 0.2993 | 0.0 | 0.0077 | 0.0505 | 0.5731 | 0.2174 | 0.1 | 0.8889 | 0.9487 | 0.9448 | 0.9700 | 0.9448 | 0.9442 |
120
+ | 37.3493 | 35.0 | 11725 | 38.6112 | 21.3607 | 15.2129 | 0.8185 | 0.0000 | 0.9169 | 0.0000 | 0.8503 | 0.0 | 0.9166 | 0.0 | 0.7816 | 0.6250 | 7.6285 | 2.2004 | 0.3052 | 0.0000 | 0.0044 | 0.9335 | 0.2863 | 0.0 | 0.0057 | 0.1520 | 0.5739 | 0.2188 | 0.2 | 0.8797 | 0.9410 | 0.9388 | 0.9712 | 0.9387 | 0.9410 |
121
+ | 33.7528 | 36.0 | 12060 | 38.6323 | 21.3682 | 15.1603 | 0.8426 | 0.0000 | 0.9156 | 0.0000 | 0.8683 | 0.0 | 0.9153 | 0.0 | 0.7984 | 0.6546 | 6.8130 | 1.6994 | 0.4313 | 0.0000 | 0.0005 | 0.9929 | 0.3897 | 0.0 | 0.0043 | 0.2720 | 0.6175 | 0.2959 | 0.2 | 0.9012 | 0.9537 | 0.9507 | 0.9746 | 0.9502 | 0.9510 |
122
+ | 41.6965 | 37.0 | 12395 | 38.3068 | 21.3550 | 15.1869 | 0.8450 | 0.0000 | 0.9169 | 0.0000 | 0.8672 | 0.0 | 0.9165 | 0.0 | 0.7996 | 0.6569 | 7.3289 | 2.0281 | 0.4395 | 0.0000 | 0.0033 | 0.9501 | 0.3784 | 0.0 | 0.0051 | 0.1992 | 0.6216 | 0.3097 | 0.2 | 0.8902 | 0.9474 | 0.9448 | 0.9749 | 0.9441 | 0.9461 |
123
+ | 36.2383 | 38.0 | 12730 | 45.3013 | 21.3023 | 15.1144 | 0.8441 | 0.0000 | 0.9003 | 0.0000 | 0.8552 | 0.0 | 0.8998 | 0.0 | 0.8177 | 0.6903 | 6.2362 | 1.5103 | 0.4335 | 0.0000 | 0.0005 | 0.9924 | 0.4016 | 0.0 | 0.0037 | 0.3462 | 0.6162 | 0.2962 | 0.2 | 0.8800 | 0.9448 | 0.9403 | 0.9652 | 0.9406 | 0.9393 |
124
+ | 35.4234 | 39.0 | 13065 | 45.0533 | 21.3658 | 15.1439 | 0.8570 | 0.0000 | 0.9014 | 0.0000 | 0.8634 | 0.0 | 0.9010 | 0.0 | 0.8220 | 0.6974 | 6.3186 | 1.4889 | 0.4809 | 0.0000 | 0.0021 | 0.9677 | 0.4335 | 0.0 | 0.0061 | 0.1195 | 0.6353 | 0.3305 | 0.2 | 0.8889 | 0.9487 | 0.9448 | 0.9692 | 0.9448 | 0.9442 |
125
+ | 30.5131 | 40.0 | 13400 | 47.3436 | 21.3763 | 15.1740 | 0.8503 | 0.0000 | 0.8965 | 0.0000 | 0.8677 | 0.0 | 0.8960 | 0.0 | 0.8086 | 0.6729 | 7.2264 | 1.8901 | 0.5019 | 0.0000 | 0.0060 | 0.9100 | 0.4626 | 0.0 | 0.0076 | 0.0536 | 0.6486 | 0.3547 | 0.4 | 0.8771 | 0.9425 | 0.9388 | 0.9676 | 0.9383 | 0.9388 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
126
 
127
 
128
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9de58043ece46319f1b9d36850fbd186fae5363cc52d005e281fe6cb629e44e0
3
  size 31374504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b555a96deb8863d5ad7316a42c908747287d068dac562763c0321f3dde258af
3
  size 31374504
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1689c000800f072a29aaa75dfc834ed916fdf091865edba14606af61d6bf7fe1
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3975fd3844be5b180f560f79ac7e1d209ccde4d15a2eb6e86604e3b8fff0c083
3
  size 5304