elodiesune commited on
Commit
bbca222
·
verified ·
1 Parent(s): b9b315f

Model save

Browse files
Files changed (3) hide show
  1. README.md +62 -61
  2. adapter_config.json +1 -1
  3. adapter_model.safetensors +2 -2
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  license: mit
3
- base_model: facebook/esm2_t30_150M_UR50D
4
  tags:
5
  - generated_from_trainer
6
  metrics:
@@ -17,40 +17,40 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  # esm_ft_Aerin_Yang_et_al_2023
19
 
20
- This model is a fine-tuned version of [facebook/esm2_t30_150M_UR50D](https://huggingface.co/facebook/esm2_t30_150M_UR50D) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.1728
23
- - Rmse: 1.3028
24
- - Mae: 0.9658
25
- - Spearmanr Corr: 0.8386
26
  - Spearmanr Corr P Value: 0.0000
27
- - Pearsonr Corr: 0.8986
28
  - Pearsonr Corr P Value: 0.0000
29
- - Spearmanr Corr Of Deltas: 0.8694
30
  - Spearmanr Corr Of Deltas P Value: 0.0
31
- - Pearsonr Corr Of Deltas: 0.8981
32
  - Pearsonr Corr Of Deltas P Value: 0.0
33
- - Ranking F1 Score: 0.7412
34
- - Ranking Mcc: 0.5952
35
- - Rmse Enriched: 0.3720
36
- - Mae Enriched: 0.1104
37
- - Spearmanr Corr Enriched: -0.0916
38
- - Spearmanr Corr Enriched P Value: 0.1104
39
- - Pearsonr Corr Enriched: 0.0130
40
- - Pearsonr Corr Enriched P Value: 0.8214
41
- - Spearmanr Corr Of Deltas Enriched: -0.0709
42
  - Spearmanr Corr Of Deltas Enriched P Value: 0.0000
43
- - Pearsonr Corr Of Deltas Enriched: 0.0086
44
- - Pearsonr Corr Of Deltas Enriched P Value: 0.0648
45
- - Ranking F1 Score Enriched: 0.0026
46
- - Ranking Mcc Enriched: -0.0434
47
  - Classification Thresh: 0.01
48
- - Mcc: 0.9011
49
- - F1 Score: 0.9465
50
- - Acc: 0.9507
51
- - Auc: 0.9728
52
- - Precision: 0.9498
53
- - Recall: 0.9513
54
 
55
  ## Model description
56
 
@@ -84,39 +84,40 @@ The following hyperparameters were used during training:
84
 
85
  | Training Loss | Epoch | Step | Validation Loss | Rmse | Mae | Spearmanr Corr | Spearmanr Corr P Value | Pearsonr Corr | Pearsonr Corr P Value | Spearmanr Corr Of Deltas | Spearmanr Corr Of Deltas P Value | Pearsonr Corr Of Deltas | Pearsonr Corr Of Deltas P Value | Ranking F1 Score | Ranking Mcc | Rmse Enriched | Mae Enriched | Spearmanr Corr Enriched | Spearmanr Corr Enriched P Value | Pearsonr Corr Enriched | Pearsonr Corr Enriched P Value | Spearmanr Corr Of Deltas Enriched | Spearmanr Corr Of Deltas Enriched P Value | Pearsonr Corr Of Deltas Enriched | Pearsonr Corr Of Deltas Enriched P Value | Ranking F1 Score Enriched | Ranking Mcc Enriched | Classification Thresh | Mcc | F1 Score | Acc | Auc | Precision | Recall |
86
  |:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:--------------:|:----------------------:|:-------------:|:---------------------:|:------------------------:|:--------------------------------:|:-----------------------:|:-------------------------------:|:----------------:|:-----------:|:-------------:|:------------:|:-----------------------:|:-------------------------------:|:----------------------:|:------------------------------:|:---------------------------------:|:-----------------------------------------:|:--------------------------------:|:----------------------------------------:|:-------------------------:|:--------------------:|:---------------------:|:------:|:--------:|:------:|:------:|:---------:|:------:|
87
- | 0.5162 | 1.0 | 335 | 0.2852 | 1.2856 | 0.9569 | 0.8084 | 0.0000 | 0.8324 | 0.0000 | 0.8270 | 0.0 | 0.8316 | 0.0 | 0.7284 | 0.5730 | 0.6156 | 0.2855 | -0.0085 | 0.8820 | 0.0316 | 0.5820 | 0.0028 | 0.5496 | 0.0279 | 0.0000 | 0.0078 | -0.0009 | 0.1 | 0.8137 | 0.8953 | 0.9075 | 0.9633 | 0.9095 | 0.9043 |
88
- | 0.3027 | 2.0 | 670 | 0.3118 | 1.2828 | 0.9520 | 0.8183 | 0.0000 | 0.8169 | 0.0000 | 0.8109 | 0.0 | 0.8160 | 0.0 | 0.7383 | 0.5897 | 0.7230 | 0.3795 | -0.0794 | 0.1668 | -0.0686 | 0.2326 | -0.0808 | 0.0000 | -0.0742 | 0.0000 | 0.0028 | -0.0372 | 0.01 | 0.8007 | 0.8794 | 0.8985 | 0.9649 | 0.9094 | 0.8915 |
89
- | 0.1994 | 3.0 | 1005 | 0.1613 | 1.2034 | 0.9331 | 0.8524 | 0.0000 | 0.9058 | 0.0000 | 0.8727 | 0.0 | 0.9053 | 0.0 | 0.7601 | 0.6268 | 0.3792 | 0.2711 | -0.0171 | 0.7665 | 0.0060 | 0.9165 | -0.0288 | 0.0000 | 0.0008 | 0.8696 | 0.0071 | -0.0060 | 0.3 | 0.9040 | 0.9481 | 0.9522 | 0.9801 | 0.9513 | 0.9527 |
90
- | 0.1951 | 4.0 | 1340 | 0.2470 | 1.2992 | 0.9684 | 0.8477 | 0.0000 | 0.8542 | 0.0000 | 0.8546 | 0.0 | 0.8535 | 0.0 | 0.7577 | 0.6228 | 0.5917 | 0.2889 | -0.0355 | 0.5365 | 0.0257 | 0.6547 | -0.0271 | 0.0000 | 0.0203 | 0.0000 | 0.0053 | -0.0188 | 0.01 | 0.8275 | 0.9 | 0.9134 | 0.9779 | 0.9188 | 0.9087 |
91
- | 0.1971 | 5.0 | 1675 | 0.1511 | 1.2492 | 0.9439 | 0.8494 | 0.0000 | 0.9128 | 0.0000 | 0.8738 | 0.0 | 0.9124 | 0.0 | 0.7569 | 0.6215 | 0.2404 | 0.1033 | 0.0514 | 0.3706 | 0.0279 | 0.6277 | 0.0405 | 0.0000 | 0.0230 | 0.0000 | 0.0098 | 0.0131 | 0.2 | 0.9143 | 0.9537 | 0.9567 | 0.9807 | 0.9557 | 0.9587 |
92
- | 0.1711 | 6.0 | 2010 | 0.1540 | 1.2843 | 0.9655 | 0.8540 | 0.0000 | 0.9079 | 0.0000 | 0.8798 | 0.0 | 0.9075 | 0.0 | 0.7583 | 0.6241 | 0.2942 | 0.1160 | -0.0307 | 0.5935 | 0.0134 | 0.8151 | -0.0127 | 0.0061 | 0.0086 | 0.0647 | 0.0053 | -0.0194 | 0.4 | 0.9075 | 0.9501 | 0.9537 | 0.9808 | 0.9526 | 0.9548 |
93
- | 0.165 | 7.0 | 2345 | 0.1893 | 1.3300 | 0.9922 | 0.8536 | 0.0000 | 0.8934 | 0.0000 | 0.8751 | 0.0 | 0.8929 | 0.0 | 0.7569 | 0.6217 | 0.4441 | 0.1889 | 0.0148 | 0.7973 | 0.0270 | 0.6383 | 0.0189 | 0.0000 | 0.0222 | 0.0000 | 0.0082 | 0.0018 | 0.3 | 0.8707 | 0.9282 | 0.9358 | 0.9802 | 0.9369 | 0.9338 |
94
- | 0.1571 | 8.0 | 2680 | 0.1426 | 1.2767 | 0.9547 | 0.8633 | 0.0000 | 0.9142 | 0.0000 | 0.8830 | 0.0 | 0.9138 | 0.0 | 0.7623 | 0.6309 | 0.3855 | 0.1532 | 0.0358 | 0.5339 | 0.0280 | 0.6264 | 0.0313 | 0.0000 | 0.0219 | 0.0000 | 0.0108 | 0.0210 | 0.1 | 0.9037 | 0.9472 | 0.9522 | 0.9853 | 0.9524 | 0.9513 |
95
- | 0.1442 | 9.0 | 3015 | 0.1872 | 1.2213 | 0.9337 | 0.8584 | 0.0000 | 0.8875 | 0.0000 | 0.8692 | 0.0 | 0.8870 | 0.0 | 0.7571 | 0.6221 | 0.5023 | 0.2909 | -0.0113 | 0.8441 | 0.0298 | 0.6041 | 0.0127 | 0.0064 | 0.0248 | 0.0000 | 0.0069 | -0.0082 | 0.01 | 0.8624 | 0.9220 | 0.9313 | 0.9812 | 0.9343 | 0.9281 |
96
- | 0.1494 | 10.0 | 3350 | 0.2390 | 1.2466 | 0.9527 | 0.8487 | 0.0000 | 0.8676 | 0.0000 | 0.8640 | 0.0 | 0.8670 | 0.0 | 0.7488 | 0.6081 | 0.1804 | 0.0791 | 0.0196 | 0.7330 | 0.0234 | 0.6838 | 0.0274 | 0.0000 | 0.0202 | 0.0000 | 0.0089 | 0.0070 | 0.4 | 0.8580 | 0.9238 | 0.9269 | 0.9819 | 0.9273 | 0.9307 |
97
- | 0.1424 | 11.0 | 3685 | 0.1604 | 1.3387 | 1.0121 | 0.8555 | 0.0000 | 0.9112 | 0.0000 | 0.8795 | 0.0 | 0.9108 | 0.0 | 0.7557 | 0.6200 | 0.3634 | 0.1631 | 0.0065 | 0.9105 | 0.0263 | 0.6476 | 0.0233 | 0.0000 | 0.0211 | 0.0000 | 0.0082 | 0.0018 | 0.01 | 0.9099 | 0.9511 | 0.9552 | 0.9810 | 0.9545 | 0.9554 |
98
- | 0.12 | 12.0 | 4020 | 0.1595 | 1.2786 | 0.9681 | 0.8436 | 0.0000 | 0.9038 | 0.0000 | 0.8707 | 0.0 | 0.9034 | 0.0 | 0.7483 | 0.6073 | 0.2999 | 0.1458 | -0.0519 | 0.3663 | 0.0053 | 0.9269 | -0.0344 | 0.0000 | -0.0008 | 0.8650 | 0.0043 | -0.0272 | 0.2 | 0.8957 | 0.9438 | 0.9478 | 0.9759 | 0.9466 | 0.9491 |
99
- | 0.1199 | 13.0 | 4355 | 0.1686 | 1.2740 | 0.9607 | 0.8401 | 0.0000 | 0.9009 | 0.0000 | 0.8731 | 0.0 | 0.9005 | 0.0 | 0.7398 | 0.5937 | 0.2809 | 0.0982 | 0.0065 | 0.9105 | 0.0209 | 0.7158 | 0.0190 | 0.0000 | 0.0187 | 0.0001 | 0.0075 | -0.0039 | 0.01 | 0.8989 | 0.9455 | 0.9493 | 0.9693 | 0.9481 | 0.9507 |
100
- | 0.0934 | 14.0 | 4690 | 0.1372 | 1.2580 | 0.9506 | 0.8541 | 0.0000 | 0.9173 | 0.0000 | 0.8824 | 0.0 | 0.9169 | 0.0 | 0.7525 | 0.6147 | 0.3460 | 0.1746 | -0.0053 | 0.9265 | 0.0223 | 0.6987 | 0.0109 | 0.0194 | 0.0171 | 0.0002 | 0.0071 | -0.0064 | 0.1 | 0.9127 | 0.9524 | 0.9567 | 0.9792 | 0.9565 | 0.9562 |
101
- | 0.0804 | 15.0 | 5025 | 0.1531 | 1.2754 | 0.9560 | 0.8401 | 0.0000 | 0.9082 | 0.0000 | 0.8716 | 0.0 | 0.9078 | 0.0 | 0.7471 | 0.6055 | 0.2932 | 0.1089 | 0.0302 | 0.5991 | 0.0233 | 0.6858 | 0.0306 | 0.0000 | 0.0190 | 0.0000 | 0.0087 | 0.0057 | 0.01 | 0.9052 | 0.9489 | 0.9522 | 0.9728 | 0.9512 | 0.9540 |
102
- | 0.0868 | 16.0 | 5360 | 0.1867 | 1.2772 | 0.9579 | 0.8370 | 0.0000 | 0.8870 | 0.0000 | 0.8565 | 0.0 | 0.8865 | 0.0 | 0.7476 | 0.6061 | 0.4502 | 0.1918 | 0.0337 | 0.5579 | 0.0327 | 0.5696 | 0.0343 | 0.0000 | 0.0295 | 0.0000 | 0.0090 | 0.0080 | 0.0 | 0.8798 | 0.9331 | 0.9403 | 0.9696 | 0.9416 | 0.9382 |
103
- | 0.0666 | 17.0 | 5695 | 0.1774 | 1.3111 | 0.9789 | 0.8204 | 0.0000 | 0.8983 | 0.0000 | 0.8581 | 0.0 | 0.8979 | 0.0 | 0.7368 | 0.5877 | 0.2841 | 0.0976 | -0.0694 | 0.2266 | 0.0111 | 0.8472 | -0.0382 | 0.0000 | 0.0085 | 0.0673 | 0.0039 | -0.0306 | 0.2 | 0.8992 | 0.9457 | 0.9493 | 0.9647 | 0.9482 | 0.9510 |
104
- | 0.0676 | 18.0 | 6030 | 0.1853 | 1.2767 | 0.9584 | 0.8402 | 0.0000 | 0.8879 | 0.0000 | 0.8620 | 0.0 | 0.8874 | 0.0 | 0.7505 | 0.6106 | 0.4225 | 0.1757 | 0.0648 | 0.2590 | 0.0323 | 0.5743 | 0.0496 | 0.0000 | 0.0279 | 0.0000 | 0.0116 | 0.0270 | 0.01 | 0.8736 | 0.9309 | 0.9373 | 0.9694 | 0.9370 | 0.9365 |
105
- | 0.0472 | 19.0 | 6365 | 0.1766 | 1.3105 | 0.9765 | 0.8398 | 0.0000 | 0.8981 | 0.0000 | 0.8663 | 0.0 | 0.8977 | 0.0 | 0.7503 | 0.6105 | 0.4301 | 0.1616 | 0.0445 | 0.4385 | 0.0296 | 0.6064 | 0.0429 | 0.0000 | 0.0257 | 0.0000 | 0.0098 | 0.0135 | 0.4 | 0.8918 | 0.94 | 0.9463 | 0.9697 | 0.9473 | 0.9445 |
106
- | 0.0458 | 20.0 | 6700 | 0.1612 | 1.3088 | 0.9764 | 0.8286 | 0.0000 | 0.9085 | 0.0000 | 0.8654 | 0.0 | 0.9080 | 0.0 | 0.7346 | 0.5842 | 0.2563 | 0.0913 | -0.0088 | 0.8788 | 0.0162 | 0.7775 | 0.0058 | 0.2119 | 0.0149 | 0.0014 | 0.0071 | -0.0068 | 0.2 | 0.9140 | 0.9536 | 0.9567 | 0.9705 | 0.9556 | 0.9584 |
107
- | 0.0403 | 21.0 | 7035 | 0.1551 | 1.2920 | 0.9650 | 0.8434 | 0.0000 | 0.9089 | 0.0000 | 0.8742 | 0.0 | 0.9085 | 0.0 | 0.7471 | 0.6055 | 0.3923 | 0.1591 | 0.0715 | 0.2130 | 0.0287 | 0.6170 | 0.0623 | 0.0000 | 0.0249 | 0.0000 | 0.0116 | 0.0280 | 0.2 | 0.9037 | 0.9474 | 0.9522 | 0.9755 | 0.9521 | 0.9516 |
108
- | 0.0328 | 22.0 | 7370 | 0.1699 | 1.3008 | 0.9670 | 0.8274 | 0.0000 | 0.9001 | 0.0000 | 0.8626 | 0.0 | 0.8997 | 0.0 | 0.7381 | 0.5896 | 0.3091 | 0.1019 | 0.0528 | 0.3578 | 0.0251 | 0.6627 | 0.0431 | 0.0000 | 0.0218 | 0.0000 | 0.0109 | 0.0229 | 0.01 | 0.8869 | 0.9391 | 0.9433 | 0.9720 | 0.9422 | 0.9447 |
109
- | 0.0308 | 23.0 | 7705 | 0.1576 | 1.2852 | 0.9559 | 0.8325 | 0.0000 | 0.9055 | 0.0000 | 0.8666 | 0.0 | 0.9051 | 0.0 | 0.7409 | 0.5948 | 0.3929 | 0.1412 | -0.0489 | 0.3947 | 0.0209 | 0.7156 | -0.0207 | 0.0000 | 0.0189 | 0.0000 | 0.0045 | -0.0267 | 0.01 | 0.8886 | 0.9386 | 0.9448 | 0.9742 | 0.9453 | 0.9434 |
110
- | 0.0168 | 24.0 | 8040 | 0.1402 | 1.2921 | 0.9571 | 0.8392 | 0.0000 | 0.9165 | 0.0000 | 0.8737 | 0.0 | 0.9162 | 0.0 | 0.7434 | 0.5991 | 0.3430 | 0.1134 | -0.0074 | 0.8978 | 0.0193 | 0.7377 | 0.0023 | 0.6255 | 0.0166 | 0.0003 | 0.0073 | -0.0054 | 0.01 | 0.9128 | 0.9525 | 0.9567 | 0.9752 | 0.9563 | 0.9565 |
111
- | 0.0152 | 25.0 | 8375 | 0.1540 | 1.2940 | 0.9607 | 0.8368 | 0.0000 | 0.9085 | 0.0000 | 0.8697 | 0.0 | 0.9081 | 0.0 | 0.7392 | 0.5921 | 0.3648 | 0.1171 | -0.0185 | 0.7482 | 0.0157 | 0.7853 | -0.0213 | 0.0000 | 0.0131 | 0.0049 | 0.0065 | -0.0115 | 0.01 | 0.9067 | 0.9493 | 0.9537 | 0.9760 | 0.9533 | 0.9535 |
112
- | 0.0181 | 26.0 | 8710 | 0.1775 | 1.2964 | 0.9631 | 0.8203 | 0.0000 | 0.8948 | 0.0000 | 0.8561 | 0.0 | 0.8943 | 0.0 | 0.7329 | 0.5811 | 0.3991 | 0.1268 | -0.0381 | 0.5078 | 0.0201 | 0.7269 | -0.0148 | 0.0014 | 0.0183 | 0.0001 | 0.0055 | -0.0188 | 0.3 | 0.8976 | 0.9439 | 0.9493 | 0.9681 | 0.9493 | 0.9483 |
113
- | 0.0155 | 27.0 | 9045 | 0.1698 | 1.2915 | 0.9597 | 0.8371 | 0.0000 | 0.8991 | 0.0000 | 0.8680 | 0.0 | 0.8986 | 0.0 | 0.7422 | 0.5969 | 0.3658 | 0.1180 | 0.0572 | 0.3193 | 0.0254 | 0.6586 | 0.0471 | 0.0000 | 0.0236 | 0.0000 | 0.0114 | 0.0273 | 0.3 | 0.8947 | 0.9425 | 0.9478 | 0.9719 | 0.9474 | 0.9472 |
114
- | 0.0143 | 28.0 | 9380 | 0.1788 | 1.2984 | 0.9642 | 0.8251 | 0.0000 | 0.8942 | 0.0000 | 0.8579 | 0.0 | 0.8937 | 0.0 | 0.7358 | 0.5861 | 0.4155 | 0.1405 | -0.0406 | 0.4799 | 0.0200 | 0.7276 | -0.0221 | 0.0000 | 0.0171 | 0.0002 | 0.0052 | -0.0213 | 0.01 | 0.8887 | 0.9394 | 0.9448 | 0.9699 | 0.9442 | 0.9445 |
115
- | 0.0113 | 29.0 | 9715 | 0.1720 | 1.2871 | 0.9571 | 0.8321 | 0.0000 | 0.8970 | 0.0000 | 0.8625 | 0.0 | 0.8965 | 0.0 | 0.7409 | 0.5950 | 0.4311 | 0.1528 | -0.0166 | 0.7726 | 0.0239 | 0.6776 | 0.0043 | 0.3554 | 0.0207 | 0.0000 | 0.0076 | -0.0027 | 0.3 | 0.8888 | 0.9382 | 0.9448 | 0.9690 | 0.9460 | 0.9428 |
116
- | 0.0082 | 30.0 | 10050 | 0.1658 | 1.2921 | 0.9608 | 0.8353 | 0.0000 | 0.9015 | 0.0000 | 0.8661 | 0.0 | 0.9010 | 0.0 | 0.7432 | 0.5984 | 0.4212 | 0.1470 | -0.0459 | 0.4244 | 0.0197 | 0.7315 | -0.0360 | 0.0000 | 0.0175 | 0.0002 | 0.0045 | -0.0262 | 0.2 | 0.8888 | 0.9382 | 0.9448 | 0.9732 | 0.9460 | 0.9428 |
117
- | 0.0084 | 31.0 | 10385 | 0.2160 | 1.2880 | 0.9613 | 0.8141 | 0.0000 | 0.8706 | 0.0000 | 0.8400 | 0.0 | 0.8700 | 0.0 | 0.7373 | 0.5885 | 0.5010 | 0.1973 | -0.0459 | 0.4244 | 0.0256 | 0.6556 | -0.0159 | 0.0006 | 0.0220 | 0.0000 | 0.0050 | -0.0223 | 0.01 | 0.8616 | 0.9233 | 0.9313 | 0.9558 | 0.9322 | 0.9294 |
118
- | 0.0101 | 32.0 | 10720 | 0.1586 | 1.2906 | 0.9558 | 0.8450 | 0.0000 | 0.9056 | 0.0000 | 0.8773 | 0.0 | 0.9052 | 0.0 | 0.7499 | 0.6101 | 0.3452 | 0.1031 | -0.0685 | 0.2328 | 0.0126 | 0.8263 | -0.0631 | 0.0000 | 0.0109 | 0.0191 | 0.0035 | -0.0348 | 0.4 | 0.9007 | 0.9460 | 0.9507 | 0.9750 | 0.9502 | 0.9505 |
119
- | 0.0078 | 33.0 | 11055 | 0.1728 | 1.3028 | 0.9658 | 0.8386 | 0.0000 | 0.8986 | 0.0000 | 0.8694 | 0.0 | 0.8981 | 0.0 | 0.7412 | 0.5952 | 0.3720 | 0.1104 | -0.0916 | 0.1104 | 0.0130 | 0.8214 | -0.0709 | 0.0000 | 0.0086 | 0.0648 | 0.0026 | -0.0434 | 0.01 | 0.9011 | 0.9465 | 0.9507 | 0.9728 | 0.9498 | 0.9513 |
 
120
 
121
 
122
  ### Framework versions
 
1
  ---
2
  license: mit
3
+ base_model: facebook/esm2_t33_650M_UR50D
4
  tags:
5
  - generated_from_trainer
6
  metrics:
 
17
 
18
  # esm_ft_Aerin_Yang_et_al_2023
19
 
20
+ This model is a fine-tuned version of [facebook/esm2_t33_650M_UR50D](https://huggingface.co/facebook/esm2_t33_650M_UR50D) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.1866
23
+ - Rmse: 1.3040
24
+ - Mae: 0.9754
25
+ - Spearmanr Corr: 0.8524
26
  - Spearmanr Corr P Value: 0.0000
27
+ - Pearsonr Corr: 0.8905
28
  - Pearsonr Corr P Value: 0.0000
29
+ - Spearmanr Corr Of Deltas: 0.8692
30
  - Spearmanr Corr Of Deltas P Value: 0.0
31
+ - Pearsonr Corr Of Deltas: 0.8899
32
  - Pearsonr Corr Of Deltas P Value: 0.0
33
+ - Ranking F1 Score: 0.7517
34
+ - Ranking Mcc: 0.6136
35
+ - Rmse Enriched: 0.4258
36
+ - Mae Enriched: 0.1658
37
+ - Spearmanr Corr Enriched: 0.0198
38
+ - Spearmanr Corr Enriched P Value: 0.7300
39
+ - Pearsonr Corr Enriched: 0.0288
40
+ - Pearsonr Corr Enriched P Value: 0.6163
41
+ - Spearmanr Corr Of Deltas Enriched: 0.0264
42
  - Spearmanr Corr Of Deltas Enriched P Value: 0.0000
43
+ - Pearsonr Corr Of Deltas Enriched: 0.0258
44
+ - Pearsonr Corr Of Deltas Enriched P Value: 0.0000
45
+ - Ranking F1 Score Enriched: 0.0090
46
+ - Ranking Mcc Enriched: 0.0081
47
  - Classification Thresh: 0.01
48
+ - Mcc: 0.8766
49
+ - F1 Score: 0.9325
50
+ - Acc: 0.9388
51
+ - Auc: 0.9746
52
+ - Precision: 0.9387
53
+ - Recall: 0.9379
54
 
55
  ## Model description
56
 
 
84
 
85
  | Training Loss | Epoch | Step | Validation Loss | Rmse | Mae | Spearmanr Corr | Spearmanr Corr P Value | Pearsonr Corr | Pearsonr Corr P Value | Spearmanr Corr Of Deltas | Spearmanr Corr Of Deltas P Value | Pearsonr Corr Of Deltas | Pearsonr Corr Of Deltas P Value | Ranking F1 Score | Ranking Mcc | Rmse Enriched | Mae Enriched | Spearmanr Corr Enriched | Spearmanr Corr Enriched P Value | Pearsonr Corr Enriched | Pearsonr Corr Enriched P Value | Spearmanr Corr Of Deltas Enriched | Spearmanr Corr Of Deltas Enriched P Value | Pearsonr Corr Of Deltas Enriched | Pearsonr Corr Of Deltas Enriched P Value | Ranking F1 Score Enriched | Ranking Mcc Enriched | Classification Thresh | Mcc | F1 Score | Acc | Auc | Precision | Recall |
86
  |:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:--------------:|:----------------------:|:-------------:|:---------------------:|:------------------------:|:--------------------------------:|:-----------------------:|:-------------------------------:|:----------------:|:-----------:|:-------------:|:------------:|:-----------------------:|:-------------------------------:|:----------------------:|:------------------------------:|:---------------------------------:|:-----------------------------------------:|:--------------------------------:|:----------------------------------------:|:-------------------------:|:--------------------:|:---------------------:|:------:|:--------:|:------:|:------:|:---------:|:------:|
87
+ | 0.4938 | 1.0 | 335 | 0.2535 | 1.2092 | 0.9284 | 0.8204 | 0.0000 | 0.8408 | 0.0000 | 0.8373 | 0.0 | 0.8403 | 0.0 | 0.7401 | 0.5930 | 0.5202 | 0.3159 | -0.0457 | 0.4267 | 0.0251 | 0.6628 | -0.0210 | 0.0000 | 0.0217 | 0.0000 | 0.0042 | -0.0265 | 0.4 | 0.8223 | 0.9025 | 0.9119 | 0.9673 | 0.9118 | 0.9106 |
88
+ | 0.2752 | 2.0 | 670 | 0.3257 | 1.2897 | 0.9506 | 0.8170 | 0.0000 | 0.8155 | 0.0000 | 0.8253 | 0.0 | 0.8146 | 0.0 | 0.7349 | 0.5841 | 0.7387 | 0.3560 | -0.0510 | 0.3749 | 0.0375 | 0.5137 | -0.0180 | 0.0001 | 0.0340 | 0.0000 | 0.0037 | -0.0305 | 0.5 | 0.7912 | 0.8743 | 0.8940 | 0.9660 | 0.9043 | 0.8871 |
89
+ | 0.2159 | 3.0 | 1005 | 0.1902 | 1.2032 | 0.9481 | 0.8455 | 0.0000 | 0.8884 | 0.0000 | 0.8669 | 0.0 | 0.8879 | 0.0 | 0.7548 | 0.6178 | 0.3961 | 0.3346 | -0.0930 | 0.1051 | 0.0012 | 0.9836 | -0.0892 | 0.0000 | -0.0040 | 0.3873 | 0.0017 | -0.0443 | 0.1 | 0.8855 | 0.9384 | 0.9418 | 0.9780 | 0.9410 | 0.9444 |
90
+ | 0.2044 | 4.0 | 1340 | 0.1532 | 1.2455 | 0.9411 | 0.8558 | 0.0000 | 0.9075 | 0.0000 | 0.8799 | 0.0 | 0.9071 | 0.0 | 0.7603 | 0.6276 | 0.3365 | 0.1489 | -0.0300 | 0.6018 | 0.0202 | 0.7255 | -0.0078 | 0.0938 | 0.0149 | 0.0014 | 0.0047 | -0.0236 | 0.01 | 0.9069 | 0.9496 | 0.9537 | 0.9812 | 0.9529 | 0.9540 |
91
+ | 0.2002 | 5.0 | 1675 | 0.1957 | 1.2367 | 0.9569 | 0.8530 | 0.0000 | 0.8912 | 0.0000 | 0.8720 | 0.0 | 0.8908 | 0.0 | 0.7601 | 0.6269 | 0.3756 | 0.1658 | -0.0394 | 0.4925 | 0.0224 | 0.6968 | -0.0179 | 0.0001 | 0.0166 | 0.0003 | 0.0047 | -0.0236 | 0.1 | 0.8646 | 0.9251 | 0.9328 | 0.9793 | 0.9335 | 0.9311 |
92
+ | 0.1686 | 6.0 | 2010 | 0.1751 | 1.2966 | 0.9666 | 0.8597 | 0.0000 | 0.8974 | 0.0000 | 0.8809 | 0.0 | 0.8969 | 0.0 | 0.7640 | 0.6335 | 0.2937 | 0.0892 | -0.0078 | 0.8915 | 0.0168 | 0.7699 | 0.0004 | 0.9369 | 0.0103 | 0.0272 | 0.0066 | -0.0100 | 0.4 | 0.8900 | 0.9408 | 0.9448 | 0.9835 | 0.9437 | 0.9464 |
93
+ | 0.1666 | 7.0 | 2345 | 0.1886 | 1.3305 | 0.9939 | 0.8594 | 0.0000 | 0.8981 | 0.0000 | 0.8830 | 0.0 | 0.8976 | 0.0 | 0.7629 | 0.6317 | 0.4580 | 0.1687 | -0.0556 | 0.3332 | 0.0208 | 0.7177 | -0.0320 | 0.0000 | 0.0148 | 0.0015 | 0.0035 | -0.0323 | 0.4 | 0.8797 | 0.9333 | 0.9403 | 0.9821 | 0.9412 | 0.9385 |
94
+ | 0.175 | 8.0 | 2680 | 0.1513 | 1.2717 | 0.9535 | 0.8644 | 0.0000 | 0.9088 | 0.0000 | 0.8868 | 0.0 | 0.9084 | 0.0 | 0.7605 | 0.6281 | 0.3927 | 0.1653 | 0.0734 | 0.2014 | 0.0291 | 0.6124 | 0.0560 | 0.0000 | 0.0235 | 0.0000 | 0.0129 | 0.0377 | 0.01 | 0.9007 | 0.9456 | 0.9507 | 0.9856 | 0.9507 | 0.9499 |
95
+ | 0.1496 | 9.0 | 3015 | 0.1598 | 1.2104 | 0.9346 | 0.8628 | 0.0000 | 0.9057 | 0.0000 | 0.8865 | 0.0 | 0.9053 | 0.0 | 0.7645 | 0.6343 | 0.3926 | 0.2572 | -0.0185 | 0.7482 | 0.0192 | 0.7387 | -0.0108 | 0.0198 | 0.0144 | 0.0019 | 0.0066 | -0.0099 | 0.01 | 0.8978 | 0.9444 | 0.9493 | 0.9829 | 0.9486 | 0.9491 |
96
+ | 0.1661 | 10.0 | 3350 | 0.1847 | 1.2898 | 0.9926 | 0.8547 | 0.0000 | 0.8971 | 0.0000 | 0.8766 | 0.0 | 0.8966 | 0.0 | 0.7579 | 0.6233 | 0.3976 | 0.2023 | 0.0464 | 0.4197 | 0.0285 | 0.6194 | 0.0384 | 0.0000 | 0.0241 | 0.0000 | 0.0097 | 0.0130 | 0.5 | 0.8886 | 0.9386 | 0.9448 | 0.9826 | 0.9453 | 0.9434 |
97
+ | 0.1468 | 11.0 | 3685 | 0.1594 | 1.3265 | 0.9881 | 0.8636 | 0.0000 | 0.9097 | 0.0000 | 0.8859 | 0.0 | 0.9093 | 0.0 | 0.7646 | 0.6344 | 0.3627 | 0.1214 | 0.0694 | 0.2266 | 0.0261 | 0.6496 | 0.0492 | 0.0000 | 0.0203 | 0.0000 | 0.0118 | 0.0278 | 0.4 | 0.9067 | 0.9493 | 0.9537 | 0.9826 | 0.9533 | 0.9535 |
98
+ | 0.1335 | 12.0 | 4020 | 0.1444 | 1.2719 | 0.9618 | 0.8635 | 0.0000 | 0.9128 | 0.0000 | 0.8861 | 0.0 | 0.9123 | 0.0 | 0.7605 | 0.6278 | 0.3261 | 0.1369 | 0.0510 | 0.3749 | 0.0288 | 0.6166 | 0.0418 | 0.0000 | 0.0235 | 0.0000 | 0.0107 | 0.0202 | 0.3 | 0.8977 | 0.9443 | 0.9493 | 0.9848 | 0.9488 | 0.9488 |
99
+ | 0.1455 | 13.0 | 4355 | 0.1524 | 1.2873 | 0.9697 | 0.8599 | 0.0000 | 0.9108 | 0.0000 | 0.8845 | 0.0 | 0.9104 | 0.0 | 0.7567 | 0.6217 | 0.3473 | 0.1380 | 0.0291 | 0.6131 | 0.0249 | 0.6644 | 0.0266 | 0.0000 | 0.0206 | 0.0000 | 0.0088 | 0.0066 | 0.3 | 0.9007 | 0.9456 | 0.9507 | 0.9809 | 0.9507 | 0.9499 |
100
+ | 0.1234 | 14.0 | 4690 | 0.1629 | 1.2232 | 0.9520 | 0.8462 | 0.0000 | 0.9086 | 0.0000 | 0.8739 | 0.0 | 0.9082 | 0.0 | 0.7468 | 0.6049 | 0.4183 | 0.3193 | 0.0288 | 0.6159 | 0.0254 | 0.6591 | 0.0314 | 0.0000 | 0.0222 | 0.0000 | 0.0089 | 0.0075 | 0.1 | 0.8980 | 0.9448 | 0.9493 | 0.9755 | 0.9483 | 0.9497 |
101
+ | 0.101 | 15.0 | 5025 | 0.1536 | 1.2280 | 0.9416 | 0.8432 | 0.0000 | 0.9082 | 0.0000 | 0.8777 | 0.0 | 0.9077 | 0.0 | 0.7476 | 0.6062 | 0.3486 | 0.1792 | 0.0452 | 0.4314 | 0.0215 | 0.7083 | 0.0353 | 0.0000 | 0.0174 | 0.0002 | 0.0106 | 0.0210 | 0.4 | 0.9097 | 0.9507 | 0.9552 | 0.9717 | 0.9551 | 0.9546 |
102
+ | 0.1104 | 16.0 | 5360 | 0.1496 | 1.2724 | 0.9555 | 0.8490 | 0.0000 | 0.9110 | 0.0000 | 0.8765 | 0.0 | 0.9106 | 0.0 | 0.7527 | 0.6146 | 0.3090 | 0.1124 | 0.0794 | 0.1668 | 0.0333 | 0.5620 | 0.0717 | 0.0000 | 0.0296 | 0.0000 | 0.0127 | 0.0354 | 0.2 | 0.9160 | 0.9545 | 0.9582 | 0.9756 | 0.9573 | 0.9587 |
103
+ | 0.0955 | 17.0 | 5695 | 0.1477 | 1.3251 | 0.9872 | 0.8473 | 0.0000 | 0.9169 | 0.0000 | 0.8809 | 0.0 | 0.9166 | 0.0 | 0.7492 | 0.6089 | 0.2794 | 0.0980 | 0.0277 | 0.6301 | 0.0192 | 0.7383 | 0.0257 | 0.0000 | 0.0176 | 0.0002 | 0.0087 | 0.0056 | 0.3 | 0.9253 | 0.9596 | 0.9627 | 0.9750 | 0.9617 | 0.9636 |
104
+ | 0.092 | 18.0 | 6030 | 0.1689 | 1.2765 | 0.9631 | 0.8479 | 0.0000 | 0.8984 | 0.0000 | 0.8675 | 0.0 | 0.8979 | 0.0 | 0.7504 | 0.6107 | 0.4028 | 0.1760 | 0.1107 | 0.0534 | 0.0433 | 0.4517 | 0.0830 | 0.0000 | 0.0390 | 0.0000 | 0.0154 | 0.0569 | 0.1 | 0.8917 | 0.9402 | 0.9463 | 0.9752 | 0.9469 | 0.9448 |
105
+ | 0.0782 | 19.0 | 6365 | 0.1967 | 1.3323 | 1.0076 | 0.8417 | 0.0000 | 0.8921 | 0.0000 | 0.8583 | 0.0 | 0.8916 | 0.0 | 0.7489 | 0.6081 | 0.4646 | 0.2140 | -0.0076 | 0.8947 | 0.0022 | 0.9697 | -0.0239 | 0.0000 | -0.0015 | 0.7406 | 0.0067 | -0.0091 | 0.1 | 0.8917 | 0.9402 | 0.9463 | 0.9704 | 0.9469 | 0.9448 |
106
+ | 0.0653 | 20.0 | 6700 | 0.1748 | 1.3168 | 0.9878 | 0.8381 | 0.0000 | 0.8992 | 0.0000 | 0.8648 | 0.0 | 0.8987 | 0.0 | 0.7428 | 0.5978 | 0.3921 | 0.1505 | 0.0208 | 0.7180 | 0.0240 | 0.6763 | 0.0183 | 0.0001 | 0.0209 | 0.0000 | 0.0086 | 0.0047 | 0.01 | 0.9007 | 0.9460 | 0.9507 | 0.9769 | 0.9502 | 0.9505 |
107
+ | 0.0543 | 21.0 | 7035 | 0.1661 | 1.2932 | 0.9593 | 0.8383 | 0.0000 | 0.9011 | 0.0000 | 0.8711 | 0.0 | 0.9007 | 0.0 | 0.7431 | 0.5987 | 0.3842 | 0.1158 | 0.0348 | 0.5445 | 0.0220 | 0.7016 | 0.0322 | 0.0000 | 0.0175 | 0.0002 | 0.0096 | 0.0125 | 0.5 | 0.9037 | 0.9472 | 0.9522 | 0.9727 | 0.9524 | 0.9513 |
108
+ | 0.0433 | 22.0 | 7370 | 0.1857 | 1.3158 | 0.9815 | 0.8419 | 0.0000 | 0.8927 | 0.0000 | 0.8633 | 0.0 | 0.8922 | 0.0 | 0.7460 | 0.6033 | 0.4318 | 0.1646 | 0.0819 | 0.1536 | 0.0448 | 0.4355 | 0.0908 | 0.0000 | 0.0411 | 0.0000 | 0.0133 | 0.0414 | 0.5 | 0.8917 | 0.9402 | 0.9463 | 0.9719 | 0.9469 | 0.9448 |
109
+ | 0.0574 | 23.0 | 7705 | 0.1825 | 1.2687 | 0.9548 | 0.8301 | 0.0000 | 0.8911 | 0.0000 | 0.8544 | 0.0 | 0.8906 | 0.0 | 0.7335 | 0.5823 | 0.3508 | 0.1376 | -0.0593 | 0.3020 | -0.0099 | 0.8631 | -0.0590 | 0.0000 | -0.0132 | 0.0044 | 0.0043 | -0.0286 | 0.3 | 0.8948 | 0.9429 | 0.9478 | 0.9730 | 0.9471 | 0.9477 |
110
+ | 0.0335 | 24.0 | 8040 | 0.1617 | 1.2991 | 0.9685 | 0.8421 | 0.0000 | 0.9046 | 0.0000 | 0.8658 | 0.0 | 0.9042 | 0.0 | 0.7458 | 0.6034 | 0.3635 | 0.1360 | -0.0155 | 0.7881 | 0.0156 | 0.7865 | -0.0113 | 0.0149 | 0.0127 | 0.0062 | 0.0063 | -0.0123 | 0.2 | 0.9097 | 0.9508 | 0.9552 | 0.9737 | 0.9549 | 0.9549 |
111
+ | 0.0295 | 25.0 | 8375 | 0.1653 | 1.2827 | 0.9651 | 0.8380 | 0.0000 | 0.9006 | 0.0000 | 0.8691 | 0.0 | 0.9002 | 0.0 | 0.7416 | 0.5961 | 0.3310 | 0.1374 | 0.0113 | 0.8441 | 0.0235 | 0.6823 | 0.0193 | 0.0000 | 0.0219 | 0.0000 | 0.0081 | 0.0012 | 0.0 | 0.8984 | 0.9452 | 0.9493 | 0.9720 | 0.9482 | 0.9502 |
112
+ | 0.0315 | 26.0 | 8710 | 0.1616 | 1.2790 | 0.9562 | 0.8416 | 0.0000 | 0.9034 | 0.0000 | 0.8710 | 0.0 | 0.9029 | 0.0 | 0.7477 | 0.6060 | 0.3236 | 0.1149 | -0.0325 | 0.5715 | -0.0133 | 0.8172 | -0.0490 | 0.0000 | -0.0169 | 0.0003 | 0.0051 | -0.0210 | 0.4 | 0.8976 | 0.9439 | 0.9493 | 0.9722 | 0.9493 | 0.9483 |
113
+ | 0.0226 | 27.0 | 9045 | 0.1603 | 1.2680 | 0.9567 | 0.8503 | 0.0000 | 0.9027 | 0.0000 | 0.8707 | 0.0 | 0.9023 | 0.0 | 0.7555 | 0.6194 | 0.3718 | 0.1684 | -0.0399 | 0.4874 | -0.0298 | 0.6037 | -0.0508 | 0.0000 | -0.0356 | 0.0000 | 0.0045 | -0.0246 | 0.01 | 0.8917 | 0.9412 | 0.9463 | 0.9776 | 0.9456 | 0.9461 |
114
+ | 0.0179 | 28.0 | 9380 | 0.1941 | 1.3060 | 0.9771 | 0.8367 | 0.0000 | 0.8866 | 0.0000 | 0.8588 | 0.0 | 0.8860 | 0.0 | 0.7425 | 0.5976 | 0.4350 | 0.1661 | -0.0699 | 0.2235 | -0.0418 | 0.4668 | -0.0655 | 0.0000 | -0.0460 | 0.0000 | 0.0030 | -0.0386 | 0.01 | 0.8797 | 0.9346 | 0.9403 | 0.9706 | 0.9396 | 0.9401 |
115
+ | 0.0161 | 29.0 | 9715 | 0.1587 | 1.2891 | 0.9602 | 0.8433 | 0.0000 | 0.9051 | 0.0000 | 0.8761 | 0.0 | 0.9047 | 0.0 | 0.7439 | 0.6003 | 0.3450 | 0.1193 | -0.0258 | 0.6531 | 0.0184 | 0.7491 | -0.0041 | 0.3762 | 0.0157 | 0.0007 | 0.0069 | -0.0087 | 0.3 | 0.9098 | 0.9510 | 0.9552 | 0.9716 | 0.9547 | 0.9551 |
116
+ | 0.0114 | 30.0 | 10050 | 0.1846 | 1.2979 | 0.9739 | 0.8431 | 0.0000 | 0.8907 | 0.0000 | 0.8642 | 0.0 | 0.8902 | 0.0 | 0.7453 | 0.6025 | 0.4478 | 0.1884 | -0.0554 | 0.3352 | 0.0043 | 0.9403 | -0.0448 | 0.0000 | -0.0001 | 0.9772 | 0.0042 | -0.0289 | 0.4 | 0.8774 | 0.9306 | 0.9388 | 0.9741 | 0.9417 | 0.9358 |
117
+ | 0.0141 | 31.0 | 10385 | 0.2011 | 1.2868 | 0.9639 | 0.8359 | 0.0000 | 0.8798 | 0.0000 | 0.8548 | 0.0 | 0.8792 | 0.0 | 0.7433 | 0.5987 | 0.4572 | 0.1858 | -0.0351 | 0.5418 | 0.0036 | 0.9495 | -0.0353 | 0.0000 | 0.0000 | 0.9935 | 0.0055 | -0.0186 | 0.1 | 0.8645 | 0.9256 | 0.9328 | 0.9682 | 0.9329 | 0.9316 |
118
+ | 0.0127 | 32.0 | 10720 | 0.1691 | 1.3026 | 0.9661 | 0.8472 | 0.0000 | 0.9008 | 0.0000 | 0.8763 | 0.0 | 0.9003 | 0.0 | 0.7469 | 0.6050 | 0.3351 | 0.0883 | 0.0272 | 0.6358 | 0.0202 | 0.7252 | 0.0285 | 0.0000 | 0.0159 | 0.0006 | 0.0090 | 0.0082 | 0.5 | 0.9038 | 0.9477 | 0.9522 | 0.9755 | 0.9517 | 0.9521 |
119
+ | 0.0089 | 33.0 | 11055 | 0.1789 | 1.2859 | 0.9594 | 0.8411 | 0.0000 | 0.8933 | 0.0000 | 0.8655 | 0.0 | 0.8928 | 0.0 | 0.7433 | 0.5990 | 0.3454 | 0.1187 | -0.0189 | 0.7421 | 0.0195 | 0.7345 | -0.0072 | 0.1216 | 0.0166 | 0.0004 | 0.0065 | -0.0113 | 0.0 | 0.8897 | 0.9406 | 0.9448 | 0.9695 | 0.9436 | 0.9461 |
120
+ | 0.0065 | 34.0 | 11390 | 0.1866 | 1.3040 | 0.9754 | 0.8524 | 0.0000 | 0.8905 | 0.0000 | 0.8692 | 0.0 | 0.8899 | 0.0 | 0.7517 | 0.6136 | 0.4258 | 0.1658 | 0.0198 | 0.7300 | 0.0288 | 0.6163 | 0.0264 | 0.0000 | 0.0258 | 0.0000 | 0.0090 | 0.0081 | 0.01 | 0.8766 | 0.9325 | 0.9388 | 0.9746 | 0.9387 | 0.9379 |
121
 
122
 
123
  ### Framework versions
adapter_config.json CHANGED
@@ -1,6 +1,6 @@
1
  {
2
  "auto_mapping": null,
3
- "base_model_name_or_path": "facebook/esm2_t30_150M_UR50D",
4
  "fan_in_fan_out": false,
5
  "feedforward_modules": [
6
  "value",
 
1
  {
2
  "auto_mapping": null,
3
+ "base_model_name_or_path": "facebook/esm2_t33_650M_UR50D",
4
  "fan_in_fan_out": false,
5
  "feedforward_modules": [
6
  "value",
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a7a7b9f260c15bd600ffcc9772c231e55f2b7f3af595f4a248ef8c64db1ac00e
3
- size 100689656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:108bb927c4c0d064a4a474555fe5aad03762116cc9d690a957d861dfc4809f4b
3
+ size 440692544