Hugging Face's logo

arjan-hada
/
esm2_t33_650M_UR50D-finetuned-Ab14H-v1

Text Classification
Transformers
TensorBoard
Safetensors
esm
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
arjan-hada commited on
Commit
8a0f57f
·
verified ·
1 Parent(s): f2e61a4

Model save

Browse files
Files changed (2) hide show
  1. README.md +11 -14
  2. model.safetensors +1 -1
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [facebook/esm2_t33_650M_UR50D](https://huggingface.co/facebook/esm2_t33_650M_UR50D) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 1.2626
21
- - Spearmanr: 0.6109
22
 
23
  ## Model description
24
 
@@ -44,28 +44,25 @@ The following hyperparameters were used during training:
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: cosine
46
  - lr_scheduler_warmup_ratio: 0.1
47
- - num_epochs: 10
48
  - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Spearmanr |
53
  |:-------------:|:-----:|:----:|:---------------:|:---------:|
54
- | 3.7775 | 1.0 | 643 | 1.8108 | 0.5994 |
55
- | 1.4213 | 2.0 | 1286 | 1.3513 | 0.6542 |
56
- | 1.2606 | 3.0 | 1929 | 1.1680 | 0.6526 |
57
- | 1.1149 | 4.0 | 2572 | 1.3710 | 0.6268 |
58
- | 1.0178 | 5.0 | 3215 | 1.2131 | 0.6613 |
59
- | 0.9379 | 6.0 | 3858 | 1.2329 | 0.6349 |
60
- | 0.6642 | 7.0 | 4501 | 1.1996 | 0.6333 |
61
- | 0.5235 | 8.0 | 5144 | 1.2297 | 0.6190 |
62
- | 0.4256 | 9.0 | 5787 | 1.2410 | 0.6175 |
63
- | 0.3714 | 10.0 | 6430 | 1.2626 | 0.6109 |
64
 
65
 
66
  ### Framework versions
67
 
68
  - Transformers 4.40.1
69
  - Pytorch 2.2.1+cu121
70
- - Datasets 2.19.0
71
  - Tokenizers 0.19.1
 
17
 
18
  This model is a fine-tuned version of [facebook/esm2_t33_650M_UR50D](https://huggingface.co/facebook/esm2_t33_650M_UR50D) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 1.2072
21
+ - Spearmanr: 0.6411
22
 
23
  ## Model description
24
 
 
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: cosine
46
  - lr_scheduler_warmup_ratio: 0.1
47
+ - num_epochs: 7
48
  - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Spearmanr |
53
  |:-------------:|:-----:|:----:|:---------------:|:---------:|
54
+ | 3.3764 | 1.0 | 643 | 1.4308 | 0.6338 |
55
+ | 1.3787 | 2.0 | 1286 | 1.3095 | 0.6546 |
56
+ | 1.2298 | 3.0 | 1929 | 1.1653 | 0.6540 |
57
+ | 1.0901 | 4.0 | 2572 | 1.2472 | 0.6532 |
58
+ | 0.9758 | 5.0 | 3215 | 1.1286 | 0.6615 |
59
+ | 0.874 | 6.0 | 3858 | 1.1729 | 0.6485 |
60
+ | 0.6273 | 7.0 | 4501 | 1.2072 | 0.6411 |
 
 
 
61
 
62
 
63
  ### Framework versions
64
 
65
  - Transformers 4.40.1
66
  - Pytorch 2.2.1+cu121
67
+ - Datasets 2.19.1
68
  - Tokenizers 0.19.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5b69776f2950274913a7541dbd0afe3eca9e5275a6521f8aed870e7289609641
3
  size 2609492776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:238b388da5177f2bd6b81df1a758398443df28534fb5fd4fdfc21032cd3e62c3
3
  size 2609492776