BATCH_SIZE=8

LEARNING_RATE=0.003
MAX_LENGTH=512
FOLD=0

README.md

@@ -14,7 +14,7 @@ model-index:
     metrics:
     - name: Accuracy
       type: accuracy
-      value: 0.58
+      value: 0.54
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -24,8 +24,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [dmis-lab/biobert-v1.1](https://huggingface.co/dmis-lab/biobert-v1.1) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.1836
-- Accuracy: 0.58
+- Loss: 0.9558
+- Accuracy: 0.54
 
 ## Model description
 
@@ -44,7 +44,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 5e-05
+- learning_rate: 0.003
 - train_batch_size: 8
 - eval_batch_size: 8
 - seed: 42
@@ -56,16 +56,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 57   | 0.8615          | 0.58     |
-| No log        | 2.0   | 114  | 0.9085          | 0.58     |
-| No log        | 3.0   | 171  | 0.8998          | 0.6      |
-| No log        | 4.0   | 228  | 1.1252          | 0.66     |
-| No log        | 5.0   | 285  | 1.4301          | 0.6      |
-| No log        | 6.0   | 342  | 1.3875          | 0.68     |
-| No log        | 7.0   | 399  | 2.0717          | 0.54     |
-| No log        | 8.0   | 456  | 2.0547          | 0.58     |
-| 0.4108        | 9.0   | 513  | 2.1581          | 0.56     |
-| 0.4108        | 10.0  | 570  | 2.1836          | 0.58     |
+| No log        | 1.0   | 57   | 1.4285          | 0.54     |
+| No log        | 2.0   | 114  | 1.0526          | 0.54     |
+| No log        | 3.0   | 171  | 1.2233          | 0.34     |
+| No log        | 4.0   | 228  | 1.0303          | 0.54     |
+| No log        | 5.0   | 285  | 0.9928          | 0.54     |
+| No log        | 6.0   | 342  | 0.9911          | 0.34     |
+| No log        | 7.0   | 399  | 1.1520          | 0.54     |
+| No log        | 8.0   | 456  | 0.9990          | 0.54     |
+| 1.1193        | 9.0   | 513  | 0.9703          | 0.54     |
+| 1.1193        | 10.0  | 570  | 0.9558          | 0.54     |
 
 
 ### Framework versions

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6a5ca30fd12a7dbbbb4e169baf287ebe108b7f7457bc1a0486bd09f76ad8b6b1
+oid sha256:fb7e5a0fd252dc1ad2e2bdb16f6746fd4fdea4085fd4350a5ed6d4103fd5aca4
 size 433334445

runs/Sep13_09-30-33_1428212fe7ba/1631525644.6111205/events.out.tfevents.1631525644.1428212fe7ba.82.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e28535429c6e78b6ace61ee8a50bb5959c7f39ad269b7785cad3fe13bdfb296c
+size 4271

runs/Sep13_09-30-33_1428212fe7ba/events.out.tfevents.1631525644.1428212fe7ba.82.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:080f7d42846813c173ab1b0c60088c7d7a649750d0200d0b2805897313772a80
+size 6904

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a542ca51702e3495c58074eabee28b3ee9f826d62bf5117f01b658f3cb669eb8
+oid sha256:dbeffaaac46228fcfb31d07a861a114b34439b1d60db4a3a6e2a3e482cbb04d9
 size 2735