BATCH_SIZE=8

LEARNING_RATE=1e-05
MAX_LENGTH=512
FOLD=0

README.md

@@ -14,7 +14,7 @@ model-index:
     metrics:
     - name: Accuracy
       type: accuracy
-      value: 0.58
+      value: 0.6
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -24,8 +24,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [dmis-lab/biobert-v1.1](https://huggingface.co/dmis-lab/biobert-v1.1) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.8478
-- Accuracy: 0.58
+- Loss: 1.0520
+- Accuracy: 0.6
 
 ## Model description
 
@@ -44,7 +44,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.003
+- learning_rate: 1e-05
 - train_batch_size: 8
 - eval_batch_size: 8
 - seed: 42
@@ -56,16 +56,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 57   | 1.0722          | 0.58     |
-| No log        | 2.0   | 114  | 0.8529          | 0.58     |
-| No log        | 3.0   | 171  | 1.4505          | 0.38     |
-| No log        | 4.0   | 228  | 1.0850          | 0.58     |
-| No log        | 5.0   | 285  | 0.9295          | 0.58     |
-| No log        | 6.0   | 342  | 0.8826          | 0.58     |
-| No log        | 7.0   | 399  | 0.8235          | 0.58     |
-| No log        | 8.0   | 456  | 0.8344          | 0.58     |
-| 1.1214        | 9.0   | 513  | 0.8390          | 0.58     |
-| 1.1214        | 10.0  | 570  | 0.8478          | 0.58     |
+| No log        | 1.0   | 57   | 0.9548          | 0.54     |
+| No log        | 2.0   | 114  | 0.9767          | 0.5      |
+| No log        | 3.0   | 171  | 1.0002          | 0.46     |
+| No log        | 4.0   | 228  | 0.9701          | 0.58     |
+| No log        | 5.0   | 285  | 0.9832          | 0.54     |
+| No log        | 6.0   | 342  | 0.9847          | 0.58     |
+| No log        | 7.0   | 399  | 1.0329          | 0.5      |
+| No log        | 8.0   | 456  | 1.0273          | 0.6      |
+| 0.6215        | 9.0   | 513  | 1.0425          | 0.6      |
+| 0.6215        | 10.0  | 570  | 1.0520          | 0.6      |
 
 
 ### Framework versions

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e7db70c3921d8240e098475d6e1b5238c6de2030f60cc616f873384998514c22
+oid sha256:32db4c199c1573e2e0b3183bbf1fa9500ce3e2908554ba32747450704645c003
 size 433334445

runs/Sep13_13-14-55_1428212fe7ba/events.out.tfevents.1631540370.1428212fe7ba.82.29

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1946012e7b5e61302a04469be32f5f5bdfeaf109566a57f90a904b37548721c9
+size 363

runs/Sep13_13-57-45_1428212fe7ba/1631541473.0325003/events.out.tfevents.1631541473.1428212fe7ba.3883.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d64be6bfc4309943b0df471f189f8340aa5f0c78a8cee1673a1e839bae54fc9a
+size 4271

runs/Sep13_13-57-45_1428212fe7ba/events.out.tfevents.1631541473.1428212fe7ba.3883.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1922b77ab30641af4b9f1ba24138714325b38299376095c4be401363a6c1856e
+size 6904

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:02a31f5d103d81b3cb60464dc5b70aec1300b06089a929e683b20076737f1230
+oid sha256:02381f210629aa76cca370add2b55aa90ef740716c7b66299afb3b4465337fa6
 size 2735