End of training

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.6339
+- Loss: 0.6285
 
 ## Model description
 
@@ -34,29 +34,29 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.003
+- learning_rate: 1e-05
 - train_batch_size: 32
 - eval_batch_size: 16
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 500
+- lr_scheduler_warmup_steps: 5000
 - num_epochs: 10
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 0.6338        | 1.0   | 50   | 0.6428          |
-| 0.6921        | 2.0   | 100  | 0.6613          |
-| 0.6453        | 3.0   | 150  | 0.6626          |
-| 0.6368        | 4.0   | 200  | 0.6847          |
-| 0.6039        | 5.0   | 250  | 0.6969          |
-| 0.7043        | 6.0   | 300  | 0.6464          |
-| 0.6971        | 7.0   | 350  | 0.6339          |
-| 0.6376        | 8.0   | 400  | 0.6956          |
-| 0.6976        | 9.0   | 450  | 0.6344          |
-| 0.623         | 10.0  | 500  | 0.6493          |
+| 0.6608        | 1.0   | 50   | 0.6593          |
+| 0.6496        | 2.0   | 100  | 0.6572          |
+| 0.6628        | 3.0   | 150  | 0.6542          |
+| 0.6627        | 4.0   | 200  | 0.6500          |
+| 0.6508        | 5.0   | 250  | 0.6454          |
+| 0.6493        | 6.0   | 300  | 0.6403          |
+| 0.6561        | 7.0   | 350  | 0.6361          |
+| 0.6719        | 8.0   | 400  | 0.6332          |
+| 0.6315        | 9.0   | 450  | 0.6307          |
+| 0.6511        | 10.0  | 500  | 0.6285          |
 
 
 ### Framework versions

logs/events.out.tfevents.1711733281.5979db352813.17795.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:aea2d9759520688494d4755f6872ffc8dbf47d513071deb87494ae7f5590be29
-size 16487
+oid sha256:477e146d7056c1fd7599bd2cd26a453382880603e79260cbd2f0f3c9b992a3ff
+size 18167

logs/events.out.tfevents.1711733533.5979db352813.17795.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e7f9e2959e1f8debdf3acad16072913d24c17e2277686e5707eafad7cabdf451
+size 311

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:57d0be28d793233d5ecc87747964483d43a705f029a88980ed44cebcb8cbd588
+oid sha256:2472624c2c0bda3fb02f57465089a014d16bdda2c663261250778d5589e6545f
 size 498612824