Nared45 commited on
Commit
18c6d09
·
verified ·
1 Parent(s): d2c54cd

End of training

Browse files
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.4176
19
 
20
  ## Model description
21
 
@@ -34,9 +34,9 @@ More information needed
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
- - learning_rate: 1e-05
38
- - train_batch_size: 16
39
- - eval_batch_size: 8
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
@@ -47,16 +47,16 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 0.6749 | 1.0 | 99 | 0.6492 |
51
- | 0.5996 | 2.0 | 198 | 0.5918 |
52
- | 0.6368 | 3.0 | 297 | 0.5676 |
53
- | 0.5453 | 4.0 | 396 | 0.4176 |
54
- | 0.2549 | 5.0 | 495 | 0.4746 |
55
- | 0.2518 | 6.0 | 594 | 0.5545 |
56
- | 0.1891 | 7.0 | 693 | 0.7260 |
57
- | 0.1042 | 8.0 | 792 | 0.9964 |
58
- | 0.056 | 9.0 | 891 | 1.0677 |
59
- | 0.0109 | 10.0 | 990 | 0.9208 |
60
 
61
 
62
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.6339
19
 
20
  ## Model description
21
 
 
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
+ - learning_rate: 0.003
38
+ - train_batch_size: 32
39
+ - eval_batch_size: 16
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 0.6338 | 1.0 | 50 | 0.6428 |
51
+ | 0.6921 | 2.0 | 100 | 0.6613 |
52
+ | 0.6453 | 3.0 | 150 | 0.6626 |
53
+ | 0.6368 | 4.0 | 200 | 0.6847 |
54
+ | 0.6039 | 5.0 | 250 | 0.6969 |
55
+ | 0.7043 | 6.0 | 300 | 0.6464 |
56
+ | 0.6971 | 7.0 | 350 | 0.6339 |
57
+ | 0.6376 | 8.0 | 400 | 0.6956 |
58
+ | 0.6976 | 9.0 | 450 | 0.6344 |
59
+ | 0.623 | 10.0 | 500 | 0.6493 |
60
 
61
 
62
  ### Framework versions
logs/events.out.tfevents.1711732863.5979db352813.15949.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:358a6f743ca8eadc2436e5c6aa59a89b17948e9e8dcc67e0c1ba65da12473c52
3
- size 17811
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c6ed99f498d316d273a9aed01163a9d1794e344da975ca40fc9e1a3ea032829
3
+ size 18165
logs/events.out.tfevents.1711733102.5979db352813.15949.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd6149a561dd626ea07a39bf8463b04cd46d789688e4f5f89380859abc316204
3
+ size 311
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1383a8c17b843260cd0f37342421871fd6ef6c1d72ecd62a9ab07d97e4782e6
3
  size 498612824
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c95069629598cf1970cf3aa0d94b2ffd20c557d69be62cb74fcf0930a0df09bb
3
  size 498612824