devhem commited on
Commit
396a27d
·
verified ·
1 Parent(s): e663438

Model save

Browse files
Files changed (2) hide show
  1. README.md +13 -6
  2. model.safetensors +1 -1
README.md CHANGED
@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [FacebookAI/roberta-base](https://huggingface.co/FacebookAI/roberta-base) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.8849
22
- - Accuracy: 0.7485
23
 
24
  ## Model description
25
 
@@ -45,14 +45,21 @@ The following hyperparameters were used during training:
45
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
  - lr_scheduler_type: linear
47
  - lr_scheduler_warmup_ratio: 0.1
48
- - num_epochs: 1
49
  - mixed_precision_training: Native AMP
50
 
51
  ### Training results
52
 
53
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
- |:-------------:|:-----:|:----:|:---------------:|:--------:|
55
- | 0.9931 | 1.0 | 1585 | 0.8849 | 0.7485 |
 
 
 
 
 
 
 
56
 
57
 
58
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [FacebookAI/roberta-base](https://huggingface.co/FacebookAI/roberta-base) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.6232
22
+ - Accuracy: 0.7953
23
 
24
  ## Model description
25
 
 
45
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
  - lr_scheduler_type: linear
47
  - lr_scheduler_warmup_ratio: 0.1
48
+ - num_epochs: 8
49
  - mixed_precision_training: Native AMP
50
 
51
  ### Training results
52
 
53
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
+ |:-------------:|:-----:|:-----:|:---------------:|:--------:|
55
+ | 1.156 | 1.0 | 1585 | 0.8263 | 0.7540 |
56
+ | 0.6895 | 2.0 | 3170 | 0.6674 | 0.7868 |
57
+ | 0.5994 | 3.0 | 4755 | 0.6469 | 0.7878 |
58
+ | 0.5539 | 4.0 | 6340 | 0.6289 | 0.7930 |
59
+ | 0.5228 | 5.0 | 7925 | 0.6235 | 0.7934 |
60
+ | 0.5095 | 6.0 | 9510 | 0.6202 | 0.7934 |
61
+ | 0.4845 | 7.0 | 11095 | 0.6232 | 0.7933 |
62
+ | 0.4863 | 8.0 | 12680 | 0.6232 | 0.7953 |
63
 
64
 
65
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9b593cd6155d724da34542a89dba1229fd3a64a01fc20a7c3c2ca665003e055f
3
  size 498640508
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf0611d191c0ee1d86a17e5b4e4399328f604cdcfa32f6f44c291e5f5d90f1fa
3
  size 498640508