Mbabazi commited on
Commit
1cea8c2
1 Parent(s): 669cab6

End of training

Browse files
Files changed (3) hide show
  1. README.md +8 -11
  2. pytorch_model.bin +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.5349
21
- - Accuracy: 0.691
22
 
23
  ## Model description
24
 
@@ -37,23 +37,20 @@ More information needed
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
- - learning_rate: 5.225114948240351e-05
41
- - train_batch_size: 8
42
- - eval_batch_size: 8
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
- - lr_scheduler_warmup_steps: 250
47
- - num_epochs: 4
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
53
- | 0.3542 | 1.0 | 1000 | 0.5356 | 0.7025 |
54
- | 0.4943 | 2.0 | 2000 | 0.5377 | 0.6915 |
55
- | 0.396 | 3.0 | 3000 | 0.5391 | 0.6855 |
56
- | 0.3931 | 4.0 | 4000 | 0.5349 | 0.691 |
57
 
58
 
59
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.5668
21
+ - Accuracy: 0.671
22
 
23
  ## Model description
24
 
 
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
+ - learning_rate: 0.00040460203863093065
41
+ - train_batch_size: 32
42
+ - eval_batch_size: 32
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
+ - lr_scheduler_warmup_steps: 369
47
+ - num_epochs: 1
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
53
+ | 0.4432 | 1.0 | 250 | 0.5668 | 0.671 |
 
 
 
54
 
55
 
56
  ### Framework versions
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:17cb7728bedb9969d9c16a1ea624c76c71c214c2eee1a38c5a226e1f706b3316
3
  size 267859050
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8013aedf497a99229cb439ea3e9f92a7f66aabf6195af1eb5492459924df07d2
3
  size 267859050
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:01e7e04b92c84ccd6428e04b459bcdee4fdb067f12287979d587cacaa4e29cab
3
  size 4536
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a835e49d84f4f864f3d2da39e3cabf603920635cdf56e5ad406c2e4aa62dcc1
3
  size 4536