SharonTudi commited on
Commit
c552f86
·
verified ·
1 Parent(s): bc6edac

End of training

Browse files
README.md CHANGED
@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [distilbert-base-cased](https://huggingface.co/distilbert-base-cased) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 0.1121
24
- - Precision: 0.9762
25
- - Recall: 0.9737
26
- - F1: 0.9736
27
- - Accuracy: 0.9737
28
 
29
  ## Model description
30
 
@@ -43,33 +43,22 @@ More information needed
43
  ### Training hyperparameters
44
 
45
  The following hyperparameters were used during training:
46
- - learning_rate: 1e-05
47
  - train_batch_size: 8
48
  - eval_batch_size: 8
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
- - num_epochs: 15
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
57
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
58
- | 1.206 | 1.0 | 48 | 0.8496 | 0.8900 | 0.8421 | 0.8322 | 0.8421 |
59
- | 0.621 | 2.0 | 96 | 0.2971 | 1.0 | 1.0 | 1.0 | 1.0 |
60
- | 0.2411 | 3.0 | 144 | 0.1237 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
61
- | 0.0988 | 4.0 | 192 | 0.0829 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
62
- | 0.0471 | 5.0 | 240 | 0.0926 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
63
- | 0.0213 | 6.0 | 288 | 0.0924 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
64
- | 0.0142 | 7.0 | 336 | 0.1157 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
65
- | 0.0106 | 8.0 | 384 | 0.1067 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
66
- | 0.0086 | 9.0 | 432 | 0.1032 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
67
- | 0.007 | 10.0 | 480 | 0.1188 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
68
- | 0.0064 | 11.0 | 528 | 0.1134 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
69
- | 0.0059 | 12.0 | 576 | 0.1122 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
70
- | 0.0055 | 13.0 | 624 | 0.1109 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
71
- | 0.0053 | 14.0 | 672 | 0.1125 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
72
- | 0.0052 | 15.0 | 720 | 0.1121 | 0.9762 | 0.9737 | 0.9736 | 0.9737 |
73
 
74
 
75
  ### Framework versions
 
20
 
21
  This model is a fine-tuned version of [distilbert-base-cased](https://huggingface.co/distilbert-base-cased) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.0912
24
+ - Precision: 1.0
25
+ - Recall: 1.0
26
+ - F1: 1.0
27
+ - Accuracy: 1.0
28
 
29
  ## Model description
30
 
 
43
  ### Training hyperparameters
44
 
45
  The following hyperparameters were used during training:
46
+ - learning_rate: 2e-05
47
  - train_batch_size: 8
48
  - eval_batch_size: 8
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
+ - num_epochs: 3
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
57
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
58
+ | 1.1769 | 0.62 | 30 | 0.7176 | 0.9737 | 0.9737 | 0.9737 | 0.9737 |
59
+ | 0.5852 | 1.25 | 60 | 0.2737 | 0.9875 | 0.9868 | 0.9868 | 0.9868 |
60
+ | 0.2857 | 1.88 | 90 | 0.1442 | 1.0 | 1.0 | 1.0 | 1.0 |
61
+ | 0.1518 | 2.5 | 120 | 0.0912 | 1.0 | 1.0 | 1.0 | 1.0 |
 
 
 
 
 
 
 
 
 
 
 
62
 
63
 
64
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:23a5643049aca9dca0a9756764cfb7d6f39ce033b1d08cd04a4e1b0dc4c49978
3
  size 263150840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fbcf81c3416217ad0245a9dde39cfd9c449a0d2a92c1d6a22fc6fe66b260bbf
3
  size 263150840
runs/Jan21_11-34-46_1a3a957c2842/events.out.tfevents.1705836891.1a3a957c2842.8067.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0afadab2419eb9c68aed7b54fd79a13b731008ae40947a104256dc3cdbf1d8ac
3
+ size 7317
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d4a7f306b7f3ec24c7f56a4a5a046c71adc46dd964de720e562953f73a7b333a
3
  size 4728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:376e19ef9f068003aff6b9b57aefd3728efe236fef839f2b63974f93d39acc61
3
  size 4728