nide01 commited on
Commit
ad8eb50
1 Parent(s): b7367d0

End of training

Browse files
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 2.1070
19
 
20
  ## Model description
21
 
@@ -34,21 +34,24 @@ More information needed
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
- - learning_rate: 2e-05
38
- - train_batch_size: 16
39
- - eval_batch_size: 16
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 3
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | No log | 1.0 | 250 | 2.3553 |
50
- | 2.7105 | 2.0 | 500 | 2.1268 |
51
- | 2.7105 | 3.0 | 750 | 2.1070 |
 
 
 
52
 
53
 
54
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 1.8440
19
 
20
  ## Model description
21
 
 
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
+ - learning_rate: 3e-05
38
+ - train_batch_size: 18
39
+ - eval_batch_size: 18
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - num_epochs: 6
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | No log | 1.0 | 223 | 2.1345 |
50
+ | No log | 2.0 | 446 | 1.5920 |
51
+ | 2.2917 | 3.0 | 669 | 1.5936 |
52
+ | 2.2917 | 4.0 | 892 | 1.6335 |
53
+ | 0.7633 | 5.0 | 1115 | 1.7695 |
54
+ | 0.7633 | 6.0 | 1338 | 1.8440 |
55
 
56
 
57
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3716be10495eb5a23a015968fcdbc51e27abd0d8be83bb9201b36fc6a57a3582
3
  size 265470032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e00623fcfc402c74c82a112e3fdb5571a7f7b1f0b113443b2ccac6650284ea52
3
  size 265470032
runs/Apr10_16-14-43_DESKTOP-O0E3GS1/events.out.tfevents.1712762083.DESKTOP-O0E3GS1.25196.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5dcd7e2d82f6c79d3ff570d4b06e73ee544d7745c89e43a23694f47aa23cce7c
3
- size 5980
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e24028b5bc898a39414320b781afe12d2580f5d029bb299c5ef9f4bf3d2f86e
3
+ size 6876