RayenLLM commited on
Commit
9138a68
·
verified ·
1 Parent(s): 73b4c55

End of training

Browse files
README.md CHANGED
@@ -19,10 +19,10 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.5532
23
- - Accuracy: 0.762
24
- - Auc: 0.662
25
- - Precision: 0.789
26
 
27
  ## Model description
28
 
@@ -42,8 +42,8 @@ More information needed
42
 
43
  The following hyperparameters were used during training:
44
  - learning_rate: 0.0002
45
- - train_batch_size: 8
46
- - eval_batch_size: 8
47
  - seed: 42
48
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
49
  - lr_scheduler_type: linear
@@ -53,16 +53,16 @@ The following hyperparameters were used during training:
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | Auc | Precision |
55
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:-----:|:---------:|
56
- | 0.6737 | 1.0 | 21 | 0.6780 | 0.571 | 0.625 | 0.818 |
57
- | 0.673 | 2.0 | 42 | 0.5509 | 0.762 | 0.688 | 0.762 |
58
- | 0.6283 | 3.0 | 63 | 0.5884 | 0.714 | 0.65 | 0.75 |
59
- | 0.621 | 4.0 | 84 | 0.5868 | 0.762 | 0.65 | 0.789 |
60
- | 0.6016 | 5.0 | 105 | 0.5632 | 0.762 | 0.65 | 0.789 |
61
- | 0.5837 | 6.0 | 126 | 0.5434 | 0.714 | 0.662 | 0.75 |
62
- | 0.5671 | 7.0 | 147 | 0.5921 | 0.667 | 0.662 | 0.765 |
63
- | 0.5686 | 8.0 | 168 | 0.5448 | 0.762 | 0.675 | 0.789 |
64
- | 0.5659 | 9.0 | 189 | 0.5459 | 0.762 | 0.662 | 0.789 |
65
- | 0.5747 | 10.0 | 210 | 0.5532 | 0.762 | 0.662 | 0.789 |
66
 
67
 
68
  ### Framework versions
 
19
 
20
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.5419
23
+ - Accuracy: 0.524
24
+ - Auc: 0.65
25
+ - Precision: 0.714
26
 
27
  ## Model description
28
 
 
42
 
43
  The following hyperparameters were used during training:
44
  - learning_rate: 0.0002
45
+ - train_batch_size: 5
46
+ - eval_batch_size: 5
47
  - seed: 42
48
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
49
  - lr_scheduler_type: linear
 
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | Auc | Precision |
55
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:-----:|:---------:|
56
+ | 0.5815 | 1.0 | 34 | 0.6348 | 0.619 | 0.688 | 0.9 |
57
+ | 0.5744 | 2.0 | 68 | 0.5624 | 0.667 | 0.688 | 0.765 |
58
+ | 0.5532 | 3.0 | 102 | 0.5057 | 0.762 | 0.688 | 0.789 |
59
+ | 0.563 | 4.0 | 136 | 0.5677 | 0.571 | 0.688 | 0.769 |
60
+ | 0.514 | 5.0 | 170 | 0.5423 | 0.667 | 0.662 | 0.765 |
61
+ | 0.5349 | 6.0 | 204 | 0.5564 | 0.571 | 0.65 | 0.769 |
62
+ | 0.5298 | 7.0 | 238 | 0.5672 | 0.571 | 0.65 | 0.769 |
63
+ | 0.4964 | 8.0 | 272 | 0.5173 | 0.667 | 0.65 | 0.765 |
64
+ | 0.5083 | 9.0 | 306 | 0.5435 | 0.571 | 0.65 | 0.769 |
65
+ | 0.4908 | 10.0 | 340 | 0.5419 | 0.524 | 0.65 | 0.714 |
66
 
67
 
68
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0b600d32efcce8a78480514b6223f02d015c048ab19ec3b19e32674193a4aff7
3
  size 267832560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8077e7bc94d39ae7cc98e34e9c0a0be850100d69f0755dafa7dc6abf3fccde4c
3
  size 267832560
runs/Mar13_03-03-25_78834890537e/events.out.tfevents.1741835019.78834890537e.1616.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3931d3eab60536e0f83868eff4c04fedb7ac4380512fdaadd1d7496ddd2ac31c
3
+ size 11810
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3536cf8d2abda9ce213eeb53071d131b7c5408aa40e637e13a790b9d086023ad
3
  size 5368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11019076554685cecf69d2137a562e0858fea104819f5ebdb8244a1776f96cc0
3
  size 5368