zohreaz commited on
Commit
760e6ba
·
verified ·
1 Parent(s): 7462af3

Model save

Browse files
README.md CHANGED
@@ -3,6 +3,11 @@ license: bigscience-openrail-m
3
  base_model: ehsanaghaei/SecureBERT
4
  tags:
5
  - generated_from_trainer
 
 
 
 
 
6
  model-index:
7
  - name: SecureBERT-finetuned-ner
8
  results: []
@@ -15,16 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [ehsanaghaei/SecureBERT](https://huggingface.co/ehsanaghaei/SecureBERT) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - eval_loss: 0.3307
19
- - eval_precision: 0.8102
20
- - eval_recall: 0.8412
21
- - eval_f1: 0.8254
22
- - eval_accuracy: 0.9269
23
- - eval_runtime: 7.8038
24
- - eval_samples_per_second: 153.386
25
- - eval_steps_per_second: 38.443
26
- - epoch: 5.0
27
- - step: 11975
28
 
29
  ## Model description
30
 
@@ -49,7 +49,18 @@ The following hyperparameters were used during training:
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
- - num_epochs: 20
 
 
 
 
 
 
 
 
 
 
 
53
 
54
  ### Framework versions
55
 
 
3
  base_model: ehsanaghaei/SecureBERT
4
  tags:
5
  - generated_from_trainer
6
+ metrics:
7
+ - precision
8
+ - recall
9
+ - f1
10
+ - accuracy
11
  model-index:
12
  - name: SecureBERT-finetuned-ner
13
  results: []
 
20
 
21
  This model is a fine-tuned version of [ehsanaghaei/SecureBERT](https://huggingface.co/ehsanaghaei/SecureBERT) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.4660
24
+ - Precision: 0.8270
25
+ - Recall: 0.8429
26
+ - F1: 0.8349
27
+ - Accuracy: 0.9309
 
 
 
 
 
28
 
29
  ## Model description
30
 
 
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
+ - num_epochs: 5
53
+
54
+ ### Training results
55
+
56
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
57
+ |:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
58
+ | 0.1046 | 1.0 | 2395 | 0.3706 | 0.8023 | 0.8288 | 0.8153 | 0.9250 |
59
+ | 0.0707 | 2.0 | 4790 | 0.3917 | 0.8138 | 0.8415 | 0.8274 | 0.9297 |
60
+ | 0.0551 | 3.0 | 7185 | 0.4256 | 0.8220 | 0.8374 | 0.8296 | 0.9293 |
61
+ | 0.0371 | 4.0 | 9580 | 0.4476 | 0.8293 | 0.8406 | 0.8349 | 0.9306 |
62
+ | 0.0265 | 5.0 | 11975 | 0.4660 | 0.8270 | 0.8429 | 0.8349 | 0.9309 |
63
+
64
 
65
  ### Framework versions
66
 
runs/Jul30_08-27-44_060c39296710/events.out.tfevents.1722328069.060c39296710.943.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4318bbf9986f04e8a652941c8293122bec4536ca23db9bac7ffad20de198630d
3
- size 15422
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b4ed434ff893eff9f728f5430caaa7f8d5dadeeb3243dd6d925bd498ff80269
3
+ size 16248
runs/Jul30_08-27-44_060c39296710/events.out.tfevents.1722330254.060c39296710.943.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1366ea211957047c9b8804e7234e9ed48f5e2e8b758b74e3ba0373cba8abc19
3
+ size 560