Hugging Face's logo

CbI3PAHb
/
my_model

Text Classification
Transformers
TensorBoard
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
CbI3PAHb commited on
Commit
e60f168
·
verified ·
1 Parent(s): 0bf48c1

End of training

Browse files
Files changed (8) hide show
  1. README.md +14 -11
  2. config.json +1 -1
  3. model.safetensors +2 -2
  4. runs/Jun24_17-11-15_3b2eb12d761d/events.out.tfevents.1719249088.3b2eb12d761d.1325.0 +3 -0
  5. runs/Jun24_18-05-19_3b2eb12d761d/events.out.tfevents.1719252357.3b2eb12d761d.1325.1 +3 -0
  6. tokenizer.json +6 -10
  7. tokenizer_config.json +0 -8
  8. training_args.bin +1 -1
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [DeepPavlov/rubert-base-cased-conversational](https://huggingface.co/DeepPavlov/rubert-base-cased-conversational) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.1583
20
- - Accuracy: 0.9542
21
 
22
  ## Model description
23
 
@@ -37,22 +37,25 @@ More information needed
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 2e-05
40
- - train_batch_size: 32
41
- - eval_batch_size: 32
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
- - num_epochs: 4
46
  - mixed_precision_training: Native AMP
47
 
48
  ### Training results
49
 
50
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
- |:-------------:|:-----:|:-----:|:---------------:|:--------:|
52
- | 0.223 | 1.0 | 3524 | 0.1747 | 0.9438 |
53
- | 0.1435 | 2.0 | 7048 | 0.1583 | 0.9542 |
54
- | 0.0892 | 3.0 | 10572 | 0.1824 | 0.9562 |
55
- | 0.05 | 4.0 | 14096 | 0.2020 | 0.9578 |
 
 
 
56
 
57
 
58
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [DeepPavlov/rubert-base-cased-conversational](https://huggingface.co/DeepPavlov/rubert-base-cased-conversational) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.1517
20
+ - Accuracy: 0.9568
21
 
22
  ## Model description
23
 
 
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 2e-05
40
+ - train_batch_size: 128
41
+ - eval_batch_size: 128
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
+ - num_epochs: 10
46
  - mixed_precision_training: Native AMP
47
 
48
  ### Training results
49
 
50
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
52
+ | 0.7699 | 1.0 | 881 | 0.2688 | 0.9057 |
53
+ | 0.268 | 2.0 | 1762 | 0.1825 | 0.9412 |
54
+ | 0.1903 | 3.0 | 2643 | 0.1592 | 0.9497 |
55
+ | 0.1528 | 4.0 | 3524 | 0.1506 | 0.9526 |
56
+ | 0.133 | 5.0 | 4405 | 0.1448 | 0.9551 |
57
+ | 0.1104 | 6.0 | 5286 | 0.1410 | 0.9579 |
58
+ | 0.0965 | 7.0 | 6167 | 0.1517 | 0.9568 |
59
 
60
 
61
  ### Framework versions
config.json CHANGED
@@ -45,5 +45,5 @@
45
  "transformers_version": "4.41.2",
46
  "type_vocab_size": 2,
47
  "use_cache": true,
48
- "vocab_size": 120832
49
  }
 
45
  "transformers_version": "4.41.2",
46
  "type_vocab_size": 2,
47
  "use_cache": true,
48
+ "vocab_size": 119547
49
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:708491be7bc249ef7d2c035e1ee7799d694d4cc2e7cf20beb52e2ed957f83dab
3
- size 715403280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b1a1bd216eaf325b6f2f85b4ec895385f2ece497ebac098a7e55e5359eea004
3
+ size 711455760
runs/Jun24_17-11-15_3b2eb12d761d/events.out.tfevents.1719249088.3b2eb12d761d.1325.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02e50e24edbdd4f40a0cdfda9af4822c154e0c36592b958a882af64f6adeed74
3
+ size 10460
runs/Jun24_18-05-19_3b2eb12d761d/events.out.tfevents.1719252357.3b2eb12d761d.1325.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0cd218219010b031cadef4ca96af197ae3fe522989b4838b65afdbdcad6139d2
3
+ size 10701
tokenizer.json CHANGED
@@ -1,6 +1,11 @@
1
  {
2
  "version": "1.0",
3
- "truncation": null,
 
 
 
 
 
4
  "padding": null,
5
  "added_tokens": [
6
  {
@@ -47,15 +52,6 @@
47
  "rstrip": false,
48
  "normalized": false,
49
  "special": true
50
- },
51
- {
52
- "id": 100792,
53
- "content": "[NEW_TOKEN]",
54
- "single_word": false,
55
- "lstrip": false,
56
- "rstrip": false,
57
- "normalized": true,
58
- "special": false
59
  }
60
  ],
61
  "normalizer": {
 
1
  {
2
  "version": "1.0",
3
+ "truncation": {
4
+ "direction": "Right",
5
+ "max_length": 130,
6
+ "strategy": "LongestFirst",
7
+ "stride": 0
8
+ },
9
  "padding": null,
10
  "added_tokens": [
11
  {
 
52
  "rstrip": false,
53
  "normalized": false,
54
  "special": true
 
 
 
 
 
 
 
 
 
55
  }
56
  ],
57
  "normalizer": {
tokenizer_config.json CHANGED
@@ -39,14 +39,6 @@
39
  "rstrip": false,
40
  "single_word": false,
41
  "special": true
42
- },
43
- "100792": {
44
- "content": "[NEW_TOKEN]",
45
- "lstrip": false,
46
- "normalized": true,
47
- "rstrip": false,
48
- "single_word": false,
49
- "special": false
50
  }
51
  },
52
  "clean_up_tokenization_spaces": true,
 
39
  "rstrip": false,
40
  "single_word": false,
41
  "special": true
 
 
 
 
 
 
 
 
42
  }
43
  },
44
  "clean_up_tokenization_spaces": true,
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2f7e76f913e35f70229684e9d924002e26f00601d1ba6da60432775474b0bfa2
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7961b1782e58e2bfb3121813882ab66b734d1646e9f042aecb361ffb4ba41fbf
3
  size 5112