Hugging Face's logo

ShynBui
/
Bartpho_spelling_correction

Text2Text Generation
Transformers
TensorBoard
Safetensors
mbart
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
1
ShynBui commited on
Commit
f65ec0e
·
verified ·
1 Parent(s): cfe82bf

Training complete

Browse files
Files changed (3) hide show
  1. README.md +65 -77
  2. generation_config.json +9 -9
  3. model.safetensors +1 -1
README.md CHANGED
@@ -1,77 +1,65 @@
1
- ---
2
- tags:
3
- - generated_from_trainer
4
- model-index:
5
- - name: Bartpho_spelling_correction
6
- results: []
7
- license: apache-2.0
8
- datasets:
9
- - ShynBui/Vietnamese_spelling_error
10
- language:
11
- - vi
12
- metrics:
13
- - bleu
14
- library_name: transformers
15
- pipeline_tag: summarization
16
- ---
17
-
18
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
19
- should probably proofread and complete it, then remove this comment. -->
20
-
21
- # Bartpho_spelling_correction
22
-
23
- This model was trained from scratch on the None dataset.
24
- It achieves the following results on the evaluation set:
25
- - Loss: 0.0025
26
-
27
- ## Model description
28
-
29
- More information needed
30
-
31
- ## Intended uses & limitations
32
-
33
- More information needed
34
-
35
- ## Training and evaluation data
36
-
37
- More information needed
38
-
39
- ## Training procedure
40
-
41
- ### Training hyperparameters
42
-
43
- The following hyperparameters were used during training:
44
- - learning_rate: 2e-05
45
- - train_batch_size: 4
46
- - eval_batch_size: 4
47
- - seed: 42
48
- - gradient_accumulation_steps: 4
49
- - total_train_batch_size: 16
50
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
- - lr_scheduler_type: linear
52
- - num_epochs: 1
53
- - mixed_precision_training: Native AMP
54
-
55
- ### Training results
56
-
57
- | Training Loss | Epoch | Step | Validation Loss |
58
- |:-------------:|:------:|:-----:|:---------------:|
59
- | 0.0122 | 0.0842 | 2000 | 0.0067 |
60
- | 0.0084 | 0.1684 | 4000 | 0.0053 |
61
- | 0.007 | 0.2526 | 6000 | 0.0045 |
62
- | 0.0062 | 0.3369 | 8000 | 0.0040 |
63
- | 0.0054 | 0.4211 | 10000 | 0.0036 |
64
- | 0.0051 | 0.5053 | 12000 | 0.0034 |
65
- | 0.0046 | 0.5895 | 14000 | 0.0032 |
66
- | 0.0043 | 0.6737 | 16000 | 0.0029 |
67
- | 0.0039 | 0.7579 | 18000 | 0.0027 |
68
- | 0.0038 | 0.8421 | 20000 | 0.0026 |
69
- | 0.0035 | 0.9263 | 22000 | 0.0025 |
70
-
71
-
72
- ### Framework versions
73
-
74
- - Transformers 4.42.4
75
- - Pytorch 2.3.1+cu121
76
- - Datasets 2.20.0
77
- - Tokenizers 0.19.1
 
1
+ ---
2
+ library_name: transformers
3
+ license: mit
4
+ base_model: vinai/bartpho-syllable
5
+ tags:
6
+ - generated_from_trainer
7
+ model-index:
8
+ - name: Bartpho_spelling_correction
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # Bartpho_spelling_correction
16
+
17
+ This model is a fine-tuned version of [vinai/bartpho-syllable](https://huggingface.co/vinai/bartpho-syllable) on the None dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 0.0068
20
+
21
+ ## Model description
22
+
23
+ More information needed
24
+
25
+ ## Intended uses & limitations
26
+
27
+ More information needed
28
+
29
+ ## Training and evaluation data
30
+
31
+ More information needed
32
+
33
+ ## Training procedure
34
+
35
+ ### Training hyperparameters
36
+
37
+ The following hyperparameters were used during training:
38
+ - learning_rate: 2e-05
39
+ - train_batch_size: 8
40
+ - eval_batch_size: 8
41
+ - seed: 42
42
+ - gradient_accumulation_steps: 8
43
+ - total_train_batch_size: 64
44
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
+ - lr_scheduler_type: linear
46
+ - num_epochs: 1
47
+ - mixed_precision_training: Native AMP
48
+
49
+ ### Training results
50
+
51
+ | Training Loss | Epoch | Step | Validation Loss |
52
+ |:-------------:|:------:|:-----:|:---------------:|
53
+ | 0.3258 | 0.1818 | 2000 | 0.0122 |
54
+ | 0.0153 | 0.3636 | 4000 | 0.0093 |
55
+ | 0.012 | 0.5455 | 6000 | 0.0078 |
56
+ | 0.0105 | 0.7273 | 8000 | 0.0072 |
57
+ | 0.0096 | 0.9091 | 10000 | 0.0068 |
58
+
59
+
60
+ ### Framework versions
61
+
62
+ - Transformers 4.44.2
63
+ - Pytorch 2.4.1
64
+ - Datasets 2.21.0
65
+ - Tokenizers 0.19.1
 
 
 
 
 
 
 
 
 
 
 
 
generation_config.json CHANGED
@@ -1,9 +1,9 @@
1
- {
2
- "_from_model_config": true,
3
- "bos_token_id": 0,
4
- "decoder_start_token_id": 2,
5
- "eos_token_id": 2,
6
- "forced_eos_token_id": 2,
7
- "pad_token_id": 1,
8
- "transformers_version": "4.42.4"
9
- }
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 0,
4
+ "decoder_start_token_id": 2,
5
+ "eos_token_id": 2,
6
+ "forced_eos_token_id": 2,
7
+ "pad_token_id": 1,
8
+ "transformers_version": "4.44.2"
9
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:71d8ec48698d53c91fdad98cd06a3385658d48bef841fb0fd1d051b8f3b63a29
3
  size 1583480280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b52f10e3d65787de70a32a767671d4692fd3b6772cbef34b3aaa28610439d21
3
  size 1583480280