AdaCodruta commited on
Commit
3471758
·
verified ·
1 Parent(s): 0ace1ad

End of training

Browse files
Files changed (2) hide show
  1. README.md +20 -19
  2. model.safetensors +1 -1
README.md CHANGED
@@ -1,4 +1,5 @@
1
  ---
 
2
  license: apache-2.0
3
  base_model: facebook/wav2vec2-base
4
  tags:
@@ -8,32 +9,32 @@ datasets:
8
  metrics:
9
  - wer
10
  model-index:
11
- - name: wav2vec2-romanian-test
12
  results:
13
  - task:
14
- type: automatic-speech-recognition
15
  name: Automatic Speech Recognition
 
16
  dataset:
17
  name: common_voice_17_0
18
  type: common_voice_17_0
19
  config: ro
20
- split: validation
21
  args: ro
22
  metrics:
23
- - type: wer
24
- value: 0.9992270033496522
25
- name: Wer
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
29
  should probably proofread and complete it, then remove this comment. -->
30
 
31
- # wav2vec2-romanian-test
32
 
33
  This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on the common_voice_17_0 dataset.
34
  It achieves the following results on the evaluation set:
35
- - Loss: 0.7702
36
- - Wer: 0.9992
37
 
38
  ## Model description
39
 
@@ -56,7 +57,7 @@ The following hyperparameters were used during training:
56
  - train_batch_size: 32
57
  - eval_batch_size: 8
58
  - seed: 42
59
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
60
  - lr_scheduler_type: linear
61
  - lr_scheduler_warmup_steps: 500
62
  - training_steps: 5000
@@ -66,16 +67,16 @@ The following hyperparameters were used during training:
66
 
67
  | Training Loss | Epoch | Step | Validation Loss | Wer |
68
  |:-------------:|:-------:|:----:|:---------------:|:------:|
69
- | 0.4402 | 6.2112 | 1000 | 0.8085 | 0.9997 |
70
- | 0.1779 | 12.4224 | 2000 | 0.8190 | 0.9992 |
71
- | 0.1242 | 18.6335 | 3000 | 0.7426 | 0.9990 |
72
- | 0.1003 | 24.8447 | 4000 | 0.7451 | 0.9990 |
73
- | 0.0862 | 31.0559 | 5000 | 0.7702 | 0.9992 |
74
 
75
 
76
  ### Framework versions
77
 
78
- - Transformers 4.40.2
79
- - Pytorch 2.5.1+cu118
80
- - Datasets 3.1.0
81
- - Tokenizers 0.19.1
 
1
  ---
2
+ library_name: transformers
3
  license: apache-2.0
4
  base_model: facebook/wav2vec2-base
5
  tags:
 
9
  metrics:
10
  - wer
11
  model-index:
12
+ - name: wav2vec2_common_voice17_finetuning
13
  results:
14
  - task:
 
15
  name: Automatic Speech Recognition
16
+ type: automatic-speech-recognition
17
  dataset:
18
  name: common_voice_17_0
19
  type: common_voice_17_0
20
  config: ro
21
+ split: test
22
  args: ro
23
  metrics:
24
+ - name: Wer
25
+ type: wer
26
+ value: 1.0
27
  ---
28
 
29
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
30
  should probably proofread and complete it, then remove this comment. -->
31
 
32
+ # wav2vec2_common_voice17_finetuning
33
 
34
  This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on the common_voice_17_0 dataset.
35
  It achieves the following results on the evaluation set:
36
+ - Loss: 0.4054
37
+ - Wer: 1.0
38
 
39
  ## Model description
40
 
 
57
  - train_batch_size: 32
58
  - eval_batch_size: 8
59
  - seed: 42
60
+ - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
61
  - lr_scheduler_type: linear
62
  - lr_scheduler_warmup_steps: 500
63
  - training_steps: 5000
 
67
 
68
  | Training Loss | Epoch | Step | Validation Loss | Wer |
69
  |:-------------:|:-------:|:----:|:---------------:|:------:|
70
+ | 0.6577 | 3.5461 | 1000 | 0.4788 | 0.9997 |
71
+ | 0.2893 | 7.0922 | 2000 | 0.4086 | 1.0 |
72
+ | 0.1997 | 10.6383 | 3000 | 0.4135 | 0.9997 |
73
+ | 0.156 | 14.1844 | 4000 | 0.4051 | 0.9992 |
74
+ | 0.138 | 17.7305 | 5000 | 0.4054 | 1.0 |
75
 
76
 
77
  ### Framework versions
78
 
79
+ - Transformers 4.49.0
80
+ - Pytorch 2.4.1+cu124
81
+ - Datasets 2.21.0
82
+ - Tokenizers 0.21.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ea070f7b75827e137dde471f08f0ab8bd83612b5aa65f2763824f5837b20d923
3
  size 377654192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e51717ae660d96760858d4f1145c2dc68f1a6722f0bc48389493bb16528a469
3
  size 377654192