miosipof commited on
Commit
abbd403
1 Parent(s): d1153b2

End of training

Browse files
Files changed (3) hide show
  1. README.md +29 -18
  2. adapter_model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -24,7 +24,7 @@ model-index:
24
  args: default
25
  metrics:
26
  - type: wer
27
- value: 81.93548387096774
28
  name: Wer
29
  ---
30
 
@@ -35,8 +35,8 @@ should probably proofread and complete it, then remove this comment. -->
35
 
36
  This model is a fine-tuned version of [openai/whisper-medium](https://huggingface.co/openai/whisper-medium) on the Dysarthria_Synthetic_Easycall_Common dataset.
37
  It achieves the following results on the evaluation set:
38
- - Loss: 3.7887
39
- - Wer: 81.9355
40
 
41
  ## Model description
42
 
@@ -57,30 +57,41 @@ More information needed
57
  The following hyperparameters were used during training:
58
  - learning_rate: 1e-05
59
  - train_batch_size: 16
60
- - eval_batch_size: 8
61
  - seed: 42
62
  - gradient_accumulation_steps: 2
63
  - total_train_batch_size: 32
64
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
65
- - lr_scheduler_type: linear
66
  - lr_scheduler_warmup_steps: 100
67
- - num_epochs: 7
68
  - mixed_precision_training: Native AMP
69
 
70
  ### Training results
71
 
72
- | Training Loss | Epoch | Step | Validation Loss | Wer |
73
- |:-------------:|:------:|:----:|:---------------:|:--------:|
74
- | 6.7033 | 0.6897 | 50 | 6.6396 | 205.1613 |
75
- | 6.091 | 1.3793 | 100 | 5.9043 | 160.0 |
76
- | 5.0041 | 2.0690 | 150 | 5.4640 | 163.2258 |
77
- | 4.4908 | 2.7586 | 200 | 5.0968 | 90.6452 |
78
- | 4.023 | 3.4483 | 250 | 4.7181 | 85.8065 |
79
- | 3.6629 | 4.1379 | 300 | 4.2892 | 83.2258 |
80
- | 3.3164 | 4.8276 | 350 | 4.0228 | 80.9677 |
81
- | 3.2009 | 5.5172 | 400 | 3.8851 | 82.2581 |
82
- | 3.0631 | 6.2069 | 450 | 3.8146 | 82.9032 |
83
- | 3.0098 | 6.8966 | 500 | 3.7887 | 81.9355 |
 
 
 
 
 
 
 
 
 
 
 
84
 
85
 
86
  ### Framework versions
 
24
  args: default
25
  metrics:
26
  - type: wer
27
+ value: 66.77419354838709
28
  name: Wer
29
  ---
30
 
 
35
 
36
  This model is a fine-tuned version of [openai/whisper-medium](https://huggingface.co/openai/whisper-medium) on the Dysarthria_Synthetic_Easycall_Common dataset.
37
  It achieves the following results on the evaluation set:
38
+ - Loss: 0.9709
39
+ - Wer: 66.7742
40
 
41
  ## Model description
42
 
 
57
  The following hyperparameters were used during training:
58
  - learning_rate: 1e-05
59
  - train_batch_size: 16
60
+ - eval_batch_size: 16
61
  - seed: 42
62
  - gradient_accumulation_steps: 2
63
  - total_train_batch_size: 32
64
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
65
+ - lr_scheduler_type: reduce_lr_on_plateau
66
  - lr_scheduler_warmup_steps: 100
67
+ - num_epochs: 15
68
  - mixed_precision_training: Native AMP
69
 
70
  ### Training results
71
 
72
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
73
+ |:-------------:|:-------:|:----:|:---------------:|:--------:|
74
+ | 6.1405 | 0.6897 | 50 | 5.7981 | 205.1613 |
75
+ | 4.968 | 1.3793 | 100 | 5.3200 | 164.8387 |
76
+ | 4.2444 | 2.0690 | 150 | 4.7663 | 85.8065 |
77
+ | 3.6175 | 2.7586 | 200 | 4.0413 | 83.8710 |
78
+ | 3.0351 | 3.4483 | 250 | 3.6257 | 80.3226 |
79
+ | 2.668 | 4.1379 | 300 | 3.2450 | 75.8065 |
80
+ | 2.3178 | 4.8276 | 350 | 2.8196 | 75.1613 |
81
+ | 1.9613 | 5.5172 | 400 | 2.3047 | 73.8710 |
82
+ | 1.5398 | 6.2069 | 450 | 1.8564 | 73.8710 |
83
+ | 1.2771 | 6.8966 | 500 | 1.5804 | 76.4516 |
84
+ | 1.0752 | 7.5862 | 550 | 1.3762 | 75.1613 |
85
+ | 0.8899 | 8.2759 | 600 | 1.2049 | 77.0968 |
86
+ | 0.7684 | 8.9655 | 650 | 1.1252 | 75.1613 |
87
+ | 0.7242 | 9.6552 | 700 | 1.0776 | 74.1935 |
88
+ | 0.67 | 10.3448 | 750 | 1.0567 | 72.9032 |
89
+ | 0.6405 | 11.0345 | 800 | 1.0334 | 73.2258 |
90
+ | 0.622 | 11.7241 | 850 | 1.0179 | 74.1935 |
91
+ | 0.5874 | 12.4138 | 900 | 1.0067 | 71.2903 |
92
+ | 0.5601 | 13.1034 | 950 | 0.9863 | 67.0968 |
93
+ | 0.544 | 13.7931 | 1000 | 0.9855 | 67.0968 |
94
+ | 0.538 | 14.4828 | 1050 | 0.9709 | 66.7742 |
95
 
96
 
97
  ### Framework versions
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9b108a300fd2cb8098162d77ee713545969948336c12077adce74af840ff5001
3
  size 37789960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1613efb7ffec72890cdb587280e03d88a6c641714c7284ff7b5009ccb64e4174
3
  size 37789960
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:412ef49982b3361160f450ff53c8a3dd615ea2c47e4c8171c5b789ecee8d7066
3
  size 5368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9c55d24ca47aeb895a7704d67ec5601894ae22f831a00c18eb1e787747fcedc
3
  size 5368