jonatasgrosman commited on
Commit
039c9c4
1 Parent(s): ea729e1

update evaluation

Browse files
README.md CHANGED
@@ -22,16 +22,16 @@ model-index:
22
  metrics:
23
  - name: Test WER
24
  type: wer
25
- value: 13.36
26
  - name: Test CER
27
  type: cer
28
- value: 3.61
29
  - name: Test WER (+LM)
30
  type: wer
31
- value: 10.05
32
  - name: Test CER (+LM)
33
  type: cer
34
- value: 3.02
35
  - task:
36
  name: Automatic Speech Recognition
37
  type: automatic-speech-recognition
@@ -56,8 +56,12 @@ model-index:
56
 
57
  # XLS-R-1B-GERMAN
58
 
59
- This model is a fine-tuned version of [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on the MOZILLA-FOUNDATION/COMMON_VOICE_8_0 - DE dataset.
 
60
 
 
 
 
61
 
62
  ## Evaluation Commands
63
 
 
22
  metrics:
23
  - name: Test WER
24
  type: wer
25
+ value: 10.95
26
  - name: Test CER
27
  type: cer
28
+ value: 2.72
29
  - name: Test WER (+LM)
30
  type: wer
31
+ value: 8.13
32
  - name: Test CER (+LM)
33
  type: cer
34
+ value: 2.18
35
  - task:
36
  name: Automatic Speech Recognition
37
  type: automatic-speech-recognition
 
56
 
57
  # XLS-R-1B-GERMAN
58
 
59
+ Fine-tuned [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on German using the [Common Voice 8](https://huggingface.co/datasets/mozilla-foundation/common_voice_8_0).
60
+ When using this model, make sure that your speech input is sampled at 16kHz.
61
 
62
+ This model has been fine-tuned thanks to the GPU credits generously given by the [OVHcloud](https://www.ovhcloud.com/en/public-cloud/ai-training/) :)
63
+
64
+ The script used for training can be found here: https://github.com/jonatasgrosman/wav2vec2-sprint
65
 
66
  ## Evaluation Commands
67
 
log_mozilla-foundation_common_voice_8_0_de_test_predictions.txt CHANGED
The diff for this file is too large to render. See raw diff
 
log_mozilla-foundation_common_voice_8_0_de_test_predictions_greedy.txt CHANGED
The diff for this file is too large to render. See raw diff
 
mozilla-foundation_common_voice_8_0_de_test_eval_results.txt CHANGED
@@ -1,2 +1,2 @@
1
- WER: 0.10052105356485207
2
- CER: 0.030289646794472255
 
1
+ WER: 0.08132936859765662
2
+ CER: 0.0218942169889596
mozilla-foundation_common_voice_8_0_de_test_eval_results_greedy.txt CHANGED
@@ -1,2 +1,2 @@
1
- WER: 0.13360522690382334
2
- CER: 0.03615821003362539
 
1
+ WER: 0.10957129022137957
2
+ CER: 0.027228823349596854