Hugging Face's logo

DrishtiSharma
/
wav2vec2-large-xls-r-300m-myv-v1

Automatic Speech Recognition
Transformers
PyTorch
TensorBoard
Erzya
wav2vec2
mozilla-foundation/common_voice_8_0
Generated from Trainer
robust-speech-event
model_for_talk
hf-asr-leaderboard
Eval Results
Inference Endpoints
Model card Files Metrics Community
wav2vec2-large-xls-r-300m-myv-v1 / README.md
anton-l's picture
anton-l HF staff
Upload README.md
1eb3e4e
preview code
|
raw
history blame contribute delete
7.3 kB
metadata
language:
  - myv
license: apache-2.0
tags:
  - automatic-speech-recognition
  - mozilla-foundation/common_voice_8_0
  - generated_from_trainer
  - myv
  - robust-speech-event
  - model_for_talk
  - hf-asr-leaderboard
datasets:
  - mozilla-foundation/common_voice_8_0
model-index:
  - name: wav2vec2-large-xls-r-300m-myv-v1
    results:
      - task:
          name: Automatic Speech Recognition
          type: automatic-speech-recognition
        dataset:
          name: Common Voice 8
          type: mozilla-foundation/common_voice_8_0
          args: myv
        metrics:
          - name: Test WER
            type: wer
            value: 0.599548532731377
          - name: Test CER
            type: cer
            value: 0.12953851902597
      - task:
          name: Automatic Speech Recognition
          type: automatic-speech-recognition
        dataset:
          name: Robust Speech Event - Dev Data
          type: speech-recognition-community-v2/dev_data
          args: myv
        metrics:
          - name: Test WER
            type: wer
            value: NA
          - name: Test CER
            type: cer
            value: NA

wav2vec2-large-xls-r-300m-myv-v1

This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the MOZILLA-FOUNDATION/COMMON_VOICE_8_0 - MYV dataset. It achieves the following results on the evaluation set:

  • Loss: 0.8537
  • Wer: 0.6160

Evaluation Commands

  1. To evaluate on mozilla-foundation/common_voice_8_0 with test split

python eval.py --model_id DrishtiSharma/wav2vec2-large-xls-r-300m-myv-v1 --dataset mozilla-foundation/common_voice_8_0 --config myv --split test --log_outputs

  1. To evaluate on speech-recognition-community-v2/dev_data

Erzya language not found in speech-recognition-community-v2/dev_data!

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.000222
  • train_batch_size: 16
  • eval_batch_size: 8
  • seed: 42
  • gradient_accumulation_steps: 2
  • total_train_batch_size: 32
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_steps: 1000
  • num_epochs: 150
  • mixed_precision_training: Native AMP

Training results

Training Loss Epoch Step Validation Loss Wer
19.453 1.92 50 16.4001 1.0
9.6875 3.85 100 5.4468 1.0
4.9988 5.77 150 4.3507 1.0
4.1148 7.69 200 3.6753 1.0
3.4922 9.62 250 3.3103 1.0
3.2443 11.54 300 3.1741 1.0
3.164 13.46 350 3.1346 1.0
3.0954 15.38 400 3.0428 1.0
3.0076 17.31 450 2.9137 1.0
2.6883 19.23 500 2.1476 0.9978
1.5124 21.15 550 0.8955 0.8225
0.8711 23.08 600 0.6948 0.7591
0.6695 25.0 650 0.6683 0.7636
0.5606 26.92 700 0.6821 0.7435
0.503 28.85 750 0.7220 0.7516
0.4528 30.77 800 0.6638 0.7324
0.4219 32.69 850 0.7120 0.7435
0.4109 34.62 900 0.7122 0.7511
0.3887 36.54 950 0.7179 0.7199
0.3895 38.46 1000 0.7322 0.7525
0.391 40.38 1050 0.6850 0.7364
0.3537 42.31 1100 0.7571 0.7279
0.3267 44.23 1150 0.7575 0.7257
0.3195 46.15 1200 0.7580 0.6998
0.2891 48.08 1250 0.7452 0.7101
0.294 50.0 1300 0.7316 0.6945
0.2854 51.92 1350 0.7241 0.6757
0.2801 53.85 1400 0.7532 0.6887
0.2502 55.77 1450 0.7587 0.6811
0.2427 57.69 1500 0.7231 0.6851
0.2311 59.62 1550 0.7288 0.6632
0.2176 61.54 1600 0.7711 0.6664
0.2117 63.46 1650 0.7914 0.6940
0.2114 65.38 1700 0.8065 0.6918
0.1913 67.31 1750 0.8372 0.6945
0.1897 69.23 1800 0.8051 0.6869
0.1865 71.15 1850 0.8076 0.6740
0.1844 73.08 1900 0.7935 0.6708
0.1757 75.0 1950 0.8015 0.6610
0.1636 76.92 2000 0.7614 0.6414
0.1637 78.85 2050 0.8123 0.6592
0.1599 80.77 2100 0.7907 0.6566
0.1498 82.69 2150 0.8641 0.6757
0.1545 84.62 2200 0.7438 0.6682
0.1433 86.54 2250 0.8014 0.6624
0.1427 88.46 2300 0.7758 0.6646
0.1423 90.38 2350 0.7741 0.6423
0.1298 92.31 2400 0.7938 0.6414
0.1111 94.23 2450 0.7976 0.6467
0.1243 96.15 2500 0.7916 0.6481
0.1215 98.08 2550 0.7594 0.6392
0.113 100.0 2600 0.8236 0.6392
0.1077 101.92 2650 0.7959 0.6347
0.0988 103.85 2700 0.8189 0.6392
0.0953 105.77 2750 0.8157 0.6414
0.0889 107.69 2800 0.7946 0.6369
0.0929 109.62 2850 0.8255 0.6360
0.0822 111.54 2900 0.8320 0.6334
0.086 113.46 2950 0.8539 0.6490
0.0825 115.38 3000 0.8438 0.6418
0.0727 117.31 3050 0.8568 0.6481
0.0717 119.23 3100 0.8447 0.6512
0.0815 121.15 3150 0.8470 0.6445
0.0689 123.08 3200 0.8264 0.6249
0.0726 125.0 3250 0.7981 0.6169
0.0648 126.92 3300 0.8237 0.6200
0.0632 128.85 3350 0.8416 0.6249
0.06 130.77 3400 0.8276 0.6173
0.0616 132.69 3450 0.8429 0.6209
0.0614 134.62 3500 0.8485 0.6271
0.0539 136.54 3550 0.8598 0.6218
0.0555 138.46 3600 0.8557 0.6169
0.0604 140.38 3650 0.8436 0.6186
0.0556 142.31 3700 0.8428 0.6178
0.051 144.23 3750 0.8440 0.6142
0.0526 146.15 3800 0.8566 0.6142
0.052 148.08 3850 0.8544 0.6178
0.0519 150.0 3900 0.8537 0.6160

Framework versions

  • Transformers 4.16.2
  • Pytorch 1.10.0+cu111
  • Datasets 1.18.2
  • Tokenizers 0.11.0