README.md

---
language:
- myv
license: apache-2.0
tags:
- automatic-speech-recognition
- mozilla-foundation/common_voice_8_0
- generated_from_trainer
- myv
- robust-speech-event
- model_for_talk
- hf-asr-leaderboard
datasets:
- mozilla-foundation/common_voice_8_0
model-index:
- name: wav2vec2-large-xls-r-300m-myv-v1
  results:
  - task:
      name: Automatic Speech Recognition
      type: automatic-speech-recognition
    dataset:
      name: Common Voice 8
      type: mozilla-foundation/common_voice_8_0
      args: myv
    metrics:
    - name: Test WER
      type: wer
      value: 0.599548532731377
    - name: Test CER
      type: cer
      value: 0.12953851902597
  - task:
      name: Automatic Speech Recognition
      type: automatic-speech-recognition
    dataset:
      name: Robust Speech Event - Dev Data
      type: speech-recognition-community-v2/dev_data
      args: myv
    metrics:
    - name: Test WER
      type: wer
      value: NA
    - name: Test CER
      type: cer
      value: NA
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# wav2vec2-large-xls-r-300m-myv-v1

This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the MOZILLA-FOUNDATION/COMMON_VOICE_8_0 - MYV dataset.
It achieves the following results on the evaluation set:
- Loss: 0.8537
- Wer: 0.6160

### Evaluation Commands

1. To evaluate on mozilla-foundation/common_voice_8_0 with test split

python eval.py --model_id DrishtiSharma/wav2vec2-large-xls-r-300m-myv-v1 --dataset mozilla-foundation/common_voice_8_0 --config myv --split test --log_outputs

2. To evaluate on speech-recognition-community-v2/dev_data

Erzya language not found in speech-recognition-community-v2/dev_data!

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.000222
- train_batch_size: 16
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 2
- total_train_batch_size: 32
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 1000
- num_epochs: 150
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Wer    |
|:-------------:|:------:|:----:|:---------------:|:------:|
| 19.453        | 1.92   | 50   | 16.4001         | 1.0    |
| 9.6875        | 3.85   | 100  | 5.4468          | 1.0    |
| 4.9988        | 5.77   | 150  | 4.3507          | 1.0    |
| 4.1148        | 7.69   | 200  | 3.6753          | 1.0    |
| 3.4922        | 9.62   | 250  | 3.3103          | 1.0    |
| 3.2443        | 11.54  | 300  | 3.1741          | 1.0    |
| 3.164         | 13.46  | 350  | 3.1346          | 1.0    |
| 3.0954        | 15.38  | 400  | 3.0428          | 1.0    |
| 3.0076        | 17.31  | 450  | 2.9137          | 1.0    |
| 2.6883        | 19.23  | 500  | 2.1476          | 0.9978 |
| 1.5124        | 21.15  | 550  | 0.8955          | 0.8225 |
| 0.8711        | 23.08  | 600  | 0.6948          | 0.7591 |
| 0.6695        | 25.0   | 650  | 0.6683          | 0.7636 |
| 0.5606        | 26.92  | 700  | 0.6821          | 0.7435 |
| 0.503         | 28.85  | 750  | 0.7220          | 0.7516 |
| 0.4528        | 30.77  | 800  | 0.6638          | 0.7324 |
| 0.4219        | 32.69  | 850  | 0.7120          | 0.7435 |
| 0.4109        | 34.62  | 900  | 0.7122          | 0.7511 |
| 0.3887        | 36.54  | 950  | 0.7179          | 0.7199 |
| 0.3895        | 38.46  | 1000 | 0.7322          | 0.7525 |
| 0.391         | 40.38  | 1050 | 0.6850          | 0.7364 |
| 0.3537        | 42.31  | 1100 | 0.7571          | 0.7279 |
| 0.3267        | 44.23  | 1150 | 0.7575          | 0.7257 |
| 0.3195        | 46.15  | 1200 | 0.7580          | 0.6998 |
| 0.2891        | 48.08  | 1250 | 0.7452          | 0.7101 |
| 0.294         | 50.0   | 1300 | 0.7316          | 0.6945 |
| 0.2854        | 51.92  | 1350 | 0.7241          | 0.6757 |
| 0.2801        | 53.85  | 1400 | 0.7532          | 0.6887 |
| 0.2502        | 55.77  | 1450 | 0.7587          | 0.6811 |
| 0.2427        | 57.69  | 1500 | 0.7231          | 0.6851 |
| 0.2311        | 59.62  | 1550 | 0.7288          | 0.6632 |
| 0.2176        | 61.54  | 1600 | 0.7711          | 0.6664 |
| 0.2117        | 63.46  | 1650 | 0.7914          | 0.6940 |
| 0.2114        | 65.38  | 1700 | 0.8065          | 0.6918 |
| 0.1913        | 67.31  | 1750 | 0.8372          | 0.6945 |
| 0.1897        | 69.23  | 1800 | 0.8051          | 0.6869 |
| 0.1865        | 71.15  | 1850 | 0.8076          | 0.6740 |
| 0.1844        | 73.08  | 1900 | 0.7935          | 0.6708 |
| 0.1757        | 75.0   | 1950 | 0.8015          | 0.6610 |
| 0.1636        | 76.92  | 2000 | 0.7614          | 0.6414 |
| 0.1637        | 78.85  | 2050 | 0.8123          | 0.6592 |
| 0.1599        | 80.77  | 2100 | 0.7907          | 0.6566 |
| 0.1498        | 82.69  | 2150 | 0.8641          | 0.6757 |
| 0.1545        | 84.62  | 2200 | 0.7438          | 0.6682 |
| 0.1433        | 86.54  | 2250 | 0.8014          | 0.6624 |
| 0.1427        | 88.46  | 2300 | 0.7758          | 0.6646 |
| 0.1423        | 90.38  | 2350 | 0.7741          | 0.6423 |
| 0.1298        | 92.31  | 2400 | 0.7938          | 0.6414 |
| 0.1111        | 94.23  | 2450 | 0.7976          | 0.6467 |
| 0.1243        | 96.15  | 2500 | 0.7916          | 0.6481 |
| 0.1215        | 98.08  | 2550 | 0.7594          | 0.6392 |
| 0.113         | 100.0  | 2600 | 0.8236          | 0.6392 |
| 0.1077        | 101.92 | 2650 | 0.7959          | 0.6347 |
| 0.0988        | 103.85 | 2700 | 0.8189          | 0.6392 |
| 0.0953        | 105.77 | 2750 | 0.8157          | 0.6414 |
| 0.0889        | 107.69 | 2800 | 0.7946          | 0.6369 |
| 0.0929        | 109.62 | 2850 | 0.8255          | 0.6360 |
| 0.0822        | 111.54 | 2900 | 0.8320          | 0.6334 |
| 0.086         | 113.46 | 2950 | 0.8539          | 0.6490 |
| 0.0825        | 115.38 | 3000 | 0.8438          | 0.6418 |
| 0.0727        | 117.31 | 3050 | 0.8568          | 0.6481 |
| 0.0717        | 119.23 | 3100 | 0.8447          | 0.6512 |
| 0.0815        | 121.15 | 3150 | 0.8470          | 0.6445 |
| 0.0689        | 123.08 | 3200 | 0.8264          | 0.6249 |
| 0.0726        | 125.0  | 3250 | 0.7981          | 0.6169 |
| 0.0648        | 126.92 | 3300 | 0.8237          | 0.6200 |
| 0.0632        | 128.85 | 3350 | 0.8416          | 0.6249 |
| 0.06          | 130.77 | 3400 | 0.8276          | 0.6173 |
| 0.0616        | 132.69 | 3450 | 0.8429          | 0.6209 |
| 0.0614        | 134.62 | 3500 | 0.8485          | 0.6271 |
| 0.0539        | 136.54 | 3550 | 0.8598          | 0.6218 |
| 0.0555        | 138.46 | 3600 | 0.8557          | 0.6169 |
| 0.0604        | 140.38 | 3650 | 0.8436          | 0.6186 |
| 0.0556        | 142.31 | 3700 | 0.8428          | 0.6178 |
| 0.051         | 144.23 | 3750 | 0.8440          | 0.6142 |
| 0.0526        | 146.15 | 3800 | 0.8566          | 0.6142 |
| 0.052         | 148.08 | 3850 | 0.8544          | 0.6178 |
| 0.0519        | 150.0  | 3900 | 0.8537          | 0.6160 |


### Framework versions

- Transformers 4.16.2
- Pytorch 1.10.0+cu111
- Datasets 1.18.2
- Tokenizers 0.11.0