End of training

README.md

@@ -1,71 +1,83 @@
----
-library_name: transformers
-license: apache-2.0
-base_model: facebook/wav2vec2-xls-r-300m
-tags:
-- generated_from_trainer
-model-index:
-- name: wav2vec2-E30_speed2
-  results: []
----
-
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
-
-# wav2vec2-E30_speed2
-
-This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on an unknown dataset.
-It achieves the following results on the evaluation set:
-- Loss: 4.3514
-- Cer: 90.8893
-
-## Model description
-
-More information needed
-
-## Intended uses & limitations
-
-More information needed
-
-## Training and evaluation data
-
-More information needed
-
-## Training procedure
-
-### Training hyperparameters
-
-The following hyperparameters were used during training:
-- learning_rate: 0.0001
-- train_batch_size: 16
-- eval_batch_size: 16
-- seed: 42
-- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 50
-- num_epochs: 3
-- mixed_precision_training: Native AMP
-
-### Training results
-
-| Training Loss | Epoch  | Step | Validation Loss | Cer     |
-|:-------------:|:------:|:----:|:---------------:|:-------:|
-| 49.2666       | 0.2577 | 200  | 7.4219          | 100.0   |
-| 11.8441       | 0.5155 | 400  | 4.7273          | 98.2378 |
-| 5.3893        | 0.7732 | 600  | 4.5335          | 94.2904 |
-| 5.5815        | 1.0309 | 800  | 4.4939          | 93.8557 |
-| 6.1895        | 1.2887 | 1000 | 4.4739          | 93.8381 |
-| 6.3558        | 1.5464 | 1200 | 4.4406          | 93.8381 |
-| 5.4883        | 1.8041 | 1400 | 4.4290          | 93.3682 |
-| 5.2029        | 2.0619 | 1600 | 4.3919          | 92.8043 |
-| 5.4859        | 2.3196 | 1800 | 4.3714          | 91.9173 |
-| 4.9494        | 2.5773 | 2000 | 4.3444          | 91.0362 |
-| 4.8426        | 2.8351 | 2200 | 4.3514          | 90.8893 |
-
-
-### Framework versions
-
-- Transformers 4.45.2
-- Pytorch 2.5.1
-- Datasets 2.19.1
-- Tokenizers 0.20.1
+---
+library_name: transformers
+license: apache-2.0
+base_model: facebook/wav2vec2-xls-r-300m
+tags:
+- generated_from_trainer
+model-index:
+- name: wav2vec2-E30_speed2
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# wav2vec2-E30_speed2
+
+This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.2995
+- Cer: 25.2938
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0001
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 50
+- num_epochs: 3
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch  | Step | Validation Loss | Cer     |
+|:-------------:|:------:|:----:|:---------------:|:-------:|
+| 41.4516       | 0.1289 | 200  | 5.3911          | 100.0   |
+| 4.9936        | 0.2579 | 400  | 4.7064          | 100.0   |
+| 4.8068        | 0.3868 | 600  | 4.6491          | 100.0   |
+| 4.7989        | 0.5158 | 800  | 4.7160          | 100.0   |
+| 4.7287        | 0.6447 | 1000 | 4.5872          | 100.0   |
+| 4.7102        | 0.7737 | 1200 | 4.5938          | 100.0   |
+| 4.6927        | 0.9026 | 1400 | 4.6049          | 100.0   |
+| 4.6106        | 1.0316 | 1600 | 4.5710          | 100.0   |
+| 4.5281        | 1.1605 | 1800 | 4.4045          | 100.0   |
+| 4.2276        | 1.2895 | 2000 | 3.8233          | 74.6240 |
+| 3.2563        | 1.4184 | 2200 | 2.8222          | 51.8508 |
+| 2.5657        | 1.5474 | 2400 | 2.3714          | 42.7850 |
+| 2.2757        | 1.6763 | 2600 | 2.1794          | 41.1163 |
+| 2.0428        | 1.8053 | 2800 | 1.9496          | 36.1222 |
+| 1.8705        | 1.9342 | 3000 | 1.8052          | 33.6310 |
+| 1.6822        | 2.0632 | 3200 | 1.6552          | 31.3514 |
+| 1.574         | 2.1921 | 3400 | 1.5774          | 30.2115 |
+| 1.4683        | 2.3211 | 3600 | 1.4999          | 28.9424 |
+| 1.4039        | 2.4500 | 3800 | 1.4358          | 28.1786 |
+| 1.3323        | 2.5790 | 4000 | 1.3441          | 26.1868 |
+| 1.3055        | 2.7079 | 4200 | 1.3460          | 25.8813 |
+| 1.2428        | 2.8369 | 4400 | 1.3022          | 25.5170 |
+| 1.2121        | 2.9658 | 4600 | 1.2995          | 25.2938 |
+
+
+### Framework versions
+
+- Transformers 4.46.2
+- Pytorch 2.5.1+cu121
+- Datasets 3.1.0
+- Tokenizers 0.20.3