End of training

README.md

@@ -23,7 +23,7 @@ model-index:
     metrics:
     - name: Wer
       type: wer
-      value: 1.0
+      value: 0.9727626459143969
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -33,8 +33,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on the minds14 dataset.
 It achieves the following results on the evaluation set:
-- Loss: 3.2396
-- Wer: 1.0
+- Loss: 2.8388
+- Wer: 0.9728
 
 ## Model description
 
@@ -53,29 +53,28 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 1e-05
-- train_batch_size: 8
-- eval_batch_size: 8
+- learning_rate: 5e-05
+- train_batch_size: 4
+- eval_batch_size: 4
 - seed: 42
-- gradient_accumulation_steps: 2
+- gradient_accumulation_steps: 4
 - total_train_batch_size: 16
 - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 500
-- training_steps: 2000
-- mixed_precision_training: Native AMP
+- lr_scheduler_warmup_steps: 200
+- training_steps: 1000
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Wer |
-|:-------------:|:-----:|:----:|:---------------:|:---:|
-| 3.3332        | 200.0 | 1000 | 3.4002          | 1.0 |
-| 3.0081        | 400.0 | 2000 | 3.2396          | 1.0 |
+| Training Loss | Epoch | Step | Validation Loss | Wer    |
+|:-------------:|:-----:|:----:|:---------------:|:------:|
+| 2.7068        | 100.0 | 500  | 2.8991          | 1.0    |
+| 1.7504        | 200.0 | 1000 | 2.8388          | 0.9728 |
 
 
 ### Framework versions
 
-- Transformers 4.46.2
-- Pytorch 2.5.1+cu124
+- Transformers 4.47.0
+- Pytorch 2.5.1
 - Datasets 3.1.0
-- Tokenizers 0.20.1
+- Tokenizers 0.21.0