speecht5_finetuned_antonio_lr4

This model is a fine-tuned version of microsoft/speecht5_tts on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.2427

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 4
• eval_batch_size: 2
• seed: 42
• gradient_accumulation_steps: 8
• total_train_batch_size: 32
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 500
• training_steps: 10000
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss
0.3021	8.9787	1000	0.2844
0.2777	17.9574	2000	0.2636
0.2731	26.9360	3000	0.2674
0.2734	35.9147	4000	0.2625
0.2539	44.8934	5000	0.2518
0.2514	53.8721	6000	0.2523
0.246	62.8507	7000	0.2483
0.2471	71.8294	8000	0.2465
0.2433	80.8081	9000	0.2431
0.2394	89.7868	10000	0.2427

Framework versions

• Transformers 4.40.2
• Pytorch 2.2.1
• Datasets 2.18.0
• Tokenizers 0.19.1