mt5-small-finetuned-amazon-en-es

This model is a fine-tuned version of google/mt5-small on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 3.0303
• Rouge1: 16.5285
• Rouge2: 7.5401
• Rougel: 16.0377
• Rougelsum: 16.0806

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5.6e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
6.9675	1.0	1209	3.2986	15.2725	6.808	14.7775	14.8012
3.8997	2.0	2418	3.1665	16.251	7.5493	15.7711	15.7602
3.5826	3.0	3627	3.1106	17.1077	8.3307	16.3925	16.4039
3.421	4.0	4836	3.0963	17.1905	8.6665	16.7501	16.7698
3.3089	5.0	6045	3.0490	16.6351	7.5016	16.1347	16.1305
3.2437	6.0	7254	3.0401	16.5347	7.8057	15.9641	15.9233
3.2133	7.0	8463	3.0292	16.184	7.5266	15.9083	15.9428
3.1851	8.0	9672	3.0303	16.5285	7.5401	16.0377	16.0806

Framework versions

• Transformers 4.46.2
• Pytorch 2.5.1+cu121
• Datasets 3.1.0
• Tokenizers 0.20.3