README.md

metadata

license: apache-2.0
base_model: t5-small
tags:
  - generated_from_keras_callback
model-index:
  - name: JuliusFx/dyu-fr-t5-small_v8
    results: []

JuliusFx/dyu-fr-t5-small_v8

This model is a fine-tuned version of t5-small on an unknown dataset. It achieves the following results on the evaluation set:

• Train Loss: 2.2133
• Validation Loss: 2.8690
• Epoch: 53

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
• training_precision: float32

Training results

Train Loss	Validation Loss	Epoch
3.1481	3.2663	0
3.0205	3.2024	1
2.9712	3.1559	2
2.9209	3.1465	3
2.8848	3.1125	4
2.8512	3.1014	5
2.8239	3.0771	6
2.7965	3.0641	7
2.7743	3.0431	8
2.7505	3.0327	9
2.7325	3.0072	10
2.7153	3.0060	11
2.6904	2.9950	12
2.6750	2.9895	13
2.6554	2.9700	14
2.6400	2.9632	15
2.6220	2.9534	16
2.6059	2.9505	17
2.5913	2.9536	18
2.5779	2.9485	19
2.5624	2.9349	20
2.5469	2.9307	21
2.5341	2.9224	22
2.5223	2.9114	23
2.5093	2.8996	24
2.4995	2.9065	25
2.4855	2.8974	26
2.4706	2.8926	27
2.4589	2.9075	28
2.4521	2.8921	29
2.4380	2.9055	30
2.4243	2.8930	31
2.4131	2.8871	32
2.4065	2.8894	33
2.3911	2.8890	34
2.3833	2.8757	35
2.3724	2.8778	36
2.3628	2.8874	37
2.3556	2.8687	38
2.3441	2.8653	39
2.3321	2.8794	40
2.3203	2.8827	41
2.3118	2.8778	42
2.3027	2.8955	43
2.2903	2.8778	44
2.2821	2.8751	45
2.2760	2.8655	46
2.2592	2.8763	47
2.2534	2.8643	48
2.2466	2.8716	49
2.2363	2.8728	50
2.2279	2.8688	51
2.2225	2.8822	52
2.2133	2.8690	53

Framework versions

• Transformers 4.38.2
• TensorFlow 2.15.0
• Datasets 2.18.0
• Tokenizers 0.15.2