Hugging Face's logo

apwic
/
liputan6-base

Transformers
Safetensors
Indonesian
t5
Generated from Trainer
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
liputan6-base / README.md
apwic's picture
apwic
Model save
fa303a8 verified
preview code
|
raw
history blame
1.81 kB
metadata
license: apache-2.0
base_model: LazarusNLP/IndoNanoT5-base
tags:
  - generated_from_trainer
datasets:
  - id_liputan6
metrics:
  - rouge
model-index:
  - name: liputan6-base
    results: []

liputan6-base

This model is a fine-tuned version of LazarusNLP/IndoNanoT5-base on the id_liputan6 dataset. It achieves the following results on the evaluation set:

  • Loss: 2.0398
  • Rouge1: 35.4918
  • Rouge2: 17.885
  • Rougel: 29.6804
  • Rougelsum: 32.9507
  • Gen Len: 36.4740

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.001
  • train_batch_size: 16
  • eval_batch_size: 64
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 3.0

Training results

Training Loss Epoch Step Validation Loss Rouge1 Rouge2 Rougel Rougelsum Gen Len
2.0683 1.0 12118 2.3723 33.423 16.5875 28.0723 31.0371 38.1132
1.5342 2.0 24236 2.1400 34.4775 17.1757 28.8546 32.0264 36.7176
1.241 3.0 36354 2.0398 35.4918 17.885 29.6804 32.9507 36.4740

Framework versions

  • Transformers 4.40.2
  • Pytorch 2.3.1+cu121
  • Datasets 2.20.0
  • Tokenizers 0.19.1