Kirundi-English MT5 Translator with LoRA

This is a LoRA-fine-tuned version of mT5-small for Kirundi-English translation.

Model Details

  • Base Model: google/mt5-small
  • LoRA rank: 8
  • LoRA alpha: 32
  • Target modules: q, v
  • Training Data: {len(tokenized_dataset["train"])} examples
  • Validation Data: {len(tokenized_dataset["test"])} examples

Training Parameters

  • Learning Rate: 2e-5
  • Batch Size: 8
  • Epochs: 3
  • Weight Decay: 0.01

Current Metrics

  • BLEU Score: 0.000054
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.