README.md

metadata

license: apache-2.0
datasets:
  - allenai/MADLAD-400
language:
  - rw
metrics:
  - perplexity
base_model:
  - FacebookAI/xlm-roberta-base
  - Davlan/afro-xlmr-base

Afro-XLMR Finetuned for MLM on 20% of MADLAD-400 (Kinyarwanda)

At Epoch 3/3

• Validation Loss: 1.2191
• Perplexity: 3.3840