juanjucm commited on
Commit
21567fd
·
verified ·
1 Parent(s): 5c94f4d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -6
README.md CHANGED
@@ -13,21 +13,31 @@ datasets:
13
  - juanjucm/FLEURS-SpeechT-GL-EN
14
  language:
15
  - gl
 
16
  ---
17
 
18
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
19
- should probably proofread and complete it, then remove this comment. -->
20
 
21
  # nllb-200-distilled-600M-FLEURS-GL-EN
22
 
23
- This model is a fine-tuned version of [facebook/nllb-200-distilled-600M](https://huggingface.co/facebook/nllb-200-distilled-600M) on [juanjucm/FLEURS-SpeechT-GL-EN](https://huggingface.co/datasets/juanjucm/FLEURS-SpeechT-GL-EN).
 
 
 
 
 
 
 
 
 
 
 
 
24
  It achieves the following results on the evaluation set:
25
  - Loss: 0.0877
26
- - Bleu: 43.7516
27
-
28
- ### Training hyperparameters
29
 
30
  The following hyperparameters were used during training:
 
31
  - learning_rate: 1e-05
32
  - train_batch_size: 4
33
  - eval_batch_size: 4
@@ -40,6 +50,8 @@ The following hyperparameters were used during training:
40
 
41
  ### Training results
42
 
 
 
43
  | Training Loss | Epoch | Step | Validation Loss | Bleu |
44
  |:-------------:|:-----:|:----:|:---------------:|:-------:|
45
  | No log | 1.0 | 343 | 5.3970 | 42.8151 |
 
13
  - juanjucm/FLEURS-SpeechT-GL-EN
14
  language:
15
  - gl
16
+ - en
17
  ---
18
 
 
 
19
 
20
  # nllb-200-distilled-600M-FLEURS-GL-EN
21
 
22
+ This model is a fine-tuned version of [facebook/nllb-200-distilled-600M](https://huggingface.co/facebook/nllb-200-distilled-600M) trained on [juanjucm/FLEURS-SpeechT-GL-EN](https://huggingface.co/datasets/juanjucm/FLEURS-SpeechT-GL-EN) for **Galician-to-Englis Machine Translation** task. It takes Galician texts as input and generates the correspondant English translation.
23
+
24
+ This Machine Translation model, was developed to be the second stage of a Speech Translation cascade system for transcribing and translating Galician audios into English texts. [This STT model](https://huggingface.co/juanjucm/whisper-large-v3-turbo-FLEURS-GL) can be used as a first step to transcribe Galician audio into text. After that, this MT model can be applied over the generated Galician transcriptions to get English text translations.
25
+ The motivation behind this work is to increase the visibility of the Galician language, making it more accessible for non-Galician speakers to understand and engage with Galician audio content.
26
+
27
+ This model was developed during a 3-week Speech Translation workshop organised by [Yasmin Moslem](https://huggingface.co/ymoslem).
28
+
29
+
30
+
31
+ ### Performance and training details
32
+
33
+ Baseline model achieved a BLEY score of **39.98** on the evaluation dataset.
34
+
35
  It achieves the following results on the evaluation set:
36
  - Loss: 0.0877
37
+ - **BLEU: 43.7516**
 
 
38
 
39
  The following hyperparameters were used during training:
40
+
41
  - learning_rate: 1e-05
42
  - train_batch_size: 4
43
  - eval_batch_size: 4
 
50
 
51
  ### Training results
52
 
53
+ We used [BLEU Score](https://en.wikipedia.org/wiki/BLEU) as our reference translation metric for selecting the best checkpoint after training.
54
+
55
  | Training Loss | Epoch | Step | Validation Loss | Bleu |
56
  |:-------------:|:-----:|:----:|:---------------:|:-------:|
57
  | No log | 1.0 | 343 | 5.3970 | 42.8151 |