File size: 1,582 Bytes
320326a d112198 b8808ae d112198 b8808ae d112198 2cf0fcd b8808ae d112198 4cf3f6c b8808ae 499793c b8808ae 499793c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 |
---
license: cc-by-nc-4.0
datasets:
- amphion/Emilia-Dataset
- mozilla-foundation/common_voice_12_0
language:
- el
- en
base_model:
- SWivid/F5-TTS
pipeline_tag: text-to-speech
---
# F5-TTS-Greek
## F5-TTS model finetuned to speak Greek
(This work is under development and is in beta version.)
Finetuned on Greek speech datasets and a small part of Emilia-EN dataset to prevent catastrophic forgetting of English.
Model can generate Greek text with Greek reference speech, English text with English reference speech, and mix of Greek and English (quality here needs improvement, and many runs might be needed to get good results).
## Datasets used:
- Common Voice 12.0 (All Greek Splits) (https://huggingface.co/datasets/mozilla-foundation/common_voice_12_0)
- Greek Single Speaker Speech Dataset (https://www.kaggle.com/datasets/bryanpark/greek-single-speaker-speech-dataset)
- Small part of Emilia Dataset (https://huggingface.co/datasets/amphion/Emilia-Dataset) (EN-B000049.tar)
## Training
Training was done in a single RTX 3090.
After some manual evaluation two checkpoints produced better results:
- 225K steps (TBA)
- 325K steps (TBA)
### Arguments
- Learning Rate: 0.00001
- Batch Size per GPU: 3200
- Max Samples: 64
- Gradient Accumulation Steps: 1
- Max Gradient Norm: 1
- Epochs: 277
- Warmup Updates: 1274
- Save per Updates: 25000
- Last per Steps: 1000
- mixed_precision: fp16
## Links:
- Github: https://github.com/SWivid/F5-TTS
- Paper: F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching (https://arxiv.org/abs/2410.06885)
|