Spaces:
Running
Running
Upload src_f5_tts_infer_SHARED.md
Browse files
src/f5_tts/infer/src_f5_tts_infer_SHARED.md
ADDED
@@ -0,0 +1,74 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
<!-- omit in toc -->
|
2 |
+
# Shared Model Cards
|
3 |
+
|
4 |
+
<!-- omit in toc -->
|
5 |
+
### **Prerequisites of using**
|
6 |
+
- This document is serving as a quick lookup table for the community training/finetuning result, with various language support.
|
7 |
+
- The models in this repository are open source and are based on voluntary contributions from contributors.
|
8 |
+
- The use of models must be conditioned on respect for the respective creators. The convenience brought comes from their efforts.
|
9 |
+
|
10 |
+
<!-- omit in toc -->
|
11 |
+
### **Welcome to share here**
|
12 |
+
- Have a pretrained/finetuned result: model checkpoint (pruned best to facilitate inference, i.e. leave only `ema_model_state_dict`) and corresponding vocab file (for tokenization).
|
13 |
+
- Host a public [huggingface model repository](https://huggingface.co/new) and upload the model related files.
|
14 |
+
- Make a pull request adding a model card to the current page, i.e. `src\f5_tts\infer\SHARED.md`.
|
15 |
+
|
16 |
+
<!-- omit in toc -->
|
17 |
+
### Supported Languages
|
18 |
+
- [Multilingual](#multilingual)
|
19 |
+
- [F5-TTS Base @ pretrain @ zh \& en](#f5-tts-base--pretrain--zh--en)
|
20 |
+
- [Mandarin](#mandarin)
|
21 |
+
- [Japanese](#japanese)
|
22 |
+
- [F5-TTS Base @ pretrain/finetune @ ja](#f5-tts-base--pretrainfinetune--ja)
|
23 |
+
- [English](#english)
|
24 |
+
- [French](#french)
|
25 |
+
- [French LibriVox @ finetune @ fr](#french-librivox--finetune--fr)
|
26 |
+
|
27 |
+
|
28 |
+
## Multilingual
|
29 |
+
|
30 |
+
#### F5-TTS Base @ pretrain @ zh & en
|
31 |
+
|Model|🤗Hugging Face|Data (Hours)|Model License|
|
32 |
+
|:---:|:------------:|:-----------:|:-------------:|
|
33 |
+
|F5-TTS Base|[ckpt & vocab](https://huggingface.co/SWivid/F5-TTS/tree/main/F5TTS_Base)|[Emilia 95K zh&en](https://huggingface.co/datasets/amphion/Emilia-Dataset/tree/fc71e07)|cc-by-nc-4.0|
|
34 |
+
|
35 |
+
```bash
|
36 |
+
MODEL_CKPT: hf://SWivid/F5-TTS/F5TTS_Base/model_1200000.safetensors
|
37 |
+
VOCAB_FILE: hf://SWivid/F5-TTS/F5TTS_Base/vocab.txt
|
38 |
+
```
|
39 |
+
|
40 |
+
*Other infos, e.g. Author info, Github repo, Link to some sampled results, Usage instruction, Tutorial (Blog, Video, etc.) ...*
|
41 |
+
|
42 |
+
|
43 |
+
## Mandarin
|
44 |
+
|
45 |
+
## Japanese
|
46 |
+
|
47 |
+
#### F5-TTS Base @ pretrain/finetune @ ja
|
48 |
+
|Model|🤗Hugging Face|Data (Hours)|Model License|
|
49 |
+
|:---:|:------------:|:-----------:|:-------------:|
|
50 |
+
|F5-TTS Base|[ckpt & vocab](https://huggingface.co/Jmica/F5TTS/tree/main/JA_8500000)|[Emilia 1.7k JA](https://huggingface.co/datasets/amphion/Emilia-Dataset/tree/fc71e07) & [Galgame Dataset 5.4k](https://huggingface.co/datasets/OOPPEENN/Galgame_Dataset)|cc-by-nc-4.0|
|
51 |
+
|
52 |
+
```bash
|
53 |
+
MODEL_CKPT: hf://Jmica/F5TTS/JA_8500000/model_8499660.pt
|
54 |
+
VOCAB_FILE: hf://Jmica/F5TTS/JA_8500000/vocab_updated.txt
|
55 |
+
```
|
56 |
+
|
57 |
+
## English
|
58 |
+
|
59 |
+
|
60 |
+
## French
|
61 |
+
|
62 |
+
#### French LibriVox @ finetune @ fr
|
63 |
+
|Model|🤗Hugging Face|Data (Hours)|Model License|
|
64 |
+
|:---:|:------------:|:-----------:|:-------------:|
|
65 |
+
|F5-TTS French|[ckpt & vocab](https://huggingface.co/RASPIAUDIO/F5-French-MixedSpeakers-reduced)|[LibriVox](https://librivox.org/)|cc-by-nc-4.0|
|
66 |
+
|
67 |
+
```bash
|
68 |
+
MODEL_CKPT: hf://RASPIAUDIO/F5-French-MixedSpeakers-reduced/model_last_reduced.pt
|
69 |
+
VOCAB_FILE: hf://RASPIAUDIO/F5-French-MixedSpeakers-reduced/vocab.txt
|
70 |
+
```
|
71 |
+
|
72 |
+
- [Online Inference with Hugging Face Space](https://huggingface.co/spaces/RASPIAUDIO/f5-tts_french).
|
73 |
+
- [Tutorial video to train a new language model](https://www.youtube.com/watch?v=UO4usaOojys).
|
74 |
+
- [Discussion about this training can be found here](https://github.com/SWivid/F5-TTS/issues/434).
|