jlehecka commited on
Commit
1bf3b52
·
verified ·
1 Parent(s): 31ccb24

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: "cs"
3
+ tags:
4
+ - Czech
5
+ - SpeechT5
6
+ - KKY
7
+ - FAV
8
+ license: "cc-by-nc-sa-4.0"
9
+ ---
10
+
11
+ # SpeechT5-base-cs-tts
12
+ This is a monolingual Czech SpeechT5 base model pre-trained from 120 thousand hours of Czech speech and a large Czech text corpus with 17.5B words.
13
+ It has been released along with a paper **Zero-Shot vs. Few-Shot Multi-Speaker TTS Using Pre-trained Czech SpeechT5 Model** accepted to TSD2024 conference.
14
+ It is meant to be used as a starting checkpoint for Czech TTS fine-tuning.
15
+
16
+ **Important note: This is only a pre-trained model, so it has not yet been trained for the TTS task.**
17
+
18
+ See our paper for details.
19
+
20
+ ## Paper
21
+ The pre-print of our paper is available at http://arxiv.org/abs/2407.17167.
22
+
23
+ ## Citation
24
+ If you find this model useful, please cite our paper:
25
+ ```
26
+ @inproceedings{lehecka2024multispeakertts,
27
+ title = {{Zero-Shot vs. Few-Shot Multi-Speaker TTS Using Pre-trained Czech SpeechT5 Model}},
28
+ author = {
29
+ Jan Lehe\v{c}ka and
30
+ Zden\v{e}k Hanzl\'i\v{c}ek and
31
+ Jind\v{r}ich Matou\v{s}ek and
32
+ Daniel Tihelka
33
+ },
34
+ booktitle = {{Text, Speech, and Dialogue}},
35
+ publisher = {{Springer International Publishing}},
36
+ year = {2024},
37
+ note = {In press},
38
+ url = {https://arxiv.org/abs/2407.17167},
39
+ }
40
+ ```
41
+
42
+ ## Usage
43
+ This is a TTS variant of the SpeechT5 model,
44
+ i.e., the input modality is text (processed via the text pre-net),
45
+ and the output modality is speech (processed via the speech post-net).
46
+ The model has the same format as the [English speecht5-tts model](https://huggingface.co/microsoft/speecht5_tts) compatible with the [SpeechT5ForTextToSpeech class](https://huggingface.co/docs/transformers/model_doc/speecht5#transformers.SpeechT5ForTextToSpeech).
47
+
48
+ In order to use this model for text-to-speech, it must be [fine-tuned](https://huggingface.co/learn/audio-course/chapter6/fine-tuning) on labeled TTS data.
49
+
50
+ The usage is the same as for the [English speecht5-tts model](https://huggingface.co/microsoft/speecht5_tts)
51
+
52
+ ## Related works