Matthijs commited on
Commit
6381ab9
·
1 Parent(s): 1ac0710

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ --- license: cc-by-nc-4.0 tags:
3
+ - mms
4
+ - vits
5
+ pipeline_tag: text-to-speech ---
6
+
7
+ # Massively Multilingual Speech (MMS) : Text-to-Speech Models
8
+
9
+ This repository contains the **Abidji (abi)** language text-to-speech (TTS) model checkpoint.
10
+
11
+ This model is part of Facebook's [Massively Multilingual Speech](https://arxiv.org/abs/2305.13516) project, aiming to
12
+ provide speech technology across a diverse range of languages. You can find more details about the supported languages
13
+ and their ISO 639-3 codes in the [MMS Language Coverage
14
+ Overview](https://dl.fbaipublicfiles.com/mms/misc/language_coverage_mms.html).
15
+
16
+ ## Usage
17
+
18
+ Using this checkpoint from Hugging Face Transformers:
19
+
20
+ ```python
21
+ from transformers import VitsModel, VitsMmsTokenizer
22
+ import torch
23
+
24
+ model = VitsModel.from_pretrained("Matthijs/mms-tts-abi")
25
+ tokenizer = VitsMmsTokenizer.from_pretrained("Matthijs/mms-tts-abi")
26
+
27
+ text = "some example text in the Abidji language"
28
+ inputs = tokenizer(text, return_tensors="pt")
29
+
30
+ with torch.no_grad():
31
+ output = model(**inputs)
32
+
33
+ from IPython.display import Audio
34
+
35
+ Audio(output.audio[0], rate=16000)
36
+ ```
37
+
38
+ Note: For certain checkpoints, the input text must be converted to the Latin alphabet first using the
39
+ [uroman](https://github.com/isi-nlp/uroman) tool.
40
+
41
+ ## Model credits
42
+
43
+ This model was developed by Vineel Pratap et al. and is licensed as **CC-BY-NC 4.0**
44
+
45
+ @article{pratap2023mms,
46
+ title={Scaling Speech Technology to 1,000+ Languages}, author={Vineel Pratap and Andros Tjandra and Bowen Shi
47
+ and Paden Tomasello and Arun Babu and Sayani Kundu and Ali Elkahky and Zhaoheng Ni and Apoorv Vyas and Maryam
48
+ Fazel-Zarandi and Alexei Baevski and Yossi Adi and Xiaohui Zhang and Wei-Ning Hsu and Alexis Conneau and
49
+ Michael Auli}, journal={arXiv}, year={2023}
50
+ }