Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
@@ -1,10 +1,30 @@
|
|
1 |
---
|
2 |
title: README
|
3 |
-
emoji:
|
4 |
colorFrom: gray
|
5 |
colorTo: green
|
6 |
sdk: static
|
7 |
pinned: false
|
8 |
---
|
|
|
|
|
|
|
9 |
|
10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
title: README
|
3 |
+
emoji: 🚀
|
4 |
colorFrom: gray
|
5 |
colorTo: green
|
6 |
sdk: static
|
7 |
pinned: false
|
8 |
---
|
9 |
+
# Guides
|
10 |
+
### emotion2vec: universal speech emotion representation model
|
11 |
+
emotion2vec is the first universal speech emotion representation model. Through self-supervised pre-training, emotion2vec has the ability to extract emotion representation across different tasks, languages, and scenarios.
|
12 |
|
13 |
+
### emotion2vec+: speech emotion recognition foundation model
|
14 |
+
emotion2vec+ is a series of foundational models for speech emotion recognition (SER). We aim to train a "whisper" in the field of speech emotion recognition, overcoming the effects of language and recording environments through data-driven methods to achieve universal, robust emotion recognition capabilities. The performance of emotion2vec+ significantly exceeds other highly downloaded open-source models on Hugging Face.
|
15 |
+
|
16 |
+
# News
|
17 |
+
- [May. 2024] 🔥 Speech emotion recognition foundation model: **emotion2vec+**, with 4-class primary emotions has been released on [Model Scope](https://modelscope.cn/models/iic/emotion2vec_plus_large/summary) and [Hugging Face](https://huggingface.co/emotion2vec). Check out a series of emotion2vec+ (seed, base, large) models for SER with high performance (We recommend this release over the Jan. 2024 release).
|
18 |
+
- [Jan. 2024] 9-class emotion recognition model with iterative fine-tuning from emotion2vec has been released in [modelscope](https://www.modelscope.cn/models/iic/emotion2vec_base_finetuned/summary) and [FunASR](https://github.com/alibaba-damo-academy/FunASR/tree/main/examples/industrial_data_pretraining/emotion2vec).
|
19 |
+
- [Jan. 2024] emotion2vec has been integrated into [modelscope](https://www.modelscope.cn/models/iic/emotion2vec_base/summary) and [FunASR](https://github.com/alibaba-damo-academy/FunASR/tree/main/examples/industrial_data_pretraining/emotion2vec).
|
20 |
+
- [Dec. 2023] We release the [paper](https://arxiv.org/abs/2312.15185) for emotion2vec.
|
21 |
+
- [Nov. 2023] We release code, checkpoints, and extracted features for emotion2vec.
|
22 |
+
|
23 |
+
# Model Card
|
24 |
+
GitHub Repo: [emotion2vec](https://github.com/ddlBoJack/emotion2vec)
|
25 |
+
|Model|⭐Model Scope|🤗Hugging Face|Fine-tuning Data (Hours)|
|
26 |
+
|:---:|:-------------:|:-----------:|:-------------:|
|
27 |
+
|emotion2vec|[Link](https://www.modelscope.cn/models/iic/emotion2vec_base/summary)|[Link](https://huggingface.co/emotion2vec/emotion2vec_base)|/|
|
28 |
+
emotion2vec+ seed|[Link](https://modelscope.cn/models/iic/emotion2vec_plus_seed/summary)|[Link](https://huggingface.co/emotion2vec/emotion2vec_plus_seed)|201|
|
29 |
+
emotion2vec+ base|[Link](https://modelscope.cn/models/iic/emotion2vec_plus_base/summary)|[Link](https://huggingface.co/emotion2vec/emotion2vec_plus_base)|4788|
|
30 |
+
emotion2vec+ large|[Link](https://modelscope.cn/models/iic/emotion2vec_plus_large/summary)|[Link](https://huggingface.co/emotion2vec/emotion2vec_plus_large)|42526|
|