YuE: Open Full-song Generation Foundation Model
Multimodal Art Projection
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
Multimodal Art Projection (M-A-P) is an open-source AI research community.
The community members are working on research topics in a wide range of spectrum, including but not limited to pre-training paradigm of foundation models, large-scale data collection and processing, and the derived applciations on coding, reasoning and music creativity.
The community is open to researchers keen on any relevant topic. Welcome to join us!
- Discord Channel
- Our Full Paper List
- mail: [email protected]
The development log of our Multimodal Art Projection (m-a-p) model family:
- π₯28/01/2025: We release YuE (δΉ), the most powerful open-source foundation models for music generation, specifically for transforming lyrics into full songs (lyrics2song), like Suno.ai. See demos.
- π₯08/05/2024: We release the fully transparent large language model MAP-Neo, series models for scaling law exploraltion and post-training alignment, and along with the training corpus Matrix.
- π₯11/04/2024: MuPT paper and demo are out. HF collection.
- π₯08/04/2024: Chinese Tiny LLM is out. HF collection.
- π₯28/02/2024: The release of ChatMusician's demo, code, model, data, and benchmark. π
- π₯23/02/2024: The release of OpenCodeInterpreter, beats GPT-4 code interpreter on HumanEval.
- 23/01/2024: we release CMMMU for better Chinese LMMs' Evaluation.
- 13/01/2024: we release a series of Music Pretrained Transformer (MuPT) checkpoints, with size up to 1.3B and 8192 context length. Our models are LLAMA2-based, pre-trained on world's largest 10B tokens symbolic music dataset (ABC notation format). We currently support Megatron-LM format and will release huggingface checkpoints soon.
- 02/06/2023: officially release the MERT pre-print paper and training codes.
- 17/03/2023: we release two advanced music understanding models, MERT-v1-95M and MERT-v1-330M , trained with new paradigm and dataset. They outperform the previous models and can better generalize to more tasks.
- 14/03/2023: we retrained the MERT-v0 model with open-source-only music dataset MERT-v0-public
- 29/12/2022: a music understanding model MERT-v0 trained with MLM paradigm, which performs better at downstream tasks.
- 29/10/2022: a pre-trained MIR model music2vec trained with BYOL paradigm.
Collections
13
spaces
4
models
112
m-a-p/YuE-s1-7B-anneal-en-icl
Text Generation
β’
Updated
β’
986
β’
26
m-a-p/YuE-upsampler
Text Generation
β’
Updated
β’
169
β’
12
m-a-p/YuE-s2-1B-general
Text Generation
β’
Updated
β’
9.2k
β’
28
m-a-p/YuE-s1-7B-anneal-zh-icl
Text Generation
β’
Updated
β’
119
β’
8
m-a-p/YuE-s1-7B-anneal-zh-cot
Text Generation
β’
Updated
β’
488
β’
23
m-a-p/YuE-s1-7B-anneal-jp-kr-icl
Text Generation
β’
Updated
β’
135
β’
8
m-a-p/YuE-s1-7B-anneal-jp-kr-cot
Text Generation
β’
Updated
β’
746
β’
13
m-a-p/YuE-s1-7B-anneal-en-cot
Text Generation
β’
Updated
β’
16.4k
β’
312
m-a-p/xcodec_mini_infer
Updated
β’
5
m-a-p/FineFineWeb-bert
Updated
β’
2
datasets
34
m-a-p/PIN-100M
Viewer
β’
Updated
β’
68.1k
β’
2.68k
β’
5
m-a-p/OmniInstruct_v1
Viewer
β’
Updated
β’
96.1k
β’
253
β’
1
m-a-p/OmniBench
Viewer
β’
Updated
β’
1.14k
β’
58
β’
4
m-a-p/PIN-14M
Viewer
β’
Updated
β’
68.1k
β’
8.8k
β’
28
m-a-p/FineFineWeb-fasttext-seeddata
Preview
β’
Updated
β’
557
m-a-p/FineFineWeb-validation
Viewer
β’
Updated
β’
35.6k
β’
404
β’
1
m-a-p/FineFineWeb-test
Viewer
β’
Updated
β’
1.41M
β’
642
β’
3
m-a-p/FineFineWeb-sample
Viewer
β’
Updated
β’
224M
β’
7.78k
β’
1
m-a-p/FineFineWeb
Viewer
β’
Updated
β’
4.89B
β’
424k
β’
28
m-a-p/FineFineWeb-bert-seeddata
Viewer
β’
Updated
β’
8.8M
β’
624
β’
2