Intro 简介
The Chinese Traditional Instrument Sound Model is a cutting-edge research outcome based on the Chinese Traditional Instrument Sound Dataset. This model covers recordings of over 200 types of Chinese traditional musical instruments, modified instruments, and ethnic minority instruments. Notably, it includes some instruments that are rarely seen among the general public in China. By conducting in-depth analysis and learning of the sound characteristics of these instruments, the model can accurately identify and classify the sounds of various instruments, providing strong technical support for music information retrieval, musical instrument research, and the preservation and inheritance of ethnic music.
中国传统乐器识别模型是一项基于中国传统乐器音响数据集训练得到的先进研究成果。该模型涵盖了 200 多种中国传统乐器、改良乐器以及少数民族乐器的录音。特别引人注目的是,这些乐器中包括了一些在中国大众中较为罕见的乐器。通过对这些乐器的声音特征进行深入分析和学习,该模型能够准确识别和分类各种乐器的声音,为音乐信息检索、乐器研究以及民族音乐的传承与保护提供了强有力的技术支持。
Demo 在线演示
https://huggingface.co/spaces/ccmusic-database/CTIS
Usage 使用
from modelscope import snapshot_download
model_dir = snapshot_download("ccmusic-database/CTIS")
Maintenance 维护
git clone [email protected]:ccmusic-database/CTIS
cd CTIS
Results 训练结果
Backbone | Size(M) | Mel | CQT | Chroma |
---|---|---|---|---|
vit_l_32 | 306.5 | 0.936 | 0.921 | 0.845 |
swin_t | 28.3 | 0.956 | 0.940 | 0.759 |
regnet_y_32gf | 145 | 0.973 | 0.980 | 0.848 |
vgg19_bn | 143.7 | 0.966 | 0.965 | 0.852 |
alexnet | 61.1 | 0.936 | 0.921 | 0.661 |
resnet101 | 44.5 | 0.953 | 0.949 | 0.782 |
inception_v3 | 27.2 | 0.860 | 0.855 | 0.664 |
Best result 最佳结果
Loss curve | |
---|---|
Training and validation accuracy | |
Confusion matrix |
Dataset 数据集
https://huggingface.co/datasets/ccmusic-database/CTIS
Mirror 镜像
https://www.modelscope.cn/models/ccmusic-database/CTIS
Evaluation 校验
https://github.com/monetjoe/ccmusic_eval
Cite 引用
@dataset{zhaorui_liu_2021_5676893,
author = {Monan Zhou, Shenyang Xu, Zhaorui Liu, Zhaowen Wang, Feng Yu, Wei Li and Baoqiang Han},
title = {CCMusic: an Open and Diverse Database for Chinese Music Information Retrieval Research},
month = {Mar},
year = {2024},
publisher = {HuggingFace},
version = {1.2},
url = {https://huggingface.co/ccmusic-database}
}