Intro

The Chinese Traditional Instrument Sound Model is a cutting-edge research outcome based on the Chinese Traditional Instrument Sound Dataset. This model covers recordings of over 200 types of Chinese traditional musical instruments, modified instruments, and ethnic minority instruments. Notably, it includes some instruments that are rarely seen among the general public in China. By conducting in-depth analysis and learning of the sound characteristics of these instruments, the model can accurately identify and classify the sounds of various instruments, providing strong technical support for music information retrieval, musical instrument research, and the preservation and inheritance of ethnic music.

Demo

https://huggingface.co/spaces/ccmusic-database/CTIS

Usage

from modelscope import snapshot_download
model_dir = snapshot_download("ccmusic-database/CTIS")

Maintenance

git clone [email protected]:ccmusic-database/CTIS
cd CTIS

Results

Backbone	Size(M)	Mel	CQT	Chroma
vit_l_32	306.5	0.936	0.921	*0.845*
swin_t	28.3	*0.956*	*0.940*	0.759

regnet_y_32gf	145	*0.973*	*0.980*	0.848
vgg19_bn	143.7	0.966	0.965	*0.852*
alexnet	61.1	0.936	0.921	0.661
resnet101	44.5	0.953	0.949	0.782
inception_v3	27.2	0.860	0.855	0.664

Best result

Loss curve
Training and validation accuracy
Confusion matrix

Dataset

https://huggingface.co/datasets/ccmusic-database/CTIS

Mirror

https://www.modelscope.cn/models/ccmusic-database/CTIS

Evaluation

https://github.com/monetjoe/ccmusic_eval

Cite

@dataset{zhaorui_liu_2021_5676893, 
  author       = {Monan Zhou, Shenyang Xu, Zhaorui Liu, Zhaowen Wang, Feng Yu, Wei Li and Baoqiang Han}, 
  title        = {CCMusic: an Open and Diverse Database for Chinese Music Information Retrieval Research}, 
  month        = {Mar}, 
  year         = {2024}, 
  publisher    = {HuggingFace}, 
  version      = {1.2}, 
  url          = {https://huggingface.co/ccmusic-database}
}

ccmusic-database
/

CTIS