Abstract
AbstractInstrumentalplaying techniques such as vibratos, glissandos, and trills often denote musical expressivity, both in classical and folk contexts. However, most existing approaches to music similarity retrieval fail to describe timbre beyond the so-called “ordinary” technique, use instrument identity as a proxy for timbre quality, and do not allow for customization to the perceptual idiosyncrasies of a new subject. In this article, we ask 31 human participants to organize 78 isolated notes into a set of timbre clusters. Analyzing their responses suggests that timbre perception operates within a more flexible taxonomy than those provided by instruments or playing techniques alone. In addition, we propose a machine listening model to recover the cluster graph of auditory similarities across instruments, mutes, and techniques. Our model relies on joint time–frequency scattering features to extract spectrotemporal modulations as acoustic features. Furthermore, it minimizes triplet loss in the cluster graph by means of the large-margin nearest neighbor (LMNN) metric learning algorithm. Over a dataset of 9346 isolated notes, we report a state-of-the-art average precision at rank five (AP@5) of .%. An ablation study demonstrates that removing either the joint time–frequency scattering transform or the metric learning algorithm noticeably degrades performance.
Funder
Universit? de Recherche Paris Sciences et Lettres
European Research Council
National Science Foundation
Publisher
Springer Science and Business Media LLC
Subject
Electrical and Electronic Engineering,Acoustics and Ultrasonics
Reference85 articles.
1. J. S. Downie, Music information retrieval. Ann. Rev. Inf. Sci. Technol.37(1), 295–340 (2003).
2. K. Siedenburg, C. Saitis, S. McAdams, in Timbre: Acoustics, Perception, and Cognition, ed. by K. Siedenburg, C. Saitis, S. McAdams, A. N. Popper, and R. R. Fay. The Present, Past, and Future of Timbre Research (Springer International PublishingCham, 2019), pp. 1–19.
3. A. Faure, S. McAdams, V. Nosulenko, in Proceedings of the International Conference on Music Perception and Cognition (ICMPC). Verbal correlates of perceptual dimensions of timbre, (1996), pp. 79–84.
4. V. Lostanlen, J. Andén, M. Lagrange, in Proceedings of the International Conference on Digital Libraries for Musicology (DLfM). Extended playing techniques: the next milestone in musical instrument recognition (ACM, 2018), pp. 1–10.
5. A. Antoine, E. R. Miranda, in Proceedings of the International Symposium on Musical Acoustics (ISMA). Musical Acoustics, Timbre, and Computer-Aided Orchestration Challenges, (2018), pp. 151–154.
Cited by
5 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Perceptual Musical Similarity Metric Learning with Graph Neural Networks;2023 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA);2023-10-22
2. Explainable audio Classification of Playing Techniques with Layer-wise Relevance Propagation;ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP);2023-06-04
3. Perceptual–Neural–Physical Sound Matching;ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP);2023-06-04
4. Feature Extraction Method of Piano Performance Technique Based on Recurrent Neural Network;International Journal of Gaming and Computer-Mediated Simulations;2022-11-23
5. Machine Learning-Based Brain Diseases Diagnosing in Electroencephalogram Signals, Alzheimer’s, and Parkinson’s;Studies in Big Data;2022