A Stave-Aware Optical Music Recognition on Monophonic Scores for Camera-Based Scenarios
-
Published:2023-08-17
Issue:16
Volume:13
Page:9360
-
ISSN:2076-3417
-
Container-title:Applied Sciences
-
language:en
-
Short-container-title:Applied Sciences
Author:
Liu Yipeng1, Wu Ruimin1, Wu Yifan1, Luo Lijie1, Xu Wei1ORCID
Affiliation:
1. School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan 430074, China
Abstract
The recognition of printed music sheets in camera-based realistic scenarios is a novel research branch of optical music recognition (OMR). However, special factors in realistic scenarios, such as uneven lighting distribution and curvature of staff lines, can have adverse effects on OMR models designed for digital music scores. This paper proposes a stave-aware method based on object detection to recognize monophonic printed sheet music in camera-based scenarios. By detecting the positions of staff lines, we improve the accuracy of note pitch effectively. In addition, we present the Camera Printed Music Staves (CPMS) dataset, which consists of labels and images captured by mobile phones under different angles and lighting conditions in realistic scenarios. We compare our method after training on different datasets with a sequence recognition method called CRNN-CTC on the test set of the CPMS dataset. The results show that the accuracy, robustness, and data dependency of our method perform better.
Funder
National Natural Science Foundation of China
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference47 articles.
1. Shatri, E., and Fazekas, G. (2020). Optical Music Recognition: State of the Art and Major Challenges. arXiv. 2. Calvo-Zaragoza, J., Valero-Mas, J.J., and Pertusa, A. (2017, January 23–27). End-to-end optical music recognition using neural networks. Proceedings of the 18th International Society for Music Information Retrieval Conference, ISMIR, Suzhou, China. 3. Calvo-Zaragoza, J., and Rizo, D. (2018). End-to-end neural optical music recognition of monophonic scores. Appl. Sci., 8. 4. Optical Music Recognition Method Combining Multi-Scale Residual Convolutional Neural Network and Bi-Directional Simple Recurrent Units;Qiong;Laser Optoelectron. Prog.,2020 5. Li, Y., Liu, H., Jin, Q., Cai, M., and Li, P. (2023, January 4–10). TrOMR: Transformer-Based Polyphonic Optical Music Recognition. Proceedings of the ICASSP 2023—2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.
|
|