In-Vehicle Speech Recognition for Voice-Driven UAV Control in a Collaborative Environment of MAV and UAV
-
Published:2023-09-27
Issue:10
Volume:10
Page:841
-
ISSN:2226-4310
-
Container-title:Aerospace
-
language:en
-
Short-container-title:Aerospace
Author:
Park Jeong-Sik1ORCID, Geng Na2
Affiliation:
1. Department of English Linguistics and Language Technology, Hankuk University of Foreign Studies, Seoul 02450, Republic of Korea 2. Department of English Linguistics, Hankuk University of Foreign Studies, Seoul 02450, Republic of Korea
Abstract
Most conventional speech recognition systems have mainly concentrated on voice-driven control of personal user devices such as smartphones. Therefore, a speech recognition system used in a special environment needs to be developed in consideration of the environment. In this study, a speech recognition framework for voice-driven control of unmanned aerial vehicles (UAVs) is proposed in a collaborative environment between manned aerial vehicles (MAVs) and UAVs, where multiple MAVs and UAVs fly together, and pilots on board MAVs control multiple UAVs with their voices. Standard speech recognition systems consist of several modules, including front-end, recognition, and post-processing. Among them, this study focuses on recognition and post-processing modules in terms of in-vehicle speech recognition. In order to stably control UAVs via voice, it is necessary to handle the environmental conditions of the UAVs carefully. First, we define control commands that the MAV pilot delivers to UAVs and construct training data. Next, for the recognition module, we investigate an acoustic model suitable for the characteristics of the UAV control commands and the UAV system with hardware resource constraints. Finally, two approaches are proposed for post-processing: grammar network-based syntax analysis and transaction-based semantic analysis. For evaluation, we developed a speech recognition system in a collaborative simulation environment between a MAV and an UAV and successfully verified the validity of each module. As a result of recognition experiments of connected words consisting of two to five words, the recognition rates of hidden Markov model (HMM) and deep neural network (DNN)-based acoustic models were 98.2% and 98.4%, respectively. However, in terms of computational amount, the HMM model was about 100 times more efficient than DNN. In addition, the relative improvement in error rate with the proposed post-processing was about 65%.
Funder
Hankuk University of Foreign Studies Research Fund Institute of Information and Communications Technology Planning
Subject
Aerospace Engineering
Reference40 articles.
1. Oneata, D., and Cucu, H. (2019). Kite: Automatic speech recognition for unmanned aerial vehicles. arXiv. 2. Protected voice control system of unmanned aerial vehicle;Lavrynenko;Electr. Control Syst.,2020 3. Design and fabrication of voice controlled unmanned aerial vehicle;Anand;IAES Int. J. Robot. Autom.,2016 4. Park, J.S., and Na, H.J. (2020). Front-end of vehicle-embedded speech recognition for voice-driven multi-UAVs control. Appl. Sci., 10. 5. Helmke, H., Kleinert, M., Shetty, S., Ohneiser, O., Ehr, H., Arilíusson, H., Simiganoschi, T.S., Prasad, A., Motlicek, P., and Veselý, K. (2021, January 20–23). Readback error detection by automatic speech recognition to increase ATM safety. Proceedings of the Fourteenth USA/Europe Air Traffic Management Research and Development Seminar (ATM2021), Virtual Event.
|
|