MEMS Devices-Based Hand Gesture Recognition via Wearable Computing
-
Published:2023-04-27
Issue:5
Volume:14
Page:947
-
ISSN:2072-666X
-
Container-title:Micromachines
-
language:en
-
Short-container-title:Micromachines
Author:
Wang Huihui1, Ru Bo2, Miao Xin2, Gao Qin3, Habib Masood2ORCID, Liu Long12ORCID, Qiu Sen2ORCID
Affiliation:
1. School of Intelligence and Electronic Engineering, Dalian Neusoft University of Information, Dalian 116023, China 2. Key Laboratory of Intelligent Control and Optimization for Industrial Equipment of Ministry of Education, Dalian University of Technology, Dalian 116024, China 3. College of Aeronautical Engineering, Taizhou University, Taizhou 318000, China
Abstract
Gesture recognition has found widespread applications in various fields, such as virtual reality, medical diagnosis, and robot interaction. The existing mainstream gesture-recognition methods are primarily divided into two categories: inertial-sensor-based and camera-vision-based methods. However, optical detection still has limitations such as reflection and occlusion. In this paper, we investigate static and dynamic gesture-recognition methods based on miniature inertial sensors. Hand-gesture data are obtained through a data glove and preprocessed using Butterworth low-pass filtering and normalization algorithms. Magnetometer correction is performed using ellipsoidal fitting methods. An auxiliary segmentation algorithm is employed to segment the gesture data, and a gesture dataset is constructed. For static gesture recognition, we focus on four machine learning algorithms, namely support vector machine (SVM), backpropagation neural network (BP), decision tree (DT), and random forest (RF). We evaluate the model prediction performance through cross-validation comparison. For dynamic gesture recognition, we investigate the recognition of 10 dynamic gestures using Hidden Markov Models (HMM) and Attention-Biased Mechanisms for Bidirectional Long- and Short-Term Memory Neural Network Models (Attention-BiLSTM). We analyze the differences in accuracy for complex dynamic gesture recognition with different feature datasets and compare them with the prediction results of the traditional long- and short-term memory neural network model (LSTM). Experimental results demonstrate that the random forest algorithm achieves the highest recognition accuracy and shortest recognition time for static gestures. Moreover, the addition of the attention mechanism significantly improves the recognition accuracy of the LSTM model for dynamic gestures, with a prediction accuracy of 98.3%, based on the original six-axis dataset.
Funder
National Natural Science Foundation of China Natural Science Foundation of Liaoning Province, China Fundamental Research Funds for the Central Universities, China Taizhou University
Subject
Electrical and Electronic Engineering,Mechanical Engineering,Control and Systems Engineering
Reference34 articles.
1. Design and implementation of FPGA-based gesture recognition system;Chen;Wirel. Internet Technol.,2020 2. Del Rio Guerra, M.S., and Martin-Gutierrez, J. (2020). Evaluation of Full-Body Gestures Performed by Individuals with Down Syndrome: Proposal for Designing User Interfaces for All Based on Kinect Sensor. Sensors, 20. 3. Siddiqui, U.A., Ullah, F., Iqbal, A., Khan, A., Ullah, R., Paracha, S., Shahzad, H., and Kwak, K.S. (2021). Wearable-Sensors-Based Platform for Gesture Recognition of Autism Spectrum Disorder Children Using Machine Learning Algorithms. Sensors, 21. 4. Ye, S. (2020). Research on Hand Gesture Recognition Based on Multi-MEMS Inertial Sensors. [Master’s Thesis, Nanjing University of Aeronautics and Astronautics]. 5. Lin, Q. (2020). The Research of Hand Detection and Tracking Using Kinect. [Master’s Thesis, Nanjing University of Posts and Telecommunications].
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|