Affiliation:
1. Robocare, Seongnam 13449, Republic of Korea
2. School of Integrated Technology, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea
3. Department of Otolaryngology-Head and Neck Surgery, Kosin University College of Medicine, Busan 49267, Republic of Korea
Abstract
Human skeleton data obtained using a depth camera have been used for pathological gait recognition to support doctor or physician diagnosis decisions. Most studies for skeleton-based pathological gait recognition have used either raw skeleton sequences directly or gait features, such as gait parameters and joint angles, extracted from raw skeleton sequences. We hypothesize that using skeleton, joint angles, and gait parameters together can improve recognition performance. This study aims to develop a deep neural network model that effectively combines different types of input data. We propose a hybrid deep neural network framework composed of a graph convolutional network, recurrent neural network, and artificial neural network to effectively encode skeleton sequences, joint angle sequences, and gait parameters, respectively. The features extracted from three different input data types are fused and fed into the final classification layer. We evaluate the proposed model on two different skeleton datasets (a simulated pathological gait dataset and a vestibular disorder gait dataset) that were collected using an Azure Kinect. The proposed model, with multiple types of input, improved the pathological gait recognition performance compared to single input models on both datasets. Furthermore, it achieved the best performance among the state-of-the-art models for skeleton-based action recognition.
Funder
Open AI Dataset Project
Korea Health Industry Development Institute
Ministry of Trade, Industry, and Energy
Korea Institute for Advancement of Technology
Reference49 articles.
1. Biometric recognition by gait: A survey of modalities and features;Connor;Comput. Vis. Image Underst.,2018
2. Clinical gait analysis: A review;Whittle;Hum. Mov. Sci.,1996
3. Classification of gait anomalies from Kinect;Li;Vis. Comput.,2016
4. Dranca, L., de Abetxuko Ruiz de Mendarozketa, L., Goñi, A., Illarramendi, A., Navalpotro Gomez, I., Delgado Alvarado, M., and Rodríguez-Oroz, M.C. (2018). Using Kinect to classify Parkinson’s disease stages related to severity of gait impairment. BMC Bioinf., 19.
5. Gait spatiotemporal signal analysis for Parkinson’s disease detection and severity rating;Alharthi;IEEE Sens. J,2021
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献