Affiliation:
1. School of Computer Science and Artificial Intelligence Wuhan Textile University Wuhan China
2. School of Electrical and Electronic Engineering Nanyang Technological University Singapore Singapore
3. Engineering Research Center of Hubei Province for Clothing Information Wuhan China
Abstract
AbstractHuman activity recognition (HAR) has significant potential in virtual sports applications. However, current HAR networks often prioritize high accuracy at the expense of practical application requirements, resulting in networks with large parameter counts and computational complexity. This can pose challenges for real‐time and efficient recognition. This paper proposes a hybrid lightweight DSANet network designed to address the challenges of real‐time performance and algorithmic complexity. The network utilizes a multi‐scale depthwise separable convolutional (Multi‐scale DWCNN) module to extract spatial information and a multi‐layer Gated Recurrent Unit (Multi‐layer GRU) module for temporal feature extraction. It also incorporates an improved channel‐space attention module called RCSFA to enhance feature extraction capability. By leveraging channel, spatial, and temporal information, the network achieves a low number of parameters with high accuracy. Experimental evaluations on UCIHAR, WISDM, and PAMAP2 datasets demonstrate that the network not only reduces parameter counts but also achieves accuracy rates of 97.55%, 98.99%, and 98.67%, respectively, compared to state‐of‐the‐art networks. This research provides valuable insights for the virtual sports field and presents a novel network for real‐time activity recognition deployment in embedded devices.
Funder
China Scholarship Council
National Natural Science Foundation of China
Reference36 articles.
1. Binarized neural network for edge intelligence of sensor‐based human activity recognition;Luo F;IEEE Trans Mob Comput,2021
2. VTON-MP: Multi-Pose Virtual Try-On via Appearance Flow and Feature Filtering
3. VTON-SCFA: A Virtual Try-On Network Based on the Semantic Constraints and Flow Alignment
4. Smart Clothing System With Multiple Sensors Based on Digital Twin Technology
5. Progress of human action recognition research in the last ten years: a comprehensive survey;Singh PK;Arch Comput Methods Eng,2021