Affiliation:
1. College of Electronics and Electrical Engineering, Henan Normal University, Xinxiang, China
2. Henan Key Laboratory of Optoelectronic Sensing Integrated Application, Xinxiang, China
3. Henan Engineering Laboratory of Additive Intelligent Manufacturing, Xinxiang, China
Abstract
Aiming at the problems of slow speed and low accuracy of traditional neural network systems for real-time gesture recognition in complex backgrounds., this paper proposes DMS-yolov8-a gesture recognition method to improve yolov8. This algorithm replaces the Bottleneck convolution module in the backbone network of yolov8 with variable row convolution DCNV2, and increases the feature convolution range without increasing the computation amount through a more flexible feeling field. in addition, the self-developed MPCA attention module is added after the feature output layer of the backbone layer, which improves the problem of recognizing the accuracy of difference gestures in complex backgrounds by effectively combining the feature information of the contextual framework, taking into account the multi-scale problem of the gestures in the image, this paper introduces the SPPFCSPS module, which realizes multi-feature fusion and improves real-time accuracy of detection. Finally, the model proposed in this paper is compared with other models, and the proposed DMS-yolov8 model achieves good results on both publicly available datasets and homemade datasets, with the average accuracy up to 97.4% and the average mAP value up to 96.3%, The improvements proposed in this paper are effectively validated.
Reference36 articles.
1. Automatic control model of power information system Access based on artificial intelligence technology[J];Jiang;Mathematical Problems in Engineering,2022
2. Research and Application of Multifeature Gesture Recognition in Human-Computer Interaction Based on Virtual Reality Technology[J];Feng;Wireless Communications and Mobile Computing,2021
3. A survey on measuring cognitive workload in human-computer interaction[J];Kosch;ACM Computing Surveys,2023
4. An intelligent chatbot using NLP and TF-IDF algorithm for text understanding applied to the medical field[C]//;Soufyane;Emerging Trends in ICT for Sustainable Development: The Proceedings of NICE2020 International Conference. Cham: Springer International Publishing,2021
5. Enabling unmanned aerial vehicle borne secure communication with classification framework for industry 5.0[J];Jain;IEEE Transactions on Industrial Informatics,2021