Abstract
Exercise is a prevailing topic in modern society as more people are pursuing a healthy lifestyle. Physical activities provide significant benefits to human well-being from the inside out. Human pose estimation, action recognition and repetitive counting fields developed rapidly in the past several years. However, few works combined them together to assist people in exercise. In this paper, we propose a multitask system covering the three domains. Different from existing methods, heatmaps, which are the byproducts of 2D human pose estimation models, are adopted for exercise recognition and counting. Recent heatmap processing methods have been proven effective in extracting dynamic body pose information. Inspired by this, we propose a deep-learning multitask model of exercise recognition and repetition counting. To the best of our knowledge, this approach is attempted for the first time. To meet the needs of the multitask model, we create a new dataset Rep-Penn with action, counting and speed labels. Our multitask system can estimate human pose, identify physical activities and count repeated motions. We achieved 95.69% accuracy in exercise recognition on the Rep-Penn dataset. The multitask model also performed well in repetitive counting with 0.004 Mean Average Error (MAE) and 0.997 Off-By-One (OBO) accuracy on the Rep-Penn dataset. Compared with existing frameworks, our method obtained state-of-the-art results.
Subject
Computer Networks and Communications,Computer Science Applications,Human-Computer Interaction,Neuroscience (miscellaneous)
Cited by
8 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Dynamic Pose Estimation for Drill Activites Using Deep Learning;2024 MIT Art, Design and Technology School of Computing International Conference (MITADTSoCiCon);2024-04-25
2. Repetitive Action Counting with Motion Feature Learning;2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV);2024-01-03
3. Exercise Recognition and Repetition Counting for Automatic Workout Documentation Using Computer Vision;Lecture Notes in Computer Science;2024
4. Thinking on Construction of Intelligent Auxiliary Physical Exercise Mode Under National Fitness Plan;International Journal of Information Technology and Web Engineering;2023-09-28
5. Exergame with Deep-Learning and Sensors;2023 7th International Conference On Computing, Communication, Control And Automation (ICCUBEA);2023-08-18