Affiliation:
1. School of Information and Control Engineering, China University of Mining and Technology, Xuzhou, China
2. School of Mechanical and Electronic Engineering, Suzhou University, Suzhou, China
Abstract
Pose estimation plays a crucial role in human-centered vision applications and has advanced significantly in recent years. However, prevailing approaches use extremely complex structural designs for obtaining high scores on the benchmark dataset, hampering edge device applications. In this study, an efficient and lightweight human pose estimation problem is investigated. Enhancements are made to the context enhancement module of the U-shaped structure to improve the multi-scale local modeling capability. With a transformer structure, a lightweight transformer block was designed to enhance the local feature extraction and global modeling ability. Finally, a lightweight pose estimation network— U-shaped Hybrid Vision Transformer, UViT— was developed. The minimal network UViT-T achieved a 3.9% improvement in AP scores on the COCO validation set with fewer model parameters and computational complexity compared with the best-performing V2 version of the MobileNet series. Specifically, with an input size of 384×288, UViT-T achieves an impressive AP score of 70.2 on the COCO test-dev set, with only 1.52 M parameters and 2.32 GFLOPs. The inference speed is approximately twice that of general-purpose networks. This study provides an efficient and lightweight design idea and method for the human pose estimation task and provides theoretical support for its deployment on edge devices.
Reference11 articles.
1. Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition, 32nd AAAI Conference on Artificial Intelligence;Yan;AAAI,2018
2. Myoelectric human computer interaction using CNN-LSTM neural network for dynamic hand gesture recognition;Li;Journal of Intelligent & Fuzzy Systems,2023
3. U2-Net: Going deeper with nested U-structure for salient object detection,;Qin;Pattern Recognition,2020
4. UULPN: An Ultra-lightweight Network for Human Pose Estimation Based on Unbiased Data Processing;Wang;Neurocomputing,2022
5. Zhang S. , Qiang B. , Yang X. , Wei X. , Chen R. and Chen L. , Human Pose Estimation via an Ultra-Lightweight Pose Distillation Network, , Electronics 12 (2023).