Affiliation:
1. School of Mechanical Engineering, Xinjiang University, Urumqi 830046, China
2. School of Information Science and Technology, Beijing University of Chemical Technology, Beijing 100029, China
Abstract
Head pose estimation is an important technology for analyzing human behavior and has been widely researched and applied in areas such as human–computer interaction and fatigue detection. However, traditional head pose estimation networks suffer from the problem of easily losing spatial structure information, particularly in complex scenarios where occlusions and multiple object detections are common, resulting in low accuracy. To address the above issues, we propose a head pose estimation model based on the residual network and capsule network. Firstly, a deep residual network is used to extract features from three stages, capturing spatial structure information at different levels, and a global attention block is employed to enhance the spatial weight of feature extraction. To effectively avoid the loss of spatial structure information, the features are encoded and transmitted to the output using an improved capsule network, which is enhanced in its generalization ability through self-attention routing mechanisms. To enhance the robustness of the model, we optimize Huber loss, which is first used in head pose estimation. Finally, experiments are conducted on three popular public datasets, 300W-LP, AFLW2000, and BIWI. The results demonstrate that the proposed method achieves state-of-the-art results, particularly in scenarios with occlusions.
Funder
National Natural Science Foundation of China
Key R&D Program of Xinjiang Uygur Autonomous Region
Natural Science Foundation of Xinjiang Uygur Autonomous Region
Subject
General Physics and Astronomy
Reference52 articles.
1. A survey on human-aware robot navigation;Moller;Robot. Auton. Syst.,2021
2. Head pose estimation in computer vision: A survey;Trivedi;IEEE Trans. Pattern Anal. Mach. Intell.,2009
3. An improved single shot multibox for video-rate head pose prediction;Jie;IEEE Sens. J.,2020
4. Yining, L., Liang, W., Fang, X., Yibiao, Z., and Lap-Fai, Y. (2018, January 18–22). Synthesizing Personalized Training Programs for Improving Driving Habits via Virtual Reality. Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Tuebingen/Reutlingen, Germany.
5. Ye, M., Zhang, W., and Cao, P. (2021). Driver fatigue detection based on residual channel attention network and head pose estimation. Appl. Sci., 11.