Author:
Chen Chengjun,Zhao Xicong,Wang Jinlei,Li Dongnian,Guan Yuanlin,Hong Jun
Abstract
AbstractIntelligent recognition of assembly behaviors of workshop production personnel is crucial to improve production assembly efficiency and ensure production safety. This paper proposes a graph convolutional network model for assembly behavior recognition based on attention mechanism and multi-scale feature fusion. The proposed model learns the potential relationship between assembly actions and assembly tools for recognizing assembly behaviors. Meanwhile, the introduction of an attention mechanism helps the network to focus on the key information in assembly behavior images. Besides, the multi-scale feature fusion module is introduced to enable the network to better extract image features at different scales. This paper constructs a data set containing 15 types of workshop production behaviors, and the proposed assembly behavior recognition model is tested on this data set. The experimental results show that the proposed model achieves good recognition results, with an average assembly recognition accuracy of 93.1%.
Funder
National Natural Science Foundation of China
Publisher
Springer Science and Business Media LLC
Reference37 articles.
1. Al-Amin, M. et al. Action recognition in manufacturing assembly using multimodal sensor fusion. Proc. Manuf. 39, 158–167 (2019).
2. Al-Amin, M., Qin, R., Tao, W., Doell, D., Lingard, R., Yin, Z., & Leu, M. C. (2020). Fusing and refining convolutional neural network models for assembly action recognition in smart manufacturing. Proc. Instit. Mech. Eng. Part C J. Mech. Eng. Sci., 0954406220931547
3. Chen, C., Wang, T., Li, D. & Hong, J. Repetitive assembly action recognition based on object detection and pose estimation. J. Manuf. Syst. 55, 325–333 (2020).
4. Xiong, Q., Zhang, J., Wang, P., Liu, D. & Gao, R. X. Transferable two-stream convolutional neural network for human action recognition. J. Manuf. Syst. 56, 605–614 (2020).
5. Chen, C. et al. Monitoring of assembly process using deep learning technology. Sensors 20(15), 4208 (2020).
Cited by
15 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献