Affiliation:
1. School of Automation, Beijing University of Posts and Telecommunications, Beijing 100876, China
Abstract
Visual servoing is widely used in the peg-in-hole assembly due to the uncertainty of pose. Humans can easily align the peg with the hole according to key visual points/edges. By imitating human behavior, we propose P2HNet, a learning-based neural network that can directly extract desired landmarks for visual servoing. To avoid collecting and annotating a large number of real images for training, we built a virtual assembly scene to generate many synthetic data for transfer learning. A multi-modal peg-in-hole strategy is then introduced to combine image-based search-and-force-based insertion. P2HNet-based visual servoing and spiral search are used to align the peg with the hole from coarse to fine. Force control is then used to complete the insertion. The strategy exploits the flexibility of neural networks and the stability of traditional methods. The effectiveness of the method was experimentally verified in the D-sub connector assembly with sub-millimeter clearance. The results show that the proposed method can achieve a higher success rate and efficiency than the baseline method in the high-precision peg-in-hole assembly.
Funder
Major Project of the New Generation of Artificial Intelligence of China
National Natural Science Foundation of China
Subject
Control and Optimization,Control and Systems Engineering
Reference27 articles.
1. Accurate Positioning of a Drilling and Riveting Cell for Aircraft Assembly;Mei;Robot. Comput.-Integr. Manuf.,2021
2. Hebecker, M., Lambrecht, J., and Schmitz, M. (2021, January 12–16). Towards Real-World Force-Sensitive Robotic Assembly through Deep Reinforcement Learning in Simulations. Proceedings of the 2021 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), Delft, The Netherlands.
3. Haugaard, R.L., Glent Buch, A., and Iversen, T.M. (2022, January 22–26). Self-Supervised Deep Visual Servoing for High Precision Peg-in-Hole Insertion. Proceedings of the 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE), Mexico City, Mexico.
4. The State of the Art of Search Strategies in Robotic Assembly;Jiang;J. Ind. Inf. Integr.,2022
5. Visual Servo Control. I. Basic Approaches;Chaumette;IEEE Robot. Autom. Mag.,2006
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献