Abstract
AbstractRobotic grasping of small metallic objects such as bolts is a challenging task due to the small dimensions and textureless reflective surfaces. Depth images acquired of such objects are often noisy and error-prone. In addition, overlapping of parts occur as they are provided randomly oriented in a box such as a small load carrier. To overcome the limitations of existing solutions for bolt separation, a flexible and cost-effective system is developed using an industrial robot and a magnetic gripper. In a two-stage procedure, the bolts are first grasped blindly from a box and placed on a flat surface. In the second step, object detection and pose estimation is performed and the individual bolts are grasped and inserted into a fixture, so that finally the bolts are in a defined position. Industrial use cases for this system are the automated preparation of bolts for robotic screwing processes or automated commissioning of small objects for assembly tasks. The methodology, implementation and evaluation of the proposed solution is presented in this paper.
Publisher
Springer International Publishing
Reference13 articles.
1. Du, G., Wang, K., Lian, S., Zhao, K.: Vision-based robotic grasping from object localization, object pose estimation to grasp estimation for parallel grippers: a review. Artif. Intell. Rev. 54(3), 1677–1734 (2021)
2. Bochkovskiy, A., Wang, C., Liao, H.M.: YOLOv4: optimal speed and accuracy of object detection. ArXiv abs/2004.10934, pp. 1–17 (2020)
3. Wang, R.J., Li, X., Ling, C.X.: Pelee: a real-time object detection system on mobile devices. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems (NIPS’18), pp. 1967–1976. Curran Associates Inc., Red Hook (2018)
4. Liu, H., Rivera Soto, R.A., Xiao, F., Jae Lee, Y.: YolactEdge: real-time instance segmentation on the edge. In: 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 9579–9585. IEEE, Xi’an (2021)
5. Sun, Y., Zuo, W., Liu, M.: RTFNet: RGB-thermal fusion network for semantic segmentation of urban scenes. IEEE Robot. Autom. Lett 4(3), 2576–2583 (2019)