Author:
Zhang Hongyan,Liang Huawei,Ni Tao,Huang Lingtao,Yang Jinsong
Abstract
As a complex task, robot sorting has become a research hotspot. In order to enable robots to perform simple, efficient, stable and accurate sorting operations for stacked multi-objects in unstructured scenes, a robot multi-object sorting system is built in this paper. Firstly, the training model of rotating target detection is constructed, and the placement state of five common objects in unstructured scenes is collected as the training set for training. The trained model is used to obtain the position, rotation angle and category of the target object. Then, the instance segmentation model is constructed, and the same data set is made, and the instance segmentation network model is trained. Then, the optimized Mask R-CNN instance segmentation network is used to segment the object surface pixels, and the upper surface point cloud is extracted to calculate the normal vector. Then, the angle obtained by the normal vector of the upper surface and the rotation target detection network is fused with the normal vector to obtain the attitude of the object. At the same time, the grasping order is calculated according to the average depth of the surface. Finally, after the obtained object posture, category and grasping sequence are fused, the performance of the rotating target detection network, the instance segmentation network and the robot sorting system are tested on the established experimental platform. Based on this system, this paper carried out an experiment on the success rate of object capture in a single network and an integrated network. The experimental results show that the multi-object sorting system based on deep learning proposed in this paper can sort stacked objects efficiently, accurately and stably in unstructured scenes.
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference33 articles.
1. Recent researches on robot autonomous grasp technology;Liu;Control. Decis.,2020
2. Sensory-Based Colour Sorting Automated Robotic Cell
3. Robust Visual Servoing
4. Learning to grasp novel objects using vision;Saxena,2008
Cited by
7 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Grasping of Unknown Objects with an Autonomous Manipulator: State of the Art, Problems and Prospects;Mekhatronika, Avtomatizatsiya, Upravlenie;2023-10-09
2. Amber Gemstones Colour Classification by CNN;2023 IEEE 12th International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS);2023-09-07
3. Design And Fabrication Of Waste Fabric Segregation System;2023 9th International Conference on Electrical Energy Systems (ICEES);2023-03-23
4. Designing the system for detecting unsuitable marble stones for an industrial process using convolutional neural networks;2023 5th International Youth Conference on Radio Electronics, Electrical and Power Engineering (REEPE);2023-03-16
5. Optimization of Sorting Robot Control System Based on Deep Learning and Machine Vision;Mathematical Problems in Engineering;2022-03-28