Affiliation:
1. School of Mechanical Engineering, Jiangsu University, Zhenjiang 212013, China
Abstract
The vision-based fruit recognition and localization system is the basis for the automatic operation of agricultural harvesting robots. Existing detection models are often constrained by high complexity and slow inference speed, which do not meet the real-time requirements of harvesting robots. Here, a method for apple object detection and localization is proposed to address the above problems. First, an improved YOLOX network is designed to detect the target region, with a multi-branch topology in the training phase and a single-branch structure in the inference phase. The spatial pyramid pooling layer (SPP) with serial structure is used to expand the receptive field of the backbone network and ensure a fixed output. Second, the RGB-D camera is used to obtain the aligned depth image and to calculate the depth value of the desired point. Finally, the three-dimensional coordinates of apple-picking points are obtained by combining two-dimensional coordinates in the RGB image and depth value. Experimental results show that the proposed method has high accuracy and real-time performance: F1 is 93%, mean average precision (mAP) is 94.09%, detection speed can reach 167.43 F/s, and the positioning errors in X, Y, and Z directions are less than 7 mm, 7 mm, and 5 mm, respectively.
Funder
Key Project of Jiangsu Province Key Research and Development Program
National Natural Science Foundation of China
21st batch of scientific research projects for university students in Jiangsu University
Subject
Agronomy and Crop Science
Reference47 articles.
1. Agricultural Robots for Field Operations: Concepts and Components;Bechar;Biosyst. Eng.,2016
2. Life Cycle Assessment of Conventional and Organic Apple Production Systems in China;Zhu;J. Clean. Prod.,2018
3. Identification, Classification & Grading of Fruits Using Machine Learning & Computer Intelligence: A Review;Behera;J. Ambient. Intell. Humaniz. Comput.,2020
4. Intelligent Fruit Yield Estimation for Orchards Using Deep Learning Based Semantic Segmentation Techniques—A Review;Maheswari;Front. Plant Sci.,2021
5. Kang, H., Zhou, H., Wang, X., and Chen, C. (2020). Real-Time Fruit Recognition and Grasping Estimation for Robotic Apple Harvesting. Sensors, 20.
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献