Affiliation:
1. Key Laboratory of Smart Agriculture System Integration, Ministry of Education China Agricultural University Beijing China
2. Key Laboratory of Agricultural Information Acquisition Technology, Ministry of Agriculture and Rural Affairs China Agricultural University Beijing China
Abstract
AbstractReliable obstacle detection is of great significance to the navigation technology of unmanned agricultural machinery. Currently, most of the previous works have achieved significant performance with the help of visual prior information of obstacles, where visual prior information refers to the visual features learned by models in the training stage. However, collecting enough annotated images for the training stage can be challenging. In the absence of annotated images, the current methods cannot perform optimally. To address the above problem, this paper presents a zero‐shot obstacle detection model based on the You Only Look Once X backbone, introducing the concept of zero‐shot learning into real‐time obstacle detection systems. Specifically, the cascade of encoder and decoder modules is appended to the presented model, and the integration of semantic space‐based classification and anchor‐free localization modules is used for zero‐shot obstacle detection. The feasibility of the proposed method was verified on the actual farmland test data set. The experimental results show that the F1 scores of the seen obstacle (e.g., people) and the unseen obstacle (e.g., agricultural machinery) are 96.22% and 94.66%, respectively. The average detection time for each panoramic image is 52.52 ms (equivalent to 19.04 FPS). The proposed obstacle detection method exhibits superior performance in the situation where training samples of the target category are not available. Notably, the proposed model not only performs the correct classification of unseen obstacles, but also improves the detection performance of both seen and unseen obstacles. The proposed method achieves a balance between accuracy and detection speed.
Funder
National Natural Science Foundation of China
Subject
Computer Science Applications,Control and Systems Engineering
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Zero-Shot Object Detection Using YOLO;2024 IEEE International Conference on Information Technology, Electronics and Intelligent Communication Systems (ICITEICS);2024-06-28
2. PanNote: an Automatic Tool for Panoramic Image Annotation of People’s Positions;2024 IEEE International Conference on Robotics and Automation (ICRA);2024-05-13
3. One-shot domain adaptive real-time 3D obstacle detection in farmland based on semantic-geometry-intensity fusion strategy;Computers and Electronics in Agriculture;2023-11