Affiliation:
1. Department of Electrical and Photonics Engineering, Technical University of Denmark, 2800 Kgs. Lyngby, Denmark
Abstract
Autonomous weeding robots need to accurately detect the joint stem of grassland weeds in order to control those weeds in an effective and energy-efficient manner. In this work, keypoints on joint stems and bounding boxes around weeds in grasslands are detected jointly using multi-task learning. We compare a two-stage, heatmap-based architecture to a single-stage, regression-based architecture—both based on the popular YOLOv5 object detector. Our results show that introducing joint-stem detection as a second task boosts the individual weed detection performance in both architectures. Furthermore, the single-stage architecture clearly outperforms its competitors with an OKS of 56.3 in joint-stem detection while also achieving real-time performance of 12.2 FPS on Nvidia Jetson NX, suitable for agricultural robots. Finally, we make the newly created joint-stem ground-truth annotations publicly available for the relevant research community.
Funder
European Commission and European GNSS Agency
Subject
Agronomy and Crop Science
Reference34 articles.
1. Farooq, A., Jia, X., Hu, J., and Zhou, J. (2019). Multi-Resolution Weed Classification via Convolutional Neural Network and Superpixel Based Local Binary Pattern Using Remote Sensing Images. Remote. Sens., 11.
2. Zelinski, M.E., Taha, T.M., Howe, J., Awwal, A.A.S., and Iftekharuddin, K.M. (2019). Proceedings of the Applications of Machine Learning, International Society for Optics and Photonics, SPIE.
3. Dadashzadeh, M., Abbaspour-Gilandeh, Y., Mesri-Gundoshmian, T., Sabzi, S., Hernández-Hernández, J.L., Hernández-Hernández, M., and Arribas, J.I. (2020). Weed Classification for Site-Specific Weed Management Using an Automated Stereo Computer-Vision Machine-Learning System in Rice Fields. Plants, 9.
4. Robotic weed control using automated weed and crop classification;Wu;J. Field Robot.,2020
5. Reedha, R., Dericquebourg, E., Canals, R., and Hafiane, A. (2022). Transformer Neural Network for Weed and Crop Classification of High Resolution UAV Images. Remote Sens., 14.