Affiliation:
1. School of Computing, University of Nebraska-Lincoln, Lincoln, NE 68588, USA
2. Department of Biological Systems Engineering, University of Nebraska-Lincoln, Lincoln, NE 68583, USA
3. Department of Agronomy and Horticulture, University of Nebraska-Lincoln, Lincoln, NE 68583, USA
Abstract
Leaf numbers are vital in estimating the yield of crops. Traditional manual leaf-counting is tedious, costly, and an enormous job. Recent convolutional neural network-based approaches achieve promising results for rosette plants. However, there is a lack of effective solutions to tackle leaf counting for monocot plants, such as sorghum and maize. The existing approaches often require substantial training datasets and annotations, thus incurring significant overheads for labeling. Moreover, these approaches can easily fail when leaf structures are occluded in images. To address these issues, we present a new deep neural network-based method that does not require any effort to label leaf structures explicitly and achieves superior performance even with severe leaf occlusions in images. Our method extracts leaf skeletons to gain more topological information and applies augmentation to enhance structural variety in the original images. Then, we feed the combination of original images, derived skeletons, and augmentations into a regression model, transferred from Inception-Resnet-V2, for leaf-counting. We find that leaf tips are important in our regression model through an input modification method and a Grad-CAM method. The superiority of the proposed method is validated via comparison with the existing approaches conducted on a similar dataset. The results show that our method does not only improve the accuracy of leaf-counting, with overlaps and occlusions, but also lower the training cost, with fewer annotations compared to the previous state-of-the-art approaches.The robustness of the proposed method against the noise effect is also verified by removing the environmental noises during the image preprocessing and reducing the effect of the noises introduced by skeletonization, with satisfactory outcomes.
Funder
National Science Foundation
National Institute of Food and Agriculture (NIFA) of the United States Department of Agriculture
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference50 articles.
1. Leaf counting: Fusing network components for improved accuracy;Farjon;Front. Plant Sci.,2021
2. Real-time plant leaf counting using deep object detection networks;Buzzy;Sensors,2020
3. Rosette plant segmentation with leaf count using orthogonal transform and deep convolutional neural network;Domnic;Mach. Vis. Appl.,2020
4. Minervini, M., Fischbach, A., Scharr, H., and Tsaftaris, S. (2023, January 04). Plant Phenotyping Datasets. Available online: http://www.Plant-phenotyping.org/datasets.
5. Finely-grained annotated datasets for image-based plant phenotyping;Minervini;Pattern Recognit. Lett.,2016
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献