An Efficient and Automated Image Preprocessing Using Semantic Segmentation for Improving the 3D Reconstruction of Soybean Plants at the Vegetative Stage
Author:
Sun Yongzhe1, Miao Linxiao1, Zhao Ziming1, Pan Tong1, Wang Xueying1, Guo Yixin1, Xin Dawei2ORCID, Chen Qingshan2, Zhu Rongsheng3
Affiliation:
1. College of Engineering, Northeast Agricultural University, Harbin 150030, China 2. College of Agriculture, Northeast Agricultural University, Harbin 150030, China 3. College of Arts and Sciences, Northeast Agricultural University, Harbin 150030, China
Abstract
The investigation of plant phenotypes through 3D modeling has emerged as a significant field in the study of automated plant phenotype acquisition. In 3D model construction, conventional image preprocessing methods exhibit low efficiency and inherent inefficiencies, which increases the difficulty of model construction. In order to ensure the accuracy of the 3D model, while reducing the difficulty of image preprocessing and improving the speed of 3D reconstruction, deep learning semantic segmentation technology was used in the present study to preprocess original images of soybean plants. Additionally, control experiments involving soybean plants of different varieties and different growth periods were conducted. Models based on manual image preprocessing and models based on image segmentation were established. Point cloud matching, distance calculation and model matching degree calculation were carried out. In this study, the DeepLabv3+, Unet, PSPnet and HRnet networks were used to conduct semantic segmentation of the original images of soybean plants in the vegetative stage (V), and Unet network exhibited the optimal test effect. The values of mIoU, mPA, mPrecision and mRecall reached 0.9919, 0.9953, 0.9965 and 0.9953. At the same time, by comparing the distance results and matching accuracy results between the models and the reference models, a conclusion could be drawn that semantic segmentation can effectively improve the challenges of image preprocessing and long reconstruction time, greatly improve the robustness of noise input and ensure the accuracy of the model. Semantic segmentation plays a crucial role as a fundamental component in enabling efficient and automated image preprocessing for 3D reconstruction of soybean plants during the vegetative stage. In the future, semantic segmentation will provide a solution for the pre-processing of 3D reconstruction for other crops.
Funder
National Key Research and Development Program of the “14th Five Year Plan” Research and Application of Key Technologies for Intelligent Farming Decision Platform, an Open Competition Project of Heilongjiang Province, China Natural Science Foundation of Heilongjiang Province of China
Subject
Agronomy and Crop Science
Reference35 articles.
1. Guan, H., Liu, M., Ma, X., and Yu, S. (2018). Three-Dimensional Reconstruction of Soybean Canopies Using Multisource Imaging for Phenotyping Analysis. Remote Sens., 10. 2. Favre, P., Gueritaine, G., Andrieu, B., Boumaza, R., Demotes-Mainard, S., Fournier, C., Galopin, G., Huche-Thelier, L., Morel-Chevillet, P., and Guérin, V. (2007, January 17–19). Modelling the architectural growth and development of rosebush using L-Systems. Proceedings of the Growth Phenotyping and Imaging in Plants, Montpellier, France. 3. Segmentation of structural parts of rosebush plants with 3D point-based deep learning methods;Turgut;Plant Methods,2022 4. Analysing the phenotype development of soybean plants using low-cost 3D reconstruction;Zhu;Sci. Rep.,2020 5. Martinez-Guanter, J., Ribeiro, Á., Peteinatos, G.G., Pérez-Ruiz, M., Gerhards, R., Bengochea-Guevara, J.M., Machleb, J., and Andújar, D. (2019). Low-Cost Three-Dimensional Modeling of Crop Plants. Sensors, 19.
|
|