A Method for Tomato Plant Stem and Leaf Segmentation and Phenotypic Extraction Based on Skeleton Extraction and Supervoxel Clustering

Abstract

To address the current problem of the difficulty of extracting the phenotypic parameters of tomato plants in a non-destructive and accurate way, we proposed a method of stem and leaf segmentation and phenotypic extraction of tomato plants based on skeleton extraction and supervoxel clustering. To carry out growth and cultivation experiments on tomato plants in a solar greenhouse, we obtained multi-view image sequences of the tomato plants to construct three-dimensional models of the plant. We used Laplace’s skeleton extraction algorithm to extract the skeleton of the point cloud after removing the noise points using a multi-filtering algorithm, and, based on the plant skeleton, searched for the highest point path, height constraints, and radius constraints to separate the stem from the leaf. At the same time, a supervoxel segmentation method based on Euclidean distance was used to segment each leaf. We extracted a total of six phenotypic parameters of the plant: height, stem diameter, leaf angle, leaf length, leaf width and leaf area, using the segmented organs, which are important for the phenotype. The results showed that the average accuracy, average recall and average F1 scores of the stem and leaf segmentation were 0.88, 0.80 and 0.84, and the segmentation indexes were better than the other four segmentation algorithms; the coefficients of determination between the measurement values of the phenotypic parameters and the real values were 0.97, 0.84, 0.88, 0.94, 0.92 and 0.93; and the root-mean-square errors were 2.17 cm, 0.346 cm, 5.65°, 3.18 cm, 2.99 cm and 8.79 cm2. The measurement values of the proposed method had a strong correlation with the actual values, which could satisfy the requirements of daily production and provide technical support for the extraction of high-throughput phenotypic parameters of tomato plants in solar greenhouses.