Detection of Wheat Lodging by Binocular Cameras during Harvesting Operation

Abstract

Wheat lodging provides important reference information for self-adaptive header control of a combine harvester. Aimed at real-time detection of wheat lodging, this paper proposed a detection method of wheat lodging location and area based on binocular vision. In this method, the angle relationship between the stem and vertical direction when wheat is upright, inclined, and lodging was determined by mechanical analysis. The discrimination condition of the wheat lodging degree was proposed based on the height of the visual point cloud on the surface of wheat crops. The binocular camera was used to obtain the image parallax of wheat within the harvesting region. The binocular camera optical axis parallel model was used to calculate the three-dimensional coordinate of wheat. Then, the height of the wheat stem was obtained by further analysis and calculation. According to the wheat stem height detected by vision, the location and area of wheat lodging within the combine harvester’s harvesting region were analyzed. A field experiment showed that the detection error of the wheat stem height was 5.5 cm and the algorithm speed was under 2000 milliseconds, which enabled the analysis and calculation of the wheat lodging location, contour, and area within the combine harvester’s harvesting region. This study provides key information for adaptive header control of combine harvesters.