InceptionV3-LSTM: A Deep Learning Net for the Intelligent Prediction of Rapeseed Harvest Time

Abstract

Timely harvest can effectively guarantee the yield and quality of rapeseed. In order to change the artificial experience model in the monitoring of rapeseed harvest period, an intelligent prediction method of harvest period based on deep learning network was proposed. Three varieties of field rapeseed in the harvest period were divided into 15 plots, and mobile phones were used to capture images of silique and stalk and manually measure the yield. The daily yield was divided into three grades of more than 90%, 70–90%, and less than 70%, according to the proportion of the maximum yield of varieties. The high-dimensional features of rapeseed canopy images were extracted using CNN networks in the HSV space that were significantly related to the maturity of the rapeseed, and the seven color features of rapeseed stalks were screened using random forests in the three color-spaces of RGB/HSV/YCbCr to form a canopy-stalk joint feature as input to the subsequent classifier. Considering that the rapeseed ripening process is a continuous time series, the LSTM network was used to establish the rapeseed yield classification prediction model. The experimental results showed that Inception v3 of the five CNN networks has the highest prediction accuracy. The recognition rate was 91% when only canopy image features were used, and the recognition rate using canopy-stalk combined features reached 96%. This method can accurately predict the yield level of rapeseed in the mature stage by only using a mobile phone to take a color image, and it is expected to become an intelligent tool for rapeseed production.