Recognition Method of Crop Disease Based on Image Fusion and Deep Learning Model

Abstract

Accurate detection of early diseased plants is of great significance for high quality and high yield of crops, as well as cultivation management. Aiming at the low accuracy of the traditional deep learning model for disease diagnosis, a crop disease recognition method was proposed based on multi-source image fusion. In this study, the adzuki bean rust disease was taken as an example. First, color and thermal infrared images of healthy and diseased plants were collected, and the dynamic thresholding excess green index algorithm was applied to extract the color image of the canopy as the reference image, and the affine transformation was used to extract the thermal infrared image of the canopy. Then, the color image was fused with the thermal infrared image by using a linear weighting algorithm to constitute a multi-source fusion image. In addition, the sample was randomly divided into a training set, validation set, and test set according to the ratio of 7:2:1. Finally, the recognition model of adzuki bean rust disease was established based on a novel deep learning model (ResNet-ViT, RMT) combined with the improved attention mechanism and the Squeeze-Excitation channel attention mechanism. The results showed that the average recognition rate was 99.63%, the Macro-F1 was 99.67%, and the recognition time was 0.072 s. The research results realized the efficient and rapid recognition of adzuki bean rust and provided the theoretical basis and technical support for the disease diagnosis of crops and the effective field management.