FastQAFPN-YOLOv8s-based method for rapid and lightweight detection of walnut unseparated material

Abstract

Abstract Pecans have rich nutritional value and high economic value. Fast and accurate shell and kernel sorting will improve the efficiency of its automated production. Therefore, we propose a FastQAFPN-YOLOv8s target detection network to achieve fast and accurate detection of unseparated materials. The method uses lightweight Pconv operators to build the FasterNextBlock structure, which serve as the backbone feature extractor for the Fasternet feature extraction network. The ECIoU loss function combining EIoU and CIoU speeds up the adjustment of the prediction frame and the network regression. In the Neck part of the network, the QAFPN feature fusion extraction network is proposed to replace the PAN-FPN in YOLOv8s with a Rep-PAN structure based on the QARepNext reparameterization structure for feature fusion extraction to achieve a trade-off between network performance and inference speed. To validate the method, we built a three-axis mobile sorting device and created a dataset of 3,000 images of walnuts after breaking their shells for experiments. The results show that the improved network has a number of 6071008 parameters, a training time of 2.49 h, a model size of 12.3 MB, an mAP of 94.5%, and a frame rate of 52.1 FPS. Compared with the original model, the number of parameters decreases by 45.5%, the training time decreases by 32.7%, the model size decreases by 45.3%, and the frame rate improves by 40.8%. However, some accuracy is lost along with the lightweight, with a 1.2% decrease in mAP. The network reduces the model size by 59.7MB and 23.9MB compared to YOLOv7 and YOLOv6, respectively, and improves the frame rate by 15.67fps and 22.55fps, respectively. the average confidence and mAP are little changed compared to YOLOv7 and improved by 4.2% and 2.4% compared to YOLOv6, respectively. The FastQAFPN-YOLOv8s detection method can effectively reduce the model size while ensuring the recognition accuracy.