DEKR-SPrior: An Efficient Bottom-Up Keypoint Detection Model for Accurate Pod Phenotyping in Soybean

Abstract

The pod and seed counts are important yield-related traits in soybean. High-precision soybean breeders face the major challenge of accurately phenotyping the number of pods and seeds in a high-throughput manner. Recent advances in artificial intelligence, especially deep learning (DL) models, have provided new avenues for high-throughput phenotyping of crop traits with increased precision. However, the available DL models are less effective for phenotyping pods that are densely packed and overlap in in situ soybean plants; thus, accurate phenotyping of the number of pods and seeds in soybean plant is an important challenge. To address this challenge, the present study proposed a bottom-up model, DEKR-SPrior (disentangled keypoint regression with structural prior), for in situ soybean pod phenotyping, which considers soybean pods and seeds analogous to human people and joints, respectively. In particular, we designed a novel structural prior (SPrior) module that utilizes cosine similarity to improve feature discrimination, which is important for differentiating closely located seeds from highly similar seeds. To further enhance the accuracy of pod location, we cropped full-sized images into smaller and high-resolution subimages for analysis. The results on our image datasets revealed that DEKR-SPrior outperformed multiple bottom-up models, viz., Lightweight-OpenPose, OpenPose, HigherHRNet, and DEKR, reducing the mean absolute error from 25.81 (in the original DEKR) to 21.11 (in the DEKR-SPrior) in pod phenotyping. This paper demonstrated the great potential of DEKR-SPrior for plant phenotyping, and we hope that DEKR-SPrior will help future plant phenotyping.