Fruit Classification Utilizing a Robotic Gripper with Integrated Sensors and Adaptive Grasping

Abstract

As the core component of agricultural robots, robotic grippers are widely used for plucking, picking, and harvesting fruits and vegetables. Secure grasping is a severe challenge in agricultural applications because of the variation in the shape and hardness of agricultural products during maturation, as well as their variety and delicacy. In this study, a fruit identification method utilizing an adaptive gripper with tactile sensing and machine learning algorithms is reported. An adaptive robotic gripper is designed and manufactured to perform adaptive grasping. A tactile sensing information acquisition circuit is built, and force and bending sensors are integrated into the robotic gripper to measure the contact force distribution on the contact surface and the deformation of the soft fingers. A robotic manipulator platform is developed to collect the tactile sensing data in the grasping process. The performance of the random forest (RF), k-nearest neighbor (KNN), support vector classification (SVC), naive Bayes (NB), linear discriminant analysis (LDA), and ridge regression (RR) classifiers in identifying and classifying five types of fruits using the adaptive gripper is evaluated and compared. The RF classifier achieves the highest accuracy of 98%, while the accuracies of the other classifiers vary from 74% to 97%. The experiment illustrates that efficient and accurate fruit identification can be realized with the adaptive gripper and machine learning classifiers, and that the proposed method can provide a reference for controlling the grasping force and planning the robotic motion in the plucking, picking, and harvesting of fruits and vegetables.