Abstract
AbstractEmploying cognitive robots, capable of throwing and catching, is a strategy aimed at expediting the logistics process within Industry 4.0’s smart manufacturing plants, specifically for the transportation of small-sized manufacturing parts. Since the flight of mechanically thrown objects is inherently unpredictable, it is crucial for the catching robot to observe the initial trajectory with utmost precision and intelligently forecast the final catching position to ensure accurate real-time grasping. This study utilizes multi-camera tracking to monitor mechanically thrown objects. It involves the creation of a 3D simulation that facilitates controlled mechanical throwing of objects within the internal logistics environment of Industry 4.0. The developed simulation empowers users to define the attributes of the thrown object and capture its trajectory using a simulated pinhole camera, which can be positioned at any desired location and orientation within the in-plant logistics environment of flexible manufacturing systems. The simulation facilitated ample experimentation to be conducted for determining the optimal camera positions for accurately observing the 3D interception positions of a flying object based on its apparent size on the camera’s sensor plane. Subsequently, a variety of calibrated multi-camera setups were experimented while placing cameras at identified optimal positions. Based on the obtained results, the most effective multi-camera configuration setup is derived. Finally, a training dataset is prepared for 3000 simulated throwing experiments where the initial part of the trajectory consists of observed interception positions, through derived best multi-camera setup, and the final part consists of actual positions. The encoder–decoder Bi-LSTM deep neural network is proposed and trained on this dataset. The trained model outperformed the current state-of-the-art by accurately predicting the final 3D catching point, achieving a mean average error of 5 mm and a root-mean-square error of 7 mm in 200 real-world test experiments.
Funder
Università degli Studi di Firenze
Publisher
Springer Science and Business Media LLC
Reference34 articles.
1. Alam, F., Tio, W., Watkins, S., et al.: Effects of spin on tennis ball aerodynamics: an experimental and computational study, 324–327 (2007)
2. Ansari, G.J., Shah, J.H., Farias, M.C., et al.: An optimized feature selection technique in diversified natural scene text for classification using genetic algorithm. IEEE Access 9, 54923–54937 (2021)
3. Barteit, D., Frank, H., Kupzog, F.: Accurate prediction of interception positions for catching thrown objects in production systems. In: 2008 6th IEEE International Conference on Industrial Informatics, pp. 893–898. IEEE (2008)
4. Barteit, D., Frank, H., Pongratz, M., et al.: Measuring the intersection of a thrown object with a vertical plane. In: 2009 7th IEEE International Conference on Industrial Informatics, pp. 680–685. IEEE (2009)
5. Barteit, D.F.: Tracking of thrown objects: catching of mechanically thrown parts for transport in manufacturing. PhD thesis, Vienna University of Technology, Austria (2010)