Test–Retest Repeatability of Human Gestures in Manipulation Tasks
-
Published:2023-07-02
Issue:13
Volume:13
Page:7808
-
ISSN:2076-3417
-
Container-title:Applied Sciences
-
language:en
-
Short-container-title:Applied Sciences
Author:
Digo Elisa1ORCID, Caselli Elena1, Polito Michele1, Antonelli Mattia1, Gastaldi Laura1ORCID, Pastorelli Stefano1ORCID
Affiliation:
1. Department of Mechanical and Aerospace Engineering, Politecnico di Torino, 10129 Turin, Italy
Abstract
The importance of performance excellence and operator’s safety is fundamental not only when operators perform repetitive and controlled industrial tasks, but also in case of abrupt gestures due to inattention and unexpected circumstances. Since optical systems work at frequencies that are too low and they are not able to detect gestures as early as possible, combining the use of wearable magneto-inertial measurement units (MIMUs) with the adoption of deep learning techniques can be useful to instruct the machine about human motion. To improve the initial training phase of neural networks for high classification performance, gesture repeatability over time has to be verified. Since the test–retest approach has been poorly applied based on MIMUs signals in a context of human–machine interaction, the aim of this work was to evaluate the repeatability of pick-and-place gestures composed of both normal and abrupt movements. Overall, results demonstrated an excellent test–retest repeatability for normal movements and a fair-to-good test–retest repeatability for abrupt movements. In addition, results suggested important information about the application of deep learning to identify the types of movements: the test showed how to improve reinforcement learning for the identification of onset gestures, whereas the retest allowed for defining the time necessary to retrain the network.
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference31 articles.
1. (2016). Robots and Robotic Devices—Collaborative Robots (Standard No. ISO/TS 15066:2016). 2. Digo, E., Antonelli, M., Cornagliotto, V., Pastorelli, S., and Gastaldi, L. (2020). Collection and analysis of human upper limbs motion features for collaborative robotic applications. Robotics, 9. 3. Real-time estimation of upper limbs kinematics with IMUs during typical industrial gestures;Digo;Procedia Comput. Sci.,2022 4. Integrating Wearable and Camera Based Monitoring in the Digital Twin for Safety Assessment in the Industry 4.0 Era. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics);Boldo;Leveraging Applications of Formal Methods, Verification and Validation, Practice: Proceedings of the 11th International Symposium, ISoLA 2022, Rhodes, Greece, 22–30 October 2022,2022 5. De Feudis, I., Buongiorno, D., Grossi, S., Losito, G., Brunetti, A., Longo, N., Di Stefano, G., and Bevilacqua, V. (2022). Evaluation of Vision-Based Hand Tool Tracking Methods for Quality Assessment and Training in Human-Centered Industry 4.0. Appl. Sci., 12.
|
|