Affiliation:
1. Mechanical Engineering Department, Soongsil University, Seoul 06978, Republic of Korea
Abstract
This study proposes a telemanipulation framework with two wearable IMU sensors without human skeletal kinematics. First, the states (intensity and direction) of spatial hand-guiding gestures are separately estimated through the proposed state estimator, and the states are also combined with the gesture’s mode (linear, angular, and via) obtained with the bi-directional LSTM-based mode classifier. The spatial pose of the 6-DOF manipulator’s end-effector (EEF) can be controlled by combining the spatial linear and angular motions based on integrating the gesture’s mode and state. To validate the significance of the proposed method, the teleoperation of the EEF to the designated target poses was conducted in the motion-capture space. As a result, it was confirmed that the mode could be classified with 84.5% accuracy in real time, even during the operator’s dynamic movement; the direction could be estimated with an error of less than 1 degree; and the intensity could be successfully estimated with the gesture speed estimator and finely tuned with the scaling factor. Finally, it was confirmed that a subject could place the EEF within the average range of 83 mm and 2.56 degrees in the target pose with only less than ten consecutive hand-guiding gestures and visual inspection in the first trial.
Subject
General Mathematics,Engineering (miscellaneous),Computer Science (miscellaneous)
Reference28 articles.
1. Human-machine interface in smart factory: A systematic literature review;Kumar;Technol. Forecast. Soc. Chang.,2022
2. Deep learning-based hand gesture recognition for collaborative robots;Nuzzi;IEEE Instrum. Meas. Mag.,2019
3. Gesture recognition based on CNN and DCGAN for calculation and text output;Fang;IEEE Access,2019
4. Gesture recognition based on skeletonization algorithm and CNN with ASL database;Jiang;Multimedia Tools Appl.,2019
5. Suarez, J., and Murphy, R.R. (2012, January 13). Hand gesture recognition with depth images: A review. Proceedings of the 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication, Paris, France.
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献