A Framework for Real-Time Gestural Recognition and Augmented Reality for Industrial Applications
Author:
Torres Winnie1ORCID, Santos Lilian2ORCID, Melo Gustavo1ORCID, Oliveira Andressa1, Nascimento Pedro2ORCID, Carvalho Geovane2ORCID, Neves Tácito3ORCID, Martins Allan1ORCID, Araújo Ícaro2ORCID
Affiliation:
1. Electrical Engineering Department, Center of Technology, Federal University of Rio Grande do Norte—UFRN, Natal 59072-970, Brazil 2. Computing Institute, A. C. Simões Campus, Federal University of Alagoas—UFAL, Maceió 57072-970, Brazil 3. Department of Exact Sciences, Center for Applied Sciences and Education, Federal University of Paraíba, Rio Tinto 58297-000, Brazil
Abstract
In recent decades, technological advancements have transformed the industry, highlighting the efficiency of automation and safety. The integration of augmented reality (AR) and gesture recognition has emerged as an innovative approach to create interactive environments for industrial equipment. Gesture recognition enhances AR applications by allowing intuitive interactions. This study presents a web-based architecture for the integration of AR and gesture recognition, designed to interact with industrial equipment. Emphasizing hardware-agnostic compatibility, the proposed structure offers an intuitive interaction with equipment control systems through natural gestures. Experimental validation, conducted using Google Glass, demonstrated the practical viability and potential of this approach in industrial operations. The development focused on optimizing the system’s software and implementing techniques such as normalization, clamping, conversion, and filtering to achieve accurate and reliable gesture recognition under different usage conditions. The proposed approach promotes safer and more efficient industrial operations, contributing to research in AR and gesture recognition. Future work will include improving the gesture recognition accuracy, exploring alternative gestures, and expanding the platform integration to improve the user experience.
Funder
Coordenação de Aperfeiçoamento de Pessoal de Nível Superior—Brasil
Reference31 articles.
1. Chen, J.Y.C., and Fragomeni, G. (2020). Virtual, Augmented and Mixed Reality. Design and Interaction, Proceedings of the 12th International Conference, VAMR 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, 19–24 July 2020, Springer. 2. Ronzhin, A., and Shishlakov, V. (2020, January 15–18). Hand Gestures Recognition Model for Augmented Reality Robotic Applications. Proceedings of the 15th International Conference on Electromechanics and Robotics “Zavalishin’s Readings”, Ufa, Russia. 3. Dong, J., Xia, Z., and Zhao, Q. (2021). Augmented Reality Assisted Assembly Training Oriented Dynamic Gesture Recognition and Prediction. Appl. Sci., 11. 4. A Transferable Adaptive Domain Adversarial Neural Network for Virtual Reality Augmented EMG-Based Gesture Recognition;Phinyomark;IEEE Trans. Neural Syst. Rehabil. Eng.,2021 5. Chen, J.Y.C., Fragomeni, G., Degen, H., and Ntoa, S. (2022). HCI International 2022—Late Breaking Papers: Interacting with eXtended Reality and Artificial Intelligence, Proceedings of the 24th International Conference on Human-Computer Interaction, HCII 2022, Virtual Event, 26 June–1 July 2022, Springer.
|
|