Development of a Wearable Sensor Glove for Real-Time Sign Language Translation-Reference-Cited by-同舟云学术

Development of a Wearable Sensor Glove for Real-Time Sign Language Translation

Published:2023-10-05 Issue:5 Volume:7 Page:25-38
ISSN:2516-029X
Container-title:Annals of Emerging Technologies in Computing
language:en
Short-container-title:AETiC

Author:

Ambar Radzi,Salim Safyzan,Wahab Mohd Helmy Abd,Jamil Muhammad Mahadi Abdul,Phing Tan Ching

Abstract

This article describes the development of a wearable sensor glove for sign language translation and an Android-based application that can display words and produce speech of the translated gestures in real-time. The objective of this project is to enable a conversation between a deaf person and another person who does not know sign language. The glove is composed of five (5) flexible sensors and an inertial sensor. This article also elaborates the development of an Android-based application using the MIT App Inventor software that produces words and speech of the translated gestures in real-time. The sign language gestures were measured by sensors and transmitted to an Arduino Nano microcontroller to be translated into words. Then, the processed data was transmitted to the Android application via Bluetooth. The application displayed the words and produced the sound of the gesture. Furthermore, preliminary experimental results demonstrated that the glove successfully displayed words and produced the sound of thirteen (13) translated sign languages via the developed application. In the future, it is hoped that further upgrades can produce a device to assist a deaf person communicates with normal people without over-reliance on sign language interpreters.

Publisher

International Association for Educators and Researchers (IAER)

Subject

Electrical and Electronic Engineering,General Computer Science

Reference21 articles.

1. Bryan Berrú-Novoa, Ricardo González-Valenzuela and Pedro Shiguihara-Juárez, "Peruvian sign language recognition using low resolution cameras", in Proceedings of the 2018 IEEE XXV International Conference on Electronics, Electrical Engineering and Computing (IEEE INTERCON 2018), 8-10 August 2018, Lima, Peru, E-ISBN: 978-1-5386-5491-0, DOI: 10.1109/INTERCON.2018.8526408, pp. 1-4, Published by IEEE, Available: https://ieeexplore.ieee.org/document/8526408.

2. Ariya Thongtawee, Onamon Pinsanoh and Yuttana Kitjaidure, "A Novel Feature Extraction for American Sign Language Recognition Using Webcam", in Proceedings of the 2018 11th Biomedical Engineering International Conference (IEEE BMEiCON 2018), 21-24 November 2018, Chiang Mai, Thailand, E-ISBN: 978-1-5386-5724-9, DOI: 10.1109/BMEiCON.2018.8609933, pp. 1-5, Available: https://ieeexplore.ieee.org/document/8609933.

3. Sakshi Sharma and Sukhwinder Singh, “Vision-based hand gesture recognition using deep learning for the interpretation of sign language”, in Expert Systems with Applications, Online ISSN: 0957-4174, Vol. 182, p. 115657, 15 November 2021, Published by Elsevier, DOI: 10.1016/j.eswa.2021.115657, Available: https://www.sciencedirect.com/science/article/abs/pii/S0957417421010484.

4. Neil Buckley, Lewis Sherrett and Emanuele Lindo Secco, “A CNN sign language recognition system with single & double-handed gestures", in Proceedings of the 2021 IEEE 45th Annual Computers, Software, and Applications Conference 2021 (COMPSAC), 12-16 July 2021, Madrid, Spain, Online ISBN: 978-1-6654-2464-6, E-ISBN: 978-1-6654-2463-9, DOI: 10.1109/COMPSAC51774.2021.00173, pp. 1250-1253, Published by IEEE, Available: https://ieeexplore.ieee.org/document/9529449.

5. Polurie Venkat, Vijay Kishore, M. V. D. Prasad, Ch. Raghava Prasad and R. Rahul, "4-Camera model for sign language recognition using elliptical fourier descriptors and ANN", in Proceedings of the 2015 International Conference on Signal Processing and Communication Engineering Systems (IEEE SPACES 2015), 2-3 January 2015, Guntur, India, Online ISBN: 978-1-4799-6109-2, DOI: 10.1109/SPACES.2015.7058288, pp. 34-38, Published by IEEE, Available: https://ieeexplore.ieee.org/document/7058288.