Affiliation:
1. Graduate School of Computer Science and Engineering, University of Aizu, Tsuruga, Ikki-machi, Aizuwakamatsu City 965-8580, Japan
Abstract
There are numerous communication barriers between people with and without hearing impairments. Writing and sign language are the most common modes of communication. However, written communication takes a long time. Furthermore, because sign language is difficult to learn, few people understand it. It is difficult to communicate between hearing-impaired people and hearing people because of these issues. In this research, we built the Sign-Glove system to recognize sign language, a device that combines a bend sensor and WonderSense (an inertial sensor node). The bending sensor was used to recognize the hand shape, and WonderSense was used to recognize the hand motion. The system collects a more comprehensive sign language feature. Following that, we built a weighted DTW fusion multi-sensor. This algorithm helps us to combine the shape and movement of the hand to recognize sign language. The weight assignment takes into account the feature contributions of the sensors to further improve the recognition rate. In addition, a set of interfaces was created to display the meaning of sign language words. The experiment chose twenty sign language words that are essential for hearing-impaired people in critical situations. The accuracy and recognition rate of the system were also assessed.
Funder
JSPS KAKENHI
JKA Foundation
NEDO Intensive Support for Young Promising Researchers
Subject
Electrical and Electronic Engineering,Computer Networks and Communications,Hardware and Architecture,Signal Processing,Control and Systems Engineering
Reference26 articles.
1. Ministry of Health (2023, January 20). Labour and Welfare Home Page, ”2016 Survey on Difficulty in Life (Nationwide Fact-Finding Survey on Children with Disabilities at Home) Results”, Available online: https://www.mhlw.go.jp/toukei/list/dl/seikatsu_chousa_c_h28.pdf.
2. Sign Language Recognition: A Deep Survey;Rastgoo;Expert Syst. Appl.,2021
3. Amin, M.S., Rizvi, S.T., and Hossain, M.M. (2022). A Comparative Review on Applications of Different Sensors for Sign Language Recognition. J. Imaging, 8.
4. Emerging Wearable Interfaces and Algorithms for Hand Gesture Recognition: A Survey;Jiang;IEEE Rev. Biomed. Eng.,2021
5. Multi-Sensor Glove Design and Bio-Signal Data Collection;Nat. Appl. Sci. J. Full Pap. 2nd Int. Congr. Updates Biomed. Eng.,2021
Cited by
5 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献