Author:
Kumarawadu Priyantha,Izzath Mohamad
Abstract
A sign language recognition system for low-resource Sinhala Sign Language using Leap Motion (LM) and Deep Neural Networks (DNN) has been presented in this paper. The study extracts static and dynamic features of hand movements of Sinhala Sign Language (SSL) using a LM controller which acquires the position of the palm, radius of hand sphere and positions of five fingers, and the proposed system is tested with the selected 24 letters and 6 words. The experimental results prove that the proposed DNN model with an average testing accuracy of 89.2% outperforms a Naïve Bayes model with 73.3% testing accuracy and a Support Vector Machine (SVM) based model with 81.2% testing accuracy. Therefore, the proposed system which uses 3D non-contact LM Controller and machine learning model has a great potential to be an affordable solution for people with hearing impairment when they communicate with normal people in their day-to-day life in all service sectors.
Publisher
Inventive Research Organization
Reference25 articles.
1. [1] World Health Organization, “World Report on Hearing”, Geneva; BY-NC-SA 3.0 IGO: Licensee: CC, (2021)
2. [2] M. Ranaweera Premasiri, H. A. D. K. N. Hettiarachchi, J. C. Delmar, P. H. S. Dias, G. S. Mallika, W. G. S. A. K. Rajapaksha, A. N. Jayasekara, S. M. W. Samarakoon et al. (Eds.). “Sri Lankan Sign Dictionary: Sinhala Language”. National Institute of Education, Maharagama, Sri Lanka (2015)
3. [3] B. H. Juang and L. R. Rabiner, “Hidden Markov models for speech recognition,” Technometrics, vol. 33, no. 3, pp. 251–272, (1991)
4. [4] H. Bunke, M. Roth, and E. G. Schukat-Talamazzini, “Off-line cursive handwriting recognition using hidden Markov models,” Pattern recognition, vol. 28, no. 9, pp. 1399–1413, (1995)
5. [5] K. Grobel and M. Assan, “Isolated sign language recognition using hidden Markov models,” in Proceedings of the IEEE International Conference on System, Man and Cybernetics, pp. 162-167, (1996)