Author:
Dhiman R.,Joshi G.,Rama Krishna C.
Abstract
Abstract
The sign language recognition system recently has drawn the attention of various researchers as there is no universal sign language, moreover, it consists of many patterns and postures. Many methods for extracting features and classifying sign language have been proposed in the literature, most of them are based on machine learning techniques. In this article, a deep learning method has been adopted by designing a Convolution Neural Network (CNN) model to extract the sign language features where for classification softmax layer is used. All alphabets in simple as well as complex backgrounds have been considered, where data is collected from 100 subjects in different lighting conditions. The effect of various optimization techniques (Adam, Sgdm, RMSProp), activation functions (ReLU and Leaky ReLU) for generalization ability is also observed. The proposed approach has succeeded in attaining the testing accuracy of 99.10%, 92.69%, and 95.95% on the Indian sign language dataset with simple, complex backgrounds and on a mixed background scenarios, respectively. The model is also tested on NUS dataset-I, NUS dataset-II, their combination, and achieved the accuracy of 100%, 95.95%, and 97.22% respectively.
Subject
General Physics and Astronomy
Reference23 articles.
1. Hand segmentation techniques to hand gesture recognition for natural human computer interaction;Ghotkar;International Journal of Human Computer Interaction,2012
2. Deep learning in vision based static hand gesture recognition;Oyedotun;Neural Comput Appl,2017
3. Indian sign language translator using gesture recognition algorithm;Badhe,2015
4. hand sign language recognition for bangla alphabet using support vector machine;Uddin,2016
5. Indian sign language recognition using krawtchouk moment-based local features;Kaur;The Imaging Science Journal,2017
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Improving accuracy using ML/DL in vision based techniques of ISLR;Multimedia Tools and Applications;2023-08-03
2. Different Categories of Feature Extraction and Machine Learning Classification Models Used for Hand Gesture Recognition Systems: A Review;2023 IEEE 8th International Conference for Convergence in Technology (I2CT);2023-04-07
3. Indian Sign Language Digit Translation Using CNN with Swish Activation Function;Key Digital Trends Shaping the Future of Information and Management Science;2023
4. Indian Sign Language Recognition System for Dynamic Signs;2022 10th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO);2022-10-13