Affiliation:
1. King Fahd University of Petroleum and Minerals, Dhahran, Saudi Arabia
Abstract
Sign language is the major means of communication for the deaf community. It uses body language and gestures such as hand shapes, lib patterns, and facial expressions to convey a message. Sign language is geography-specific, as it differs from one country to another. Arabic Sign language is used in all Arab countries. The availability of a comprehensive benchmarking database for ArSL is one of the challenges of the automatic recognition of Arabic Sign language. This article introduces KArSL database for ArSL, consisting of 502 signs that cover 11 chapters of ArSL dictionary. Signs in KArSL database are performed by three professional signers, and each sign is repeated 50 times by each signer. The database is recorded using state-of-art multi-modal Microsoft Kinect V2. We also propose three approaches for sign language recognition using this database. The proposed systems are Hidden Markov Models, deep learning images’ classification model applied on an image composed of shots of the video of the sign, and attention-based deep learning captioning system. Recognition accuracies of these systems indicate their suitability for such a large number of Arabic signs. The techniques are also tested on a publicly available database. KArSL database will be made freely available for interested researchers.
Funder
King Fahd University of Petroleum and Minerals
Publisher
Association for Computing Machinery (ACM)
Reference64 articles.
1. Pulse-coupled neural network feature generation model for Arabic sign language recognition;Magdy;IET Image Proc.,2013
2. Kinda Al-Fityani and Carol Padden. 2010. Sign language geography in the Arab world. Sign Lang.: Cambridge Surv. (2010) 433--450. Kinda Al-Fityani and Carol Padden. 2010. Sign language geography in the Arab world. Sign Lang.: Cambridge Surv. (2010) 433--450.
3. Recognition of gestures in Arabic sign language using neuro-fuzzy systems
Cited by
30 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献