A Computer Vision-Based System for Recognition and Classification of Urdu Sign Language Dataset for Differently Abled People Using Artificial Intelligence

Author:

Zahid Hira1ORCID,Syed Sidra Abid2ORCID,Rashid Munaf3ORCID,Hussain Samreen4ORCID,Umer Asif5ORCID,Waheed Abdul67ORCID,Nasim Shahzad8,Zareei Mahdi9ORCID,Mansoor Nafees10ORCID

Affiliation:

1. Biomedical Engineering Department and Electrical Engineering Department, Ziauddin University, Karachi 74600, Pakistan

2. Biomedical Engineering Department, Sir Syed University of Engineering and Technology, Karachi 75300, Pakistan

3. Software Engineering Department, Sir Syed University of Engineering and Technology, Karachi 74600, Pakistan

4. Electronic Engineering Department, Dawood University of Engineering & Technology, Karachi 74800, Pakistan

5. Department of Computer Science & IT, Hazara University, Mansehra 23100, Pakistan

6. Department of Computer Science, Women University Swabi, Swabi 23430, Pakistan

7. School of Electrical and Computer Engineering, Seoul National University, Seoul 08826, Republic of Korea

8. Begum Nusrat Bhutto Women University, Faculty of Management Information Science and Technology, Sukkur, Pakistan

9. Tecnologico de Monterrey, School of Engineering and Sciences, Monterrey 64849, Mexico

10. Department of Computer Science and Engineering, University of Liberal Arts Bangladesh (ULAB), Dhaka, Bangladesh

Abstract

Communication between normal people and deaf people is the most difficult part of daily life worldwide. It is difficult for a normal person to understand a word from the deaf one in their daily routine. So, to communicate with deaf people, different countries developed different sign languages to make communication easy. In Pakistan, for deaf people, the government developed Urdu Sign Language to communicate with deaf people. Physical trainers and experts are difficult to provide everywhere in society, so we need such a computer/mobile-based system to convert the deaf sign symbol into voice and written alphabet that the normal person can easily get the intentions of the deaf one. In this paper, we provided an image processing and deep learning-based model for Urdu Sign Language. The proposed model is implemented in Python 3 and uses different image processing and machine techniques to capture the video and transform the symbols into voice and Urdu writing. First, we get a video from the deaf person, and then the model crops the frames into pictures. Then, the individual picture is recognized for the sign symbol such as if the deaf showed a symbol for one, then the model recognizes it and shows the letter which he/she wants to tell. Image processing techniques such as OpenCV are used for image recognition and classification while TensorFlow and linear regression are used for training the model to behave intelligently in the future. The results show that the proposed model increased accuracy from 80% to 97% and 100% accordingly. The accuracy of the previously available work was 80% when we implemented the algorithms, while with the proposed algorithm, when we used linear regression, we achieved the highest accuracy. Similarly, when we used the TensorFlow deep learning algorithm, we achieved 97% accuracy which was less than that of the linear regression model.

Funder

University of Liberal Arts Bangladesh

Publisher

Hindawi Limited

Subject

Computer Networks and Communications,Computer Science Applications

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3