Sand Cat Swarm Optimizer with Deep Wavelet Autoencoder-based Sign Language Recognition for Hearing- and Speech-impaired Persons

Author:

Asiri Mashael M.12ORCID,Motwakel Abdelwahed3,Drar Suhanda4

Affiliation:

1. Department of Computer Science, College of Science and Arts at Mahayil, King Khalid University, Abha, Saudi Arabia

2. King Salman Center for Disability Research, Riyadh, Saudi Arabia

3. Department of Information Systems, College of Business Administration in Hawtat Bani Tamim, Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia

4. Department of Computer and Self Development, Preparatory Year Deanship, Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia

Abstract

Sign language is commonly used to interact with people who have speech and hearing disorders. Sign language was exploited for interacting with people having developmental impairments who have some or no communication skills. Communication using Sign language has become a fruitful means of interaction for speech- and hearing-impaired people. The hand gesture recognition technique is useful for dumb and deaf people by using convolutional neural networks (CNNs) and human–computer interface for recognizing the static indication of sign language. Therefore, this study presents a new Sand Cat Swarm Optimizer with Deep Wavelet Autoencoder-based Intelligent Sign Language Recognition (SCSO-DWAESLR) technique for hearing- and speech-impaired persons. In the presented SCSO-DWAESLR technique, computer vision and CNN concepts are utilized for identifying sign languages to aid the interaction of hearing- and speech-impaired persons. The SCSO-DWAESLR method makes use of the Inception v3 model for the feature map generation process. In addition, the DWAE classifier is utilized for the recognition and classification of different kinds of signs posed by hearing- and speech-impaired persons. Finally, the hyperparameters related to the DWAE classifier are optimally chosen by using the SCSO algorithm. For exhibiting the effectual recognition outcomes of the SCSO-DWAESLR technique, a detailed experimental analysis was performed. The comparative outcome highlights the superior recognition performance of the SCSO-DWAESLR method over existing techniques under several evaluation metrics.

Funder

King Salman Center for Disability Research

Publisher

King Salman Center for Disability Research

Subject

General Medicine,General Earth and Planetary Sciences,General Environmental Science,General Medicine,Ocean Engineering,General Medicine,General Medicine,General Medicine,General Medicine,General Earth and Planetary Sciences,General Environmental Science,General Medicine

Reference21 articles.

1. Implementation of dynamic gesture interpretation of sign language for impact on hearing and speech impairment;B Aarthi,2023

2. Brain tumor detection and classification on MR images by a deep wavelet auto-encoder model;I Abd El Kader;Diagnostics,2021

3. Ethiopian sign language recognition using deep convolutional neural network;BT Abeje;Multimed. Tools Appl.,2022

4. Deep learning-based sign language recognition for hearing and speaking impaired people;MM Alnfiai;Intell. Autom. Soft Comput.,2023

5. Real-time assamese sign language recognition using MediaPipe and deep learning;J Bora;Procedia Comput. Sci.,2023

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3