Exploring a Novel Mexican Sign Language Lexicon Video Dataset
-
Published:2023-08-19
Issue:8
Volume:7
Page:83
-
ISSN:2414-4088
-
Container-title:Multimodal Technologies and Interaction
-
language:en
-
Short-container-title:MTI
Author:
Martínez-Sánchez Víctor1, Villalón-Turrubiates Iván1ORCID, Cervantes-Álvarez Francisco1ORCID, Hernández-Mejía Carlos2ORCID
Affiliation:
1. Instituto Tecnológico de Estudios Superiores de Occidente (ITESO), Guadalajara 45604, Mexico 2. Tecnológico Nacional de México/ITS de Misantla, Misantla 93850, Mexico
Abstract
This research explores a novel Mexican Sign Language (MSL) lexicon video dataset containing the dynamic gestures most frequently used in MSL. Each gesture consists of a set of different versions of videos under uncontrolled conditions. The MX-ITESO-100 dataset is composed of a lexicon of 100 gestures and 5000 videos from three participants with different grammatical elements. Additionally, the dataset is evaluated in a two-step neural network model as having an accuracy greater than 99% and thus serves as a benchmark for future training of machine learning models in computer vision systems. Finally, this research provides an inclusive environment within society and organizations, in particular for people with hearing impairments.
Subject
Computer Networks and Communications,Computer Science Applications,Human-Computer Interaction,Neuroscience (miscellaneous)
Reference34 articles.
1. Mejía-Pérez, K., Córdova-Esparza, D.M., Terven, J., Herrera-Navarro, A.M., García-Ramírez, T., and Ramírez-Pedraza, A. (2022). Automatic Recognition of Mexican Sign Language Using a Depth Camera and Recurrent Neural Networks. Appl. Sci., 12. 2. Dreuw, P., Neidle, C., Athitsos, V., Sclaroff, S., and Ney, H. (June, January 26). Benchmark Databases for Video-Based Automatic Sign Language Recognition. Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC’08), Marrakech, Morocco. 3. Athitsos, V., Neidle, C., Sclaroff, S., Nash, J., Stefan, A., Yuan, Q., and Thangali, A. (2008, January 23–28). The American Sign Language Lexicon Video Dataset. Proceedings of the 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Anchorage, AK, USA. 4. Sosa-Jiménez, C.O., Ríos-Figueroa, H.V., Rechy-Ramírez, E.J., Marín-Hernández, A., and González-Cosío, A.L.S. (2017, January 8–10). Real-time Mexican Sign Language recognition. Proceedings of the 2017 IEEE International Autumn Meeting on Power, Electronics and Computing (ROPEC), Ixtapa, Mexico. 5. Carmona-Arroyo, G., Ríos-Figueroa, H.V., and Avendaño-Garrido, M.L. (2021). Machine Vision Inspection Systems, Volume 2: Machine Learning-Based Approaches, Wiley.
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献
|
|