AI empowered Auslan learning for parents of deaf children and children of deaf adults
-
Published:2024-03-18
Issue:
Volume:
Page:
-
ISSN:2730-5953
-
Container-title:AI and Ethics
-
language:en
-
Short-container-title:AI Ethics
Author:
Sheng Hongwei, Shen Xin, Du Heming, Zhang Hu, Huang Zi, Yu XinORCID
Abstract
AbstractCommunication poses a challenge for the deaf and hearing loss community. This difficulty is even more pronounced in the families of Children of Deaf Adults (CODAs) and Parents of Deaf Children (PODCs). To help these families overcome this challenge, we design an AI-empowered interactive bi-directional Australian Sign Language (i.e., Auslan) dictionary application to facilitate communication within a household. Technically, our APP can not only look up sign gestures for the given English words but also translate isolated Auslan gestures into English. Through an inviting user interface and experience design, we can further improve engagement within the CODA and PODC families while enabling Auslan education at home. The positive user experience underscores the success of our APP not only in leveraging AI to revolutionise Auslan education but also in promoting cross-generational language acquisition and communication.
Funder
Australian Research Council Google research The University of Queensland
Publisher
Springer Science and Business Media LLC
Reference33 articles.
1. Organization, W.H., et al.: World report on hearing (2021) 2. Albanie, S., Varol, G., Momeni, L., Bull, H., Afouras, T., Chowdhury, H., Fox, N., Woll, B., Cooper, R., McParland, A., Zisserman, A.: BBC-Oxford British sign language dataset. CoRR arXiv:abs/2111.03635 (2021) 3. Zhou, H., Zhou, W., Qi, W., Pu, J., Li, H.: Improving sign language translation with monolingual data by sign back-translation. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, Virtual, June 19–25, 2021, pp. 1316–1325 (2021) 4. Duarte, A.C., Palaskar, S., Ventura, L., Ghadiyaram, D., DeHaan, K., Metze, F., Torres, J., Giró-i-Nieto, X.: How2sign: A large-scale multimodal dataset for continuous American sign language. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, Virtual, June 19–25, 2021, pp. 2735–2744 (2021) 5. Shen, X., Yuan, S., Sheng, H., Du, H., Yu, X.: Auslan-daily: Australian sign language translation for daily communication and news. In: Thirty-Seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track (2023)
|
|