Affiliation:
1. Microsoft Research, USA
2. Boston University, USA
3. Gallaudet University, USA
4. Rochester Institute of Technology, USA
5. Microsoft, USA
6. Microsoft, Germany
7. University of Washington, USA
Abstract
Sign language datasets are essential to developing many sign language technologies. In particular, datasets are required for training artificial intelligence (AI) and machine learning (ML) systems. Though the idea of using AI/ML for sign languages is not new, technology has now advanced to a point where developing such sign language technologies is becoming increasingly tractable. This critical juncture provides an opportunity to be thoughtful about an array of Fairness, Accountability, Transparency, and Ethics (FATE) considerations. Sign language datasets typically contain recordings of people signing, which is highly personal. The rights and responsibilities of the parties involved in data collection and storage are also complex and involve individual data contributors, data collectors or owners, and data users who may interact through a variety of exchange and access mechanisms. Deaf community members (and signers, more generally) are also central stakeholders in any end applications of sign language data. The centrality of sign language to deaf culture identity, coupled with a history of oppression, makes usage by technologists particularly sensitive. This piece presents many of these issues that characterize working with sign language AI datasets, based on the authors’ experiences living, working, and studying in this space.
Funder
Microsoft
NSF
National Institute on Deafness and Other Communication Disorders,Office of Behavioral and Social Sciences Research at the National Institutes of Health
National Institute on Disability, Independent Living, and Rehabilitation Research
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Science Applications,Human-Computer Interaction
Reference223 articles.
1. United Nations. 2016. WFD and WASLI Issue Statement on Signing Avatars. Retrieved from https://wfdeaf.org/news/wfd-wasli-issue-statement-signing-avatars/. United Nations. 2016. WFD and WASLI Issue Statement on Signing Avatars. Retrieved from https://wfdeaf.org/news/wfd-wasli-issue-statement-signing-avatars/.
2. Registry of Interpreters for the Deaf Inc. (RID). 2019. 2018 Annual Report. Retrieved from https://rid.org/2018-annual-report/. Registry of Interpreters for the Deaf Inc. (RID). 2019. 2018 Annual Report. Retrieved from https://rid.org/2018-annual-report/.
Cited by
12 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. U.S. Deaf Community Perspectives on Automatic Sign Language Translation;The 25th International ACM SIGACCESS Conference on Computers and Accessibility;2023-10-22
2. The Sem-Lex Benchmark: Modeling ASL Signs and their Phonemes;The 25th International ACM SIGACCESS Conference on Computers and Accessibility;2023-10-22
3. Community-Driven Information Accessibility: Online Sign Language Content Creation within d/Deaf Communities;Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems;2023-04-19
4. Chapter 11. W(h)ither the ASL corpus?;Advances in Sign Language Corpus Linguistics;2023-03-15
5. Interactive description to enhance accessibility and experience of deaf and hard-of-hearing individuals in museums;Universal Access in the Information Society;2023-03-01