Tap to Sign: Towards using American Sign Language for Text Entry on Smartphones-Reference-Cited by-同舟云学术

Tap to Sign: Towards using American Sign Language for Text Entry on Smartphones

Published:2023-09-11 Issue:MHCI Volume:7 Page:1-23
ISSN:2573-0142
Container-title:Proceedings of the ACM on Human-Computer Interaction
language:en
Short-container-title:Proc. ACM Hum.-Comput. Interact.

Author:

Hassan Saad¹^ORCID,Glasser Abraham²^ORCID,Shengelia Max³^ORCID,Starner Thad⁴^ORCID,Forbes Sean⁵^ORCID,Qualls Nathan⁵^ORCID,Sepah Sam S.⁶^ORCID

Affiliation:

1. Tulane University, New Orleans, LA, USA

2. Gallaudet University, Washington, DC, USA

3. Rochester Institute of Technology, Rochester, NY, USA

4. Google Research, Atlanta, GA, USA

5. DPAN, Ferndale, MI, USA

6. Google Research, Mountain View, CA, USA

Abstract

Soon, smartphones may be capable of allowing American Sign Language (ASL) signing and/or fingerspelling for text entry. To explore the usefulness of this approach, we compared emulated fingerspelling recognition with a virtual keyboard for 12 Deaf participants. With practice, fingerspelling is faster (42.5 wpm), potentially has fewer errors (4.02% corrected error rate) and higher throughput (14.2 bits/second), and is as desired as virtual keyboard texting (31.9 wpm; 6.46% corrected error rate; 10.9 bits/second throughput). Our second study recruits another 12 Deaf users at the 2022 National Association for the Deaf conference to compare the walk-up usability of fingerspelling alone, signing, and virtual keyboard text entry for interacting with an emulated mobile assistant. Both signing and virtual keyboard text entry were preferred over fingerspelling.

Publisher

Association for Computing Machinery (ACM)

Subject

Computer Networks and Communications,Human-Computer Interaction,Social Sciences (miscellaneous)

Link

https://dl.acm.org/doi/pdf/10.1145/3604274

Reference67 articles.

1. 2021. International Day of Sign Languages. https://www.un.org/en/observances/sign-languages-day

2. 2022. Deafness and hearing loss. https://www.who.int/health-topics/hearing-loss#tab=tab_1

3. Mehdi Assefi, Guangchi Liu, Mike P Wittie, and Clemente Izurieta. 2015. An experimental evaluation of apple siri and google speech recognition. Proccedings of the 2015 ISCA SEDE 118 (2015).

4. Judith E Harkins St Matthew Bakke. 2003. Technologies for Communication. Oxford Handbook of Deaf Studies, Language, and Education (2003), 406.

5. F Bakken. 2004. The Inside Text: Social Cultural and Design Perspectives on SMS chapter SMS Use Among Deaf Teens and Young Adults in Norway.