QuickPic AAC: An AI-Based Application to Enable Just-in-Time Generation of Topic-Specific Displays for Persons Who Are Minimally Speaking-Reference-Cited by-同舟云学术

QuickPic AAC: An AI-Based Application to Enable Just-in-Time Generation of Topic-Specific Displays for Persons Who Are Minimally Speaking

Published:2024-08-29 Issue:9 Volume:21 Page:1150
ISSN:1660-4601
Container-title:International Journal of Environmental Research and Public Health
language:en
Short-container-title:IJERPH

Author:

Yu Christina¹²,Schlosser Ralf W.¹³^ORCID,Fontana de Vargas Maurício⁴^ORCID,White Leigh Anne¹^ORCID,Koul Rajinder⁵,Shane Howard C.¹²

Affiliation:

1. Boston Children’s Hospital, Waltham, MA 02453, USA

2. Massachusetts General Hospital Institute of Health Professionals, Boston, MA 02129, USA

3. Department of Communication Sciences and Disorders, Northeastern University, Boston, MA 02115, USA

4. School of Information Studies, McGill University, Montreal, QC H3A 0G4, Canada

5. Department of Speech, Language, and Hearing Sciences, University of Texas at Austin, Austin, TX 78712, USA

Abstract

As artificial intelligence (AI) makes significant headway in various arenas, the field of speech–language pathology is at the precipice of experiencing a transformative shift towards automation. This study introduces QuickPic AAC, an AI-driven application designed to generate topic-specific displays from photographs in a “just-in-time” manner. Using QuickPic AAC, this study aimed to (a) determine which of two AI algorithms (NLG-AAC and GPT-3.5) results in greater specificity of vocabulary (i.e., percentage of vocabulary kept/deleted by clinician relative to vocabulary generated by QuickPic AAC; percentage of vocabulary modified); and to (b) evaluate perceived usability of QuickPic AAC among practicing speech–language pathologists. Results revealed that the GPT-3.5 algorithm consistently resulted in greater specificity of vocabulary and that speech–language pathologists expressed high user satisfaction for the QuickPic AAC application. These results support continued study of the implementation of QuickPic AAC in clinical practice and demonstrate the possibility of utilizing topic-specific displays as just-in-time supports.

Funder

App Factory to Support Health and Function of People with Disabilities

Publisher

MDPI AG

Link

https://www.mdpi.com/1660-4601/21/9/1150/pdf

Reference29 articles.

1. Applying technology to visually support language and communication in individuals with ASD;Shane;J. Autism Develop. Dis.,2012

2. Beukelman, D., and Light, J. (2020). Augmentative and Alternative Communication: Supporting Children and Adults with Complex Communication Needs, Paul H. Brookes.

3. Wearables and mobile technologies in Autism Spectrum Disorder interventions: A systematic literature review;Koumpouros;Res. Autism Spectr. Disord.,2019

4. Shane, H.C., Laubscher, E., Schlosser, R.W., Fadie, H.L., Sorce, J.F., Abramson, J.S., Flynn, S., and Corley, K. (2014). Enhancing Communication for Individuals with Autism: A Guide to the Visual Immersion System, Paul H. Brookes.

5. Beukelman, D.R., and Mirenda, P. (2005). Augmentative and Alternative Communication: Supporting Children and Adults with Complex Communication Needs, Paul H. Brookes. [3rd ed.].