EasyAsk: An In-App Contextual Tutorial Search Assistant for Older Adults with Voice and Touch Inputs-Reference-Cited by-同舟云学术

EasyAsk: An In-App Contextual Tutorial Search Assistant for Older Adults with Voice and Touch Inputs

Published:2024-08-22 Issue:3 Volume:8 Page:1-27
ISSN:2474-9567
Container-title:Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
language:en
Short-container-title:Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.

Author:

Gao Weiwei¹^ORCID,Du Kexin¹^ORCID,Luo Yujia¹^ORCID,Shi Weinan²^ORCID,Yu Chun²^ORCID,Shi Yuanchun³^ORCID

Affiliation:

1. Department of Computer Science and Technology, Tsinghua University, Beijing, China

2. Department of Computer Science and Technology, Tsinghua University, Beijing, China and Key Laboratory of Pervasive Computing, Ministry of Education, Beijing, China

3. Department of Computer Science and Technology, Tsinghua University, Beijing, China and Key Laboratory of Pervasive Computing, Ministry of Education, Beijing, China and Qinghai University, Xining, Qinghai, China

Abstract

An easily accessible tutorial is crucial for older adults to use mobile applications (apps) on smartphones. However, older adults often struggle to search for tutorials independently and efficiently. Through a formative study, we investigated the demands of older adults in seeking assistance and identified patterns of older adults' behaviors and verbal questions when seeking help for smartphone-related issues. Informed by the findings from the formative study, we designed EasyAsk, an app-independent method to make tutorial search accessible for older adults. This method was implemented as an Android app. Using EasyAsk, older adults can obtain interactive tutorials through voice and touch whenever they encounter problems using smartphones. To power the method, EasyAsk uses a large language model to process the voice text and contextual information provided by older adults, and another large language model to search for the tutorial. Our user experiment, involving 18 older participants, demonstrated that EasyAsk helped users obtain tutorials correctly in 98.94% of cases, making tutorial search accessible and natural.

Publisher

Association for Computing Machinery (ACM)

Link

https://dl.acm.org/doi/pdf/10.1145/3678516

Reference90 articles.

1. Ali Abdolrahmani, Ravi Kuber, and Stacy M Branham. 2018. " Siri Talks at You" An Empirical Investigation of Voice-Activated Personal Assistant (VAPA) Usage by Individuals Who Are Blind. In Proceedings of the 20th international ACM SIGACCESS conference on computers and accessibility. 249--258.

2. Maria Bakardjieva. 2005. Internet society: The Internet in everyday life. Internet Society (2005), 1--232.

3. Statistics Bureau. 2010. Ministry of internal affairs and communications, Japan. Annual Report on Current Population Estimates (2010).

4. Design of interactive tutorials on mobile applications for chinese middle-aged and older adults;Chen Xiaoou;Art and Design Review,2017

5. Pei-Yu Chi, Sally Ahn, Amanda Ren, Mira Dontcheva, Wilmot Li, and Björn Hartmann. 2012. MixT: Automatic Generation of Step-by-Step Mixed Media Tutorials. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST '12). Association for Computing Machinery, New York, NY, USA, 93--102. https://doi.org/10.1145/2380116.2380130