Enabling People With Intellectual and Sensory Disabilities to Trigger a Tablet’s Delivery of Task Instructions by Walking to the Tablet: Proof-of-Concept Study (Preprint)

Abstract

People with intellectual and sensory or sensory-motor disabilities tend to have problems performing multistep tasks. To alleviate their problems, technological solutions have been developed that provide task-step instructions. Instructions are generally delivered at people’s request (eg, as they touch an area of a computer or tablet screen) or automatically, at preset intervals.

This study carried out a preliminary assessment of a new tablet-based technology system that presented task-step instructions when participants with intellectual and sensory disabilities walked close to the tablet (ie, did not require participants to perform fine motor responses on the tablet screen).

The system entailed a tablet and a wireless camera and was programmed to present instructions when participants approached the tablet, that is, when the camera positioned in front of the tablet detected them. Two instructions were available for each task step. One instruction concerned the object(s) that the participants were to collect, and the other instruction concerned the “where” and “how” the object(s) collected would need to be used. For 3 of the six participants, the two instructions were presented in succession, with the second instruction presented once the required object(s) had been collected. For the other 3 participants, the two instructions were presented simultaneously. Instructions consisted of pictorial representations combined with brief verbal phrases. The impact of the system was assessed for each of the 2 groups of participants using a nonconcurrent multiple baseline design across individuals.

All participants were successful in using the system. Their mean frequency of correct task steps was close to or above 11.5 for tasks including 12 steps. Their level of correct performance tended to be much lower during the baseline phase when they were to receive the task-step instructions from a regular tablet through scrolling responses.

The findings, which need to be interpreted with caution given the preliminary nature of the study, suggest that the new tablet-based technology system might be useful for helping people with intellectual and sensory disabilities perform multistep tasks.