Usability, User Experience, and Acceptance Evaluation of CAPACITY: A Technological Ecosystem for Remote Follow-Up of Frailty

Abstract

Frailty predisposes older persons to adverse events, and information and communication technologies can play a crucial role to prevent them. CAPACITY provides a means to remotely monitor variables with high predictive power for adverse events, enabling preventative personalized early interventions. This study aims at evaluating the usability, user experience, and acceptance of a novel mobile system to prevent disability. Usability was assessed using the system usability scale (SUS); user experience using the user experience questionnaire (UEQ); and acceptance with the technology acceptance model (TAM) and a customized quantitative questionnaire. Data were collected at baseline (recruitment), and after three and six months of use. Forty-six participants used CAPACITY for six months; nine dropped out, leaving a final sample of 37 subjects. SUS reached a maximum averaged value of 83.68 after six months of use; no statistically significant values have been found to demonstrate that usability improves with use, probably because of a ceiling effect. UEQ, obtained averages scores higher or very close to 2 in all categories. TAM reached a maximum of 51.54 points, showing an improvement trend. Results indicate the success of the participatory methodology, and support user centered design as a key methodology to design technologies for frail older persons. Involving potential end users and giving them voice during the design stage maximizes usability and acceptance.