Internet-Delivered Emotional Self-Management program for the General Population During the COVID-19 Pandemic: Usability testing (Preprint)

Abstract

Internet-based self-help interventions have the potential to help people address their emotional needs at relatively low costs. However, if the system does not offer optimal functions, it could reduce end-users' adherence and satisfaction with the treatment, therefore possibly compromising the effectiveness of the program

This study evaluated the usability of an Internet-delivered self-help intervention for emotional self-management among the general population in Italy during the COVID-19 pandemic. The main goals were to (1) collect qualitative and quantitative data on usability and (2) identify usability problems.

A balanced gender-age sample of 10 individuals meeting the inclusion criteria were consecutively recruited online. The think-aloud testing method, the system usability scale, and an ad hoc semi-structured interview were employed to determine the overall system usability. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content using thematic analysis.

The participants were mostly satisfied with the overall usability of the program. Still, some usability problems were encountered by older (≥45 years) users, who took longer, made more mistakes, and needed more help in performing the tasks than their younger counterparts. The mean perceived usability score was 68,25 - classified as “good”. The analysis of the interviews revealed 3 central themes: general thoughts about the platform, weaknesses of the platform and difficulties encountered while navigating and completing tasks, and strengths of the platform.

Conducting usability testing was a crucial step at an early stage of the development process of an Internet-based self-help intervention to identify potential problems of usability with the system. Based on the results of this study, important improvements will be made before the RinasciMENTE program will be tested in real-world conditions.

RR2-10.1186/s13063-022-06714-x