BACKGROUND
Terminology and studies on usability lack common terminology and reporting standards.
OBJECTIVE
To generate consensus on terms and procedures that should be considered when planning and reporting a study on usability evaluation of health-related digital solutions both by users and experts.
METHODS
A Delphi study with two rounds was conducted with a panel of 30 international participants experienced in usability evaluation. In the first round, they were asked to comment on definitions and rate the importance of pre-identified procedures using a 9-item Likert scale, and suggest additional procedures. In the second round, experienced participants were asked to reappraise the relevance of each procedure informed by round one results.
RESULTS
Agreement was achieved on the definitions of a set of usability evaluation-related terms and a total of 38 procedures related to usability evaluation planning and reporting were identified. Consensus on the relevance was achieved for 30 (79%) of the 38 procedures.
CONCLUSIONS
This work provides an important step towards a more standardized approach in the field of usability evaluation that may contribute to enhancing the quality of planning and reporting usability studies.