Heuristic Evaluation of Play4Fit Health and Fitness App: A Comparison Between Experts and Novices Evaluators

Abstract

Heuristic evaluation (HE) can be used to effectively identify usability issues in various interfaces. However, it has not been widely used in evaluating smartphone apps, especially in the health and fitness domain. One reason is the lack of HCI experts, which makes incorporating HE into the design process difficult. This paper presents the results of a study that compared HE performed by three HCI experts and three novices in evaluating a gamification app for health and fitness on a smartphone. The study used Smartphone Mobile Application heuRisTics (SMART), which focuses on smartphone apps, and a severity rating scale to determine the severity of the usability issues. These issues were mapped to the SMART heuristic. The findings indicate that novices may identify usability issues that the experts overlooked. While the experts identified eighteen usability issues, the novices found only four; however, the novice’s findings may be used as a substitute for HE when experts are unavailable. Both experts and novices identified two similar usability issues, but their severity ratings differed. One possible solution to address the lack of usability issues identified by novices in HE is to use more novices instead of experts in the evaluation process.