Physicians as usability evaluators – first aid for poor EHR usability?

Abstract

According to earlier studies, Finnish physicians suffer from stress caused by poor usability of their digital tools and feel excluded from healthcare IT development. Active participation in usability evaluation could help involve doctors into developmental work, but more effective and participatory methods are needed. The objective of this study was to research whether physicians with no training in usability evaluation are able to discover usability problems using heuristic walkthrough technique. In addition, we wanted to find out if the level of EHR user experience affects the nature of the usability problems found. Heuristic walkthrough using a modified set of Nielsen’s heuristics and clinical tasks was performed to evaluate usability of a widely used Electronic Health Record (EHR) in Finland. Medical students and physicians with no previous experience in usability evaluation and 1) with or 2) without prior experience in using the EHR in question were recruited as evaluators. A control group of usability experts was used. Physicians were able to identify usability problems, ranging from cosmetic flaws to problems concerning patient safety and significant hindrance for work. Analysis of the found usability problems revealed that experienced EHR users discovered usability problems in nearly all major functions within the given scenario and time span. Physicians as evaluators in heuristic walkthrough has the potential to produce relevant data about EHR usability. The arrangement benefits participating physicians by introducing them to usability. Further research needs to find out, whether the suggested method could support better communication and collaboration between end-users and software developers.