Confidence and Utilization are Poorly Associated with Point-of-Care Ultrasound Competency among Internal Medicine Trainees

Abstract

ABSTRACT Introduction Point-of-Care Ultrasound (POCUS) is the utilization of bedside ultrasound by clinicians. Its portable and rapid diagnostic capabilities make it an excellent tool for deployment and mobile military settings. However, formal and uniform POCUS training is lacking. Furthermore, the evaluation of these curricula often relies on confidence assessment. Our objective was to assess the relationships between confidence, frequency of utilization, and image interpretation knowledge among our Internal Medicine residents before and after the implementation of a formal curriculum. Materials and Methods In November 2020, we implemented a longitudinal, flipped-classroom, academic half-day curriculum, conducting a prospective before-after cohort evaluation of its implementation. The POCUS curriculum was implemented as a longitudinal, asynchronous, flipped-classroom activity with workshop sessions during one academic half-day per month. We measured confidence via a Likert scale and utilization frequency via a five-point scale. Six multiple-choice questions (MCQ) with ultrasound videos assessed image interpretation competency. The image interpretation score was reported as percent correct. We related confidence and utilization to the image interpretation score. Results Ninety-nine residents were eligible for participation. Fifty-four (55%) completed a pre-curriculum assessment and 45 (45%) completed a post-curriculum assessment. Average image interpretation scores were 41% pre-curriculum and 51% post-curriculum (P =0.02). Pre-curriculum residents were on average unconfident (mean=2.56), and post-curriculum residents were on average confident (mean=3.62). Pre-curriculum residents used POCUS occasionally (mean=2.02, count 13 (24%) never utilizing). Post-curriculum residents used POCUS occasionally (mean=2.42, count 4 (9%) never utilizing). Pre- and post-curriculum confidence were not significantly associated with image interpretation scores (pre-curriculum: r=−0.10, P =0.50; post-curriculum: r=0.24, P =0.11). Pre- and post-curriculum utilization were not significantly associated with image interpretation scores (pre-curriculum: r=0.15, P =0.28; post-curriculum: r=0.02, P =0.90). The number of curriculum sessions attended was significantly associated with higher image interpretation scores (r=0.30, P =0.003). Conclusions Our study suggests that POCUS confidence and informal utilization do not correlate with image interpretation knowledge on MCQs among Internal Medicine residents. These findings support assessing direct measures of knowledge, rather than confidence, as an endpoint in evaluating POCUS curricula among Internal Medicine residents.