Validity evidence for a team‐leading assessment tool in pediatric emergency resuscitations using video review

Author:

Hartwell Victoria12ORCID,Edmunds Katherine12ORCID,Elliott Laura1,Williams Brenda3,Menk Paul T.4,Geis Gary L.123

Affiliation:

1. Division of Emergency Medicine Cincinnati Children's Hospital Medical Center Cincinnati Ohio USA

2. Department of Pediatrics University of Cincinnati College of Medicine Cincinnati Ohio USA

3. Center for Simulation and Research Cincinnati Children's Hospital Medical Center Cincinnati Ohio USA

4. Cincinnati Children's Hospital Medical Center Cincinnati Ohio USA

Abstract

AbstractBackgroundEffective leadership of health care action teams has demonstrated positive influence on team performance and patient care, but there is no consensus on how to assess these skills. We developed a novel team leadership assessment tool for leaders of interprofessional pediatric resuscitation teams and collected validity evidence for this tool using video review.MethodsThis was a prospective cohort study from November 2021 to October 2022. A novel team leadership assessment tool was developed using literature review and local expertise and then piloted and refined using medical simulation. Pediatric emergency medicine (PEM) fellows from a single tertiary care pediatric medical center were enrolled, and videos of one medical resuscitation and one trauma resuscitation were collected per fellow each month. Three reviewers underwent reviewer training and then scored the videos using the assessment tool. Raters provided feedback on feasibility and ease of use using a 5‐point Likert scale. Inter‐rater reliability for the assessment tool using Gwet's agreement coefficient and the association between performance and clinical level of training using generalized linear mixed model were calculated.ResultsTwelve PEM fellows enrolled and 146 videos were reviewed. The inter‐rater reliability for each domain ranged from 0.45 (p < 0.0001) to 0.59 (p < 0.0001), with the inter‐rater reliability of the total score being 0.49 (p < 0.0001). The reviewers’ mean ratings of the elements of the tool were as follows: clarity of the domains (4.6/5), the independence of each domain from each other (3.9/5), the ease of use of the 5‐point Likert scale (4.5/5), the usefulness of the provided examples for each domain (4.6/5), and the ability to assess each domain without having to rewatch (4.5/5). The tool differentiated between levels of clinical training for two of the six domains (p < 0.02).ConclusionsWe developed a novel team leadership assessment tool for pediatric resuscitation team leaders that demonstrated moderate inter‐rater reliability. The tool was easy to use and feasible for educators to assess the performance of PEM trainees in complex high‐stakes clinical situations.

Publisher

Wiley

Reference24 articles.

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3