ENTRUST: A Serious Game-Based Virtual Patient Platform to Assess Entrustable Professional Activities in Graduate Medical Education-Reference-Cited by-同舟云学术

ENTRUST: A Serious Game-Based Virtual Patient Platform to Assess Entrustable Professional Activities in Graduate Medical Education

Published:2023-04-01 Issue:2 Volume:15 Page:228-236
ISSN:1949-8357
Container-title:Journal of Graduate Medical Education
language:en
Short-container-title:

Author:

Lin Dana T.¹^ORCID,Melcer Edward F.²^ORCID,Keehl Oleksandra³^ORCID,Eddington Hyrum⁴^ORCID,Trickey Amber W.⁵^ORCID,Tsai Jason⁶,Camacho Fatyma⁷,Merrell Sylvia Bereknyei⁸^ORCID,Korndorffer James⁹^ORCID,Liebert Cara A.¹⁰^ORCID

Affiliation:

1. Dana T. Lin, MD, FACS, is Clinical Associate Professor, Department of Surgery, Stanford University School of Medicine

2. Edward F. Melcer, PhD, is Assistant Professor and Director of the Alternative Learning Technologies and Games (ALT Games) Lab, Baskin School of Engineering, University of California, Santa Cruz

3. Oleksandra Keehl, MS, is a PhD Student, Baskin School of Engineering, University of California, Santa Cruz

4. Hyrum Eddington, BS, is Data Manager and Data Analyst, Stanford-Surgery Policy Improvement Research and Education Center

5. Amber W. Trickey, PhD, MS, CPH, is Senior Biostatistician, Stanford-Surgery Policy Improvement Research and Education Center

6. Jason Tsai, MS, is a Master's Student, Baskin School of Engineering, University of California, Santa Cruz

7. Fatyma Camacho, MS, is a Master's Student, Baskin School of Engineering, University of California, Santa Cruz

8. Sylvia Bereknyei Merrell, DrPH, MS, is a Research Scholar, Department of Pediatrics, Stanford University School of Medicine

9. James Korndorffer Jr, MD, MHPE, FACS, is Vice Chair of Education and Associate Professor of Surgery, Department of Surgery, Stanford University School of Medicine

10. Cara A. Liebert, MD, FACS, is Clinical Assistant Professor, Department of Surgery, Stanford University School of Medicine

Abstract

ABSTRACT Background As entrustable professional activities (EPAs) are implemented in graduate medical education, there is a great need for tools to efficiently and objectively evaluate clinical competence. Readiness for entrustment in surgery requires not only assessment of technical ability, but also the critical skill of clinical decision-making. Objective We report the development of ENTRUST, a serious game-based, virtual patient case creation and simulation platform to assess trainees' decision-making competence. A case scenario and corresponding scoring algorithm for the Inguinal Hernia EPA was iteratively developed and aligned with the description and essential functions outlined by the American Board of Surgery. In this study we report preliminary feasibility data and validity evidence. Methods In January 2021, the case scenario was deployed and piloted on ENTRUST with 19 participants of varying surgical expertise levels to demonstrate proof of concept and initial validity evidence. Total score, preoperative sub-score, and intraoperative sub-score were analyzed by training level and years of medical experience using Spearman rank correlations. Participants completed a Likert scale user acceptance survey (1=strongly agree to 7=strongly disagree). Results Median total score and intraoperative mode sub-score were higher with each progressive level of training (rho=0.79, P<.001 and rho=0.69, P=.001, respectively). There were significant correlations between performance and years of medical experience for total score (rho=0.82, P<.001) and intraoperative sub-scores (rho=0.70, P<.001). Participants reported high levels of platform engagement (mean 2.06) and ease of use (mean 1.88). Conclusions Our study demonstrates feasibility and early validity evidence for ENTRUST as an assessment platform for clinical decision-making.

Publisher

Journal of Graduate Medical Education

Subject

General Medicine,Education

Link

https://meridian.allenpress.com/jgme/article-pdf/15/2/228/3249286/i1949-8357-15-2-228.pdf

Reference34 articles.

1. ten Cate O, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med . 2007; 82(6): 542- 547. doi:https://doi.org/10.1097/ACM.0b013e31805559c7

2. ten Cate O, Chen HC, Hoff RG, Peters H, Bok H, van der Schaaf M. . Curriculum development for the workplace using entrustable professional activities (EPAs): AMEE Guide No. 99. Med Teach. 2015; 37(11): 983- 1002. doi:https://doi.org/10.3109/0142159X.2015.1060308

3. Hart D, Franzen D, Beeson M, et al. Integration of entrustable professional activities with the milestones for emergency medicine residents. West J Emerg Med. 2019; 20(1): 35- 42. doi:https://doi.org/10.5811/westjem.2018.11.38912

4. American Board of Pediatrics. Entrustable professional activities for general pediatrics. Accessed January 2, 2023. https://www.abp.org/content/entrustable-professional-activities-general-pediatrics

5. Deitte LA, Gordon LL, Zimmerman RD, et al. Entrustable professional activities: ten things radiologists do. Acad Radiol. 2016; 23(3): 374- 381. doi:1https://doi.org/0.1016/j.acra.2015.11.010

Cited by 2 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Usability of ENTRUST as an Assessment Tool for Entrustable Professional Activities (EPAs): A Mixed Methods Analysis;Journal of Surgical Education;2023-11

2. Correlation of Performance on ENTRUST and Traditional Oral Objective Structured Clinical Examination for High-Stakes Assessment in the College of Surgeons of East, Central, and Southern Africa;Journal of the American College of Surgeons;2023-06-15