Reliability and validity of the Persian version of the ACE tool: assessing medical trainees’ competency in evidence-based medicine

Abstract

Abstract Background Evidence-based medicine (EBM) allows users to integrate evidence into decision-making alongside clinical expertise and patient values. This study aimed to evaluate the reliability and validity of the Persian version of the Assessing Competency in EBM (ACE) tool across knowledge, skills, and attitude. Methods This cross-sectional study was performed on medical residents (first-year residents and junior residents) of Shiraz University of Medical Sciences in 2019. The study instrument was the ACE tool which consists of 15 two-choice questions (yes–no) and each of these questions measures one of four steps in evidence-based medicine (1- asking the answerable question, 2- searching the literature, 3- critical appraisal, and 4- applying the evidence to scenario). This tool was translated into Persian according to international standards. To ensure that the original and translated ACE questionnaire can be matched accurately and conceptuality, content validity index (CVI) and content validity ratio (CVR) were determined. Cronbach’s alpha was applied to determine the internal consistency for each scale and Confirmatory factor analysis (CFA) was used to survey the factor structure validity. Results One hundred sixty-three questionnaires were studied, selecting 59 first-year medical residents and 104 s-year medical residents. The results showed that using the Persian translation of the ACE tools, the content validity index (CVI) values were equal to or above 0.8 for all items. The content validity ratio (CVR) value was 0.90 for the total scale. The indicators of the confirmatory factor analysis (CFA) for the ACE tool revealed that this model had an acceptable fit. Cronbach’s alpha for the overall score was 0.79. Conclusion The Persian translated version of the ACE tool is a valid and reliable instrument for assessing medical trainees’ competency in EBM.