Project Extension for Community Healthcare Outcomes Intervention Evaluations: A Scoping Review of Research Methods

Abstract

Introduction: Since its inception in 2003, the Project Extension for Community Healthcare Outcomes (ECHO) tele-education model has reached and improved outcomes for patients, providers, and health centers through interventions in >180 countries. Utilization of this model has recently increased due to the COVID-19 pandemic and a higher demand for remote education. However, limited research has examined the methodologies used to evaluate Project ECHO interventions. Methods: We conducted a scoping review to determine the extent and types of research methods used to evaluate outcomes and implementation success of Project ECHO interventions and to identify gaps and opportunities for future investigation. Using Arksey and O'Malley's scoping review framework and the PRISMA-ScR checklist, we reviewed study designs, temporality, analysis methods, data sources, and levels and types of data in 121 articles evaluating Project ECHO interventions. Results: Most interventions addressed substance use disorders (24.8%, n = 30), infectious diseases (24%, n = 29), psychiatric and behavioral health conditions (21.5%, n = 26), and chronic diseases (19%, n = 23). The most frequently reported evaluation methods included cohort studies (86.8%, n = 105), longitudinal designs (74.4%, n = 90), mixed methods analysis (52.1%, n = 63), surveys (61.2%, n = 74), process evaluation measures (98.3%, n = 119), and provider-level outcome measures (84.3%, n = 102). Few evaluations used experimental designs (1.7%, n = 2), randomization (5.8%, n = 7), or comparison groups (14%, n = 17), indicating limited rigor. Discussion: This scoping review demonstrates the need for more rigorous evaluation methods to test the effectiveness of the Project ECHO model at improving outcomes and standardized reporting guidelines to enhance the dissemination of evaluation data from future Project ECHO interventions.