Comparison of Researcher-Led versus Teacher-Led effectiveness and fidelity: A Hybrid Type 1 study of Kids SIPsmartER in Appalachia middle schools

Abstract

Abstract The implementation of school-based obesity-prevention programs is understudied. Kids SIPsmartER is a 6-month, school-based, behavioral intervention for Appalachian middle school students and includes a teacher implementation strategy. Kids SIPsmartER effectively reduced students’ sugar-sweetened beverages (SSB) when Researcher-Led. However, Teacher-Led effectiveness and fidelity are unknown. To explore the relative SSB effects when Kids SIPsmartER was Researcher-Led versus Teacher-Led and to examine teacher fidelity. This study of secondary outcomes used a quasi-experimental analytic approach of a Hybrid Type 1 effectiveness–implementation and cluster randomized controlled tria (RCT) of Kids SIPsmartER. Student SSB behaviors and teacher self-rated fidelity were assessed, respectively, with the validated Beverage Intake Questionnaire (BEVQ-15) and lesson-specific checklists. Analyses included descriptive statistics and modified two-part models with time-fixed effects and school-year cohort cluster controls. The analytic sample included students from six control schools (n = 220), six Researcher-Led intervention schools (n = 306), and five Teacher-Led intervention schools (n = 218), as well as eight teachers. Teacher-Led intervention students decreased SSB by −14.3 ounces/day (95% confidence interval = −15.4, −13.2; P < .001). Relative to control and to Researcher-Led intervention, the Teacher-Led treatment effect among students was −11.6 ounces SSB/day (P < .001, effect size = 0.75) and −4.3 (P = .004, effect size = 0.25), respectively. Teachers returned fidelity checklists for 90% of planned lessons. Fidelity averaged 94% (SD = 4.0%) among returned forms and 85% (SD = 18.9%) when missing forms were counted as zeros. Teachers can implement Kids SIPsmartER with high fidelity and produce statistically and clinically meaningful improvements in students’ SSB behaviors. Findings have implications for the sustained implementation of Kids SIPsmartER and other school-based obesity-prevention programs. Clinical Trial information: NCT03740113.