The Devil’s in the Detail: Implementation Fidelity in Evaluating a School-Based Prevention Programme for Children Under 12
-
Published:2023-04-10
Issue:6
Volume:38
Page:1177-1189
-
ISSN:0885-7482
-
Container-title:Journal of Family Violence
-
language:en
-
Short-container-title:J Fam Viol
Author:
Kurdi ZainORCID, Millar Annemarie, Barter Christine Anne, Stanley Nicky
Abstract
Abstract
Purpose
This paper examines implementation fidelity (IF) and the underpinning conceptual framework drawing on the evaluation of a UK-wide, manualized child abuse and neglect prevention program for elementary schools. We describe and assess our approach to assessing IF and consider how IF can inform program development.
Method
We drew on the literature on program fidelity and critical components of the program evaluated to identify three dimensions of IF: Coverage, Quality and Context. Data was collected through external observations using systemized observation schedules which were extracted to be scored using scoring protocols for each intervention type. Scores were calculated by two researchers with a random sample cross-checked by a third member of the research team.
Results
Observation analysis demonstrated consistency in the coverage of content when delivering assemblies for both younger and older children with at least 76% coverage of content across the assemblies. However, observation analysis revealed greater levels of variability in the delivery of workshops. Material on sexual abuse was less fully covered and children reported that some facilitators lacked confidence and clarity in delivering this material (Stanley et al., 2023).
Conclusion
Our results indicate the usefulness of systemized observations in capturing coverage of content, these findings underscore the importance of developing scoring protocols and training observers prior to evaluating program delivery. We highlight the significance of integrating implementation fidelity training for program facilitators and implementers to both assist with monitoring and to maintain quality, despite variations in the actual delivery and setting of the program.
Funder
National Society for the Prevention of Cruelty to Children JMCMRJ Sorrell Foundation Health Foundation
Publisher
Springer Science and Business Media LLC
Subject
Law,Sociology and Political Science,Social Sciences (miscellaneous),Clinical Psychology
Reference31 articles.
1. Barter, C., Batool, F., Charles, J., Devaney, J., Farrelly, N., Hayes, D., Kurdi, Z., Millar, A., Monks, C., & Foster, H. R., Lorraine Radford, Rhiannon Tudor Edwards, Eira Winrow, and Nicky Stanley. 2022. ‘Conducting Large-Scale Mixed-Method Research on Harm and Abuse Prevention with Children under 12: Learning from a UK Feasibility Study’. Children & Society online(n/a). doi: https://doi.org/10.1111/chso.12658. 2. Bauer, M. S., Damschroder, L., Hagedorn, H., Smith, J., & Kilbourne, A. M. (2015). An introduction to implementation science for the Non-Specialist. BMC Psychology, 3(1), 32. https://doi.org/10.1186/s40359-015-0089-9. 3. Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the Pieces together: An Integrated model of program implementation. Prevention Science, 12(1), 23–33. https://doi.org/10.1007/s11121-010-0186-1. 4. Bertram, R. M., Karen, A., Blase, & Fixsen, D. L. (2015). Improving programs and outcomes: Implementation frameworks and Organization Change. Research on Social Work Practice, 25(4), 477–487. https://doi.org/10.1177/1049731514537687. 5. Bruhn, A. L., Shanna, E., Hirsch, & Lloyd, J. W. (2015). Treatment Integrity in school-wide programs: A review of the literature (1993–2012). The Journal of Primary Prevention, 36(5), 335–349. https://doi.org/10.1007/s10935-015-0400-9.
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|