Conducting a systematic review in six weeks – experiences with and evaluation of an intensive team pilot project

Author:

Ames Heather Melanie R1,Kornør Hege1,Evensen Line Holtet1,Lidal Ingeborg Beate1,Hafstad Elisabet1,Hestevik Christine Hillestad1,Jardim Patricia Sofia Jacobsen1,Hval Gyri1

Affiliation:

1. Norwegian Institute of Public Health

Abstract

Abstract Background Evidence synthesis organisations worldwide are trying to meet commissioners’ need for rapid responses to their evidence synthesis commissions. In this project we piloted an intensive process, working to complete an evidence synthesis within six-weeks, rather than the standard lead time of 4-6 months. There were three objectives: 1) To develop a plan for and conduct an evidence synthesis in six weeks or less (“intensive pilot”) 2) To register time used for the intensive pilot 3) To evaluate the intensive pilot process and identify barriers, facilitators, learning points, areas for improvement or future implementation ideas. Methods The two project teams divided the pilot into three phases: Pre-planning, planning and intensive. During the pre-planning phase commissions were identified and researchers were recruited. During the planning phase the team interacted with the commissioner, completed the evidence synthesis protocol, and planned how they were going to work together during the intensive phase. During the intensive phase the team implemented their plan and completed the evidence synthesis they were assigned. We held reflective meetings and kept evaluator notes throughout the process. Results The team was able to achieve the project objectives. They developed and implemented a plan for conducting an evidence synthesis in six weeks. They registered their times use. During the pilot process the team reflected on and evaluated the process itself to identify barriers, facilitators, learning points, areas for improvement or future implementation ideas. The involved researchers preferred working in this intensive way. They felt that time use was more effective, and they were more focused. However, there are implications for project leadership and implementation that should be considered before implementing an intensive approach in future evidence synthesis projects. Conclusions The involved researchers preferred working intensively with one evidence synthesis over being involved with many projects at the same time. They felt that time use was more effective, and they were able to complete the tasks in a focused way. However, there are several implications for project management, leadership and further implementation that should be considered before implementing an intensive approach in future evidence syntheses.

Publisher

Research Square Platform LLC

Reference23 articles.

1. Beyond Toyota: How to root out waste and pursue perfection;Womack JP;Harvard Business Rev,1996

2. Automating risk of bias assessment in systematic reviews: a real-time mixed methods comparison of human researchers to a machine learning system;Jardim PSJ;BMC Med Res Methodol,2022

3. Muller AE, Ames HMR, Himmels JPW, Jardim PSJ, Nguyen HL, Rose CJ et al. Implementation of machine learning in evidence syntheses in the Cluster for Reviews and Health Technology Assessments: Final report 2020–2021. 2021.

4. Machine learning in systematic reviews: Comparing automated text clustering with Lingo3G and human researcher categorization in a rapid review;Muller AE;Res Synthesis Methods,2022

5. The effect of machine learning tools for evidence synthesis on resource use and time-to-completion: protocol for a retrospective pilot study;Muller AE;Syst Reviews,2023

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3