Developing Standards for Rapid Evaluation and Appraisal Methods (STREAM): an e-Delphi consensus study

Abstract

AbstractTimeliness is key to influencing the utility of evaluation and research findings and has given rise to a range of rapid evaluation and appraisal approaches. However, issues in the design, implementation and transparency in their reporting has led to concerns around their rigour and validity. To address this, we have developed the Standards for Rapid Evaluation and Appraisal Methods (STREAM). We followed a four-stage consensus process, starting with a (1) steering group consultation; (2) three-stage e-Delphi study; (3) stakeholder consensus workshop; and (4) piloting exercise. The stakeholders invited to participate in the consensus process had experience in conducting, being part of, or commissioning rapid evaluations or appraisals. As a result, 38 standards were developed with the purpose of guiding the design and implementation of rapid evaluations and appraisals and supporting the reporting of methods used. We suggest strengthening STREAM by testing it in alternative contexts to assess its generalisability.