Developing Standards for Rapid Evaluation and Appraisal Methods (STREAM): An e-Delphi Consensus Study

Timeliness is key to influencing the utility of evaluation and research findings and has given rise to a range of rapid evaluation and appraisal approaches. However, issues in the design, implementation and transparency in their reporting has led to concerns around their rigour and validity. To address this, we have developed the Standards for Rapid Evaluation and Appraisal Methods (STREAM).

We followed a four-stage consensus process, starting with a (1) steering group consultation; (2) three-stage e-Delphi study; (3) stakeholder consensus workshop; and (4) piloting exercise. The stakeholders invited to participate in the consensus process had experience in conducting, being part of, or commissioning rapid evaluations or appraisals.

Thirty-eight standards were developed with the purpose of guiding the design and implementation of rapid evaluations and appraisals and supporting the reporting of methods used.

Rapid evaluations and appraisals can be useful in time and resource limited contexts and in the response to new or changing services, but close attention needs to be paid to their rigour and other factors that might influence the production of knowledge and validity of the findings.