Related Experiment Video
Updated: May 10, 2026

Iterative Development of an Innovative Smartphone-Based Dietary Assessment Tool: Traqq
Published on: March 19, 2021
Assessing searches in NICE single technology appraisals: practice and checklist
Ruth Wong1, Suzy Paisley, Christopher Carroll
1School of Health and Related Research, University of Sheffield, United Kingdom. ruth.wong@sheffield.ac.uk
Evidence Review Groups (ERGs) lack guidelines for appraising manufacturer search methodologies in Single Technology Appraisals (STA). This study identifies common search limitations and recommends a checklist for ERGs to improve appraisal consistency.
Area of Science:
- Health Technology Assessment
- Systematic Review Methodology
- Pharmaceutical Policy
Background:
- Evidence Review Groups (ERGs) currently lack standardized guidelines for evaluating manufacturer search methodologies within Single Technology Appraisals (STA).
- This absence of a defined approach leads to varied appraisal practices among ERGs.
- Manufacturers' submissions (MS) are critical for STA, making robust search methodology appraisal essential.
Purpose of the Study:
- To investigate the limitations identified in manufacturers' search methodologies by ERGs in published STA reports.
- To provide a recommended checklist to standardize the appraisal of manufacturer search strategies.
Main Methods:
- A systematic review of 83 ERG reports published on the NIHR website (2006-2011) was conducted.
- Limitations cited in ERG critiques were extracted and thematically analyzed.
- Comparisons were drawn between limitations in clinical effectiveness and cost-effectiveness searches.
Main Results:
- Twelve limitation themes were identified, including search strategy, source, reporting, and missing studies.
- The 'search strategy' theme exhibited the most limitations.
- Omission of unpublished/ongoing trials was a frequent critique in clinical effectiveness searches, while poor reporting of strategies dominated cost-effectiveness searches.
Conclusions:
- A standardized checklist incorporating reporting, source, and search strategy elements is recommended.
- Implementing this checklist will enhance the consistency and rigor of manufacturer search appraisal in STA.
- This aims to improve the overall quality of evidence used in healthcare decision-making.
Related Concept Videos
SBAR II: Application of SBAR
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
Lazarus's Cognitive Appraisal Theory
Primary Appraisal:...
Quality Assurance
Protecting Self-Esteem
Self-Evaluation Maintenance Model
