Updating a systematic review--what difference did it make? Case study of nicotine replacement therapy

Area of Science:

• Evidence-based medicine
• Systematic reviews and meta-analysis
• Smoking cessation interventions

Background:

• Systematic reviews require regular updates to incorporate new evidence.
• Nicotine replacement therapy (NRT) is a key intervention for smoking cessation.
• The impact of updating a review on its conclusions and scope is not always clear.

Purpose of the Study:

• To assess the effect of updating a systematic review of nicotine replacement therapy (NRT).
• To evaluate changes in meta-analytic findings and review content over time.
• To examine the impact of new trial data on the evidence base for NRT.

Main Methods:

• Compared meta-analyses from 1994 and 2000 for nicotine gum and patch.
• Assessed changes in the number of trials and pooled effect estimates (odds ratio).
• Qualitatively evaluated shifts in review questions and subgroup analyses.

Main Results:

• Nicotine patch trials increased significantly, leading to a more precise effect estimate.
• The pooled effect estimate for the nicotine patch decreased slightly but remained significant.
• Updated reviews addressed new research questions not present in the original version.

Conclusions:

• Updating meta-analyses yields more precise estimates but may not change the overall clinical message for NRT.
• Further placebo-controlled NRT trials may offer diminishing returns to the evidence base.
• There is an inherent tension between pre-defining review questions and adapting to emerging research.