Evidence-based public health: moving beyond randomized trials

Area of Science:

• Public Health Research
• Clinical Epidemiology

Background:

• Randomized controlled trials (RCTs) are the gold standard for clinical intervention evaluation due to short, simple causal chains.
• Public health interventions often involve complex causal pathways, leading to effect modification in diverse populations.
• The internal and external validity of RCT findings may be limited in public health contexts.

Purpose of the Study:

• To highlight the limitations of RCTs in public health intervention evaluation.
• To emphasize the value of observational studies with adequacy or plausibility designs.
• To advocate for the development of new evaluation standards for public health.

Main Methods:

• Discussion of the applicability of RCTs versus observational designs.
• Analysis of validity enhancement through plausibility and adequacy designs.
• Consideration of feasibility for large-scale public health interventions.

Main Results:

• RCTs are best suited for interventions with direct, simple causal links.
• Observational studies, particularly those with plausibility designs, can bolster the validity of RCT findings.
• Plausibility designs offer a feasible and valid approach for evaluating large-scale public health initiatives.

Conclusions:

• RCTs are not always appropriate or feasible for evaluating complex public health interventions.
• Observational studies with specific designs can provide crucial evidence of impact.
• There is a pressing need for robust evaluation standards tailored to public health research.