Efficacy vs effectiveness trial results of an indicated "model" substance abuse program: implications for public
Denise Hallfors1, Hyunsan Cho, Victoria Sanchez
1Pacific Institute for Research and Evaluation, Chapel Hill, NC, USA. hallfors@pire.org
Objectives:
The US Department of Education requires schools to choose substance abuse and violence prevention programs that meet standards of effectiveness. The Substance Abuse and Mental Health Services Agency certifies "model" programs that meet this standard. We compared findings from a large, multisite effectiveness trial of 1 model program to its efficacy trial findings, upon which the certification was based.
Methods:
1370 high-risk youths were randomized to experimental or control groups across 9 high schools in 2 large urban school districts. We used intent-to-treat and on-treatment approaches to examine baseline equivalence, attrition, and group differences in outcomes at the end of the program and at a 6-month follow-up.
Results:
Positive efficacy trial findings were not replicated in the effectiveness trial. All main effects were either null or worse for the experimental than for the control group.
Conclusions:
These findings suggest that small efficacy trials conducted by developers provide insufficient evidence of effectiveness. Federal agencies and public health scientists must work together to raise the standards of evidence and ensure that data from new trials are incorporated into ongoing assessments of program effects.
Related Concept Videos
Dose-Response Relationship: Potency and Efficacy
Impact of Pharmacokinetic–Pharmacodynamic Models: Regulatory Decisions
Drug Abuse and Addiction: Pharmacological Phenomena
Pharmacodynamic Models: Additive and Proportional Drug Effect Model
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Drug Control Governance: Regulatory Bodies and Their Impact

