Related Experiment Video
Updated: Jul 28, 2025

Evaluating the Effectiveness of Cancer Drug Sensitization In Vitro and In Vivo
Published on: February 6, 2015
A Systematic Review and Pooled Analysis of Hypothesized versus Observed Effect Sizes in Early Phase Cancer Prevention
Jens Eickhoff1, Jen Zaborek1, Guanhua Chen1
1Department of Biostatistics and Medical Informatics, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin.
Abstract:
Early phase cancer prevention trials are designed to demonstrate safety, tolerability, feasibility, and signals of efficacy of preventive agents. Yet it is often observed that many trials fail to detect intervention effects. We conducted a systematic review and pooled analyses of recently completed early phase chemoprevention trials to gain in depth insight on the failure of detecting efficacy signals by comparing hypothesized effect sizes to the corresponding observed effect sizes.Single- or multi-arm efficacy chemoprevention trials conducted under the phase 0/I/II Cancer Prevention Clinical Trials Program of the Division of Cancer Prevention, NCI between 2003 and 2019 were evaluated. A total of 59 chemoprevention trials were reviewed. Twenty-four studies were efficacy or biomarker trials with complete information on hypothesized and observed effect sizes and included in this analysis. The majority of the trials (n = 18) were multi-arm randomized studies of which 15 trials were blinded. The pooled estimate of the observed to hypothesized effect size ratio was 0.57 (95% confidence interval: 0.42-0.73, P < 0.001) based on a random-effects model. There were no significant differences detected in the ratio of observed to hypothesized effect sizes when conducting various subgroup analyses.The results demonstrate that the majority of early phase cancer chemoprevention trials have substantially smaller observed effect sizes than hypothesized effect sizes. Sample size calculations for early phase chemoprevention trials need to balance the potential detectable effect sizes with realistic and cost-effective accrual of study populations, thereby, detecting only intervention effects large enough to justify subsequent large-scale confirmatory trials.
Prevention Relevance:
The results of this systematic review and pooled analyses demonstrate that for early chemoprevention trials, there are substantial differences between hypothesized and observed effect sizes, regardless of study characteristics. The conduct of early phase chemoprevention trial requires careful planning of study design, primary endpoint, and sample size determination.
Insights
Early phase cancer prevention trials often fail to detect intervention effects. Pooled analyses reveal observed effect sizes are significantly smaller than hypothesized, necessitating careful trial design and sample size planning.
Area of Science:
- Oncology
- Clinical Trials
- Preventive Medicine
Background:
- Early phase cancer prevention trials aim to assess safety, tolerability, feasibility, and efficacy signals of preventive agents.
- Many early phase chemoprevention trials do not detect hypothesized intervention effects, leading to potential failures in identifying promising agents.
- Understanding the discrepancy between hypothesized and observed effect sizes is crucial for optimizing trial design and resource allocation.
Approach:
- A systematic review and pooled analysis were conducted on early phase (Phase 0/I/II) chemoprevention trials.
- Fifty-nine trials were evaluated, with 24 selected for analysis based on complete data for hypothesized and observed effect sizes.
- Pooled analysis examined the ratio of observed to hypothesized effect sizes using a random-effects model.
Key Points:
- The pooled estimate showed observed effect sizes were 0.57 times the hypothesized effect sizes (95% CI: 0.42-0.73, P < 0.001).
- This significant reduction in observed effect sizes was consistent across various subgroup analyses.
- The findings highlight a consistent overestimation of efficacy in the initial planning of these trials.
Conclusions:
- Early phase cancer chemoprevention trials frequently yield smaller observed effect sizes than initially hypothesized.
- Accurate sample size calculations must balance detectable effect sizes with realistic population accrual for cost-effectiveness.
- Careful planning of study design, primary endpoints, and sample size is essential for successful early phase chemoprevention trials.
Related Concept Videos
Hazard Ratio
For example, in a clinical trial...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Cancer Survival Analysis
Clinical Trials
There are four phases in a clinical trial. A phase one...
Comparing the Survival Analysis of Two or More Groups
Clinical Trials: Overview

