Related Experiment Video
Updated: May 22, 2026

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Assessment and implication of prognostic imbalance in randomized controlled trials with a binary outcome--a
Rong Chu1, Stephen D Walter, Gordon Guyatt
1Department of Clinical Epidemiology and Biostatistics, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada. chur@mcmaster.ca
Randomized controlled trials can have chance imbalance in prognostic factors, especially with small sample sizes. Adjusting for strong prognostic factors improves treatment effect estimation and statistical power, making it crucial for accurate results.
Area of Science:
- Biostatistics
- Clinical Trial Design
- Epidemiology
Background:
- Chance imbalance in baseline prognostic factors (PF) can bias treatment effect estimates in randomized controlled trials (RCTs).
- This bias is more pronounced in trials with smaller sample sizes.
- Prognostic imbalance can lead to over or underestimation of treatment effects.
Purpose of the Study:
- To evaluate the probability of prognostic factor imbalance between treatment arms in RCTs.
- To investigate the impact of prognostic imbalance on treatment effect estimation.
- To examine the effect of sample size on prognostic imbalance and treatment effect estimation.
Main Methods:
- Simulated data from parallel-group trials with varying outcome risks, treatment effects, PF prevalence, and sample sizes (n).
- Compared logistic regression models with and without PF adjustment.
- Assessed bias, standard error, confidence interval coverage, and statistical power.
Main Results:
- A 5% imbalance in a common PF (0.5 prevalence) occurred in 42% of trials with 125 participants/arm.
- Ignoring a strong PF (RR=5) underestimated moderate treatment effects, independent of sample size (n>50/arm).
- Adjusting for strong PFs increased statistical power and reduced bias; adjustment for weak PFs had minimal impact.
Conclusions:
- Substantial prognostic imbalance is probable in small RCTs.
- Covariate adjustment for strong prognostic factors enhances estimation accuracy and statistical power.
- Performing covariate adjustment is recommended when strong PFs are identified.
Related Concept Videos
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Comparing the Survival Analysis of Two or More Groups
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Regression Toward the Mean
Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
Hazard Ratio
For example, in a clinical trial evaluating a...

