Related Experiment Video
Updated: Jul 13, 2026

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Active-control trials with binary data: a comparison of methods for testing superiority or non-inferiority using the
Arminda Lucia Siqueira1, Anne Whitehead, Susan Todd
1Departamento de Estatística, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil.
This study compares three statistical tests for active-control trials with binary outcomes. The score test generally offers the highest power for superiority or non-inferiority testing, with minimal practical differences between methods.
Area of Science:
- Biostatistics
- Clinical Trials
- Statistical Inference
Background:
- Active-control trials are crucial for comparing new treatments against existing ones.
- Assessing treatment effects with binary data using odds ratios is common in clinical research.
- Establishing superiority or non-inferiority requires robust statistical testing methods.
Purpose of the Study:
- To evaluate and compare three asymptotic statistical tests for superiority or non-inferiority in active-control trials.
- To examine the performance of likelihood ratio, Wald, and score tests for binary data analyzed via odds ratios.
- To assess Type I error rates and statistical power across different non-inferiority margins.
Main Methods:
- The study presents three asymptotic tests: likelihood ratio, Wald, and score tests.
- These tests are based on the unconditional binary likelihood for the log-odds ratio.
- Simulations were conducted to compare the tests' performance regarding Type I error and power.
Main Results:
- All three tests demonstrated Type I error rates close to the nominal level in simulations.
- The score test showed slightly elevated Type I error rates with large non-inferiority margins.
- The score test generally yielded the highest statistical power, though differences among tests were not practically significant.
Conclusions:
- Likelihood ratio, Wald, and score tests are viable and implementable methods for active-control trials with binary data.
- The score test is recommended for its generally higher power, while maintaining acceptable Type I error rates.
- These methods and their confidence intervals are readily available in standard statistical software.
Related Concept Videos
Odds Ratio
Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
Friedman Two-way Analysis of Variance by Ranks
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Hazard Ratio
For example, in a clinical trial evaluating a...
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs

