Related Experiment Video
Updated: May 12, 2026

08:13
Flypub To Study Ethanol Induced Behavioral Disinhibition and Sensitization
Published on: May 18, 2020
Large sample tests for simultaneous comparison to multiple controls in terms of binomial proportions
Julia N Soulakova1, Linlin Luo
1Department of Statistics, University of Nebraska-Lincoln, Lincoln , NE, USA. jsoulakova2@unl.edu
Journal of Biopharmaceutical Statistics
|April 25, 2013
Summary
This study evaluates nine statistical tests for demonstrating a treatment
Area of Science:
- Biostatistics
- Clinical Trial Design
- Statistical Inference
Background:
- Comparing a single treatment to multiple control groups is common in clinical trials.
- Ensuring simultaneous superiority over all controls requires robust statistical methods.
- Existing methods may lack power or have inflated Type I error rates.
Purpose of the Study:
- To evaluate the performance of nine large-sample intersection-union tests for demonstrating simultaneous treatment superiority.
- To compare these tests regarding Type I error rates and statistical power.
- To assess methods for estimating minimum sample size requirements.
Main Methods:
- Application of nine intersection-union tests, including Min tests (Wald, pooled, Falk and Koch) and adjustments (Berger and Boos, Röhmel and Mansmann).
- A large-scale simulation study to assess Type I error rates and power.
- Investigation of approximate power calculations and alternative sample size estimation approaches.
Main Results:
- The simulation study compared the Type I error rate and power of the nine proposed tests.
- The study analyzed the accuracy of approximate power calculations.
- The proximity of alternative sample size estimation methods was investigated.
Conclusions:
- The study provides a comparative analysis of statistical tests for simultaneous superiority in multi-control trials.
- Findings inform the selection of appropriate tests and sample size calculations for clinical research.
- The research contributes to optimizing the design and analysis of studies comparing treatments to multiple controls.
Related Concept Videos
Multiple Comparison Tests
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Bonferroni Test
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Testing a Claim about Population Proportion
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
Sign Test for Matched Pairs
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in value between...
To conduct the sign test, we first calculate the differences in value between...
Test for Homogeneity
The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can be stated as...
One-Way ANOVA: Unequal Sample Sizes
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:

