Related Experiment Video
Updated: Jul 20, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
Published on: October 11, 2018
Multiple comparisons procedures for comparing several treatments with a control based on binary data
1Upjohn Company, Kalamazoo, MI 49001, USA.
Abstract:
In this paper, we examine three approaches for comparing several treatments with a control with use of binary response data. The first approach relies on asymptotic theory applied to the Freeman-Tukey transformation of the observed proportions. The second finds an acceptance region based on the binomial distributions estimated under the joint null hypotheses. The third approach applies Dunnett's procedure to the binary data. We evaluated the actual overall type I error rates of the Freeman-Tukey test and Dunnett's procedure using both simulation and binomial calculations while we assessed those of the binomial approach using simulation. Based upon their capability to preserve the desirable overall type I error rate, we provide recommendations regarding the choices among the three approaches for various occasions. In addition, we provide comments on the power of these three approaches.
Related Concept Videos
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Crossover Experiments
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs
Comparing the Survival Analysis of Two or More Groups
Cochran's Q Test

