Related Experiment Video
Updated: Aug 16, 2026

A Two-interval Forced-choice Task for Multisensory Comparisons
Published on: November 9, 2018
A comparison of multiplicity adjustment strategies for correlated binary endpoints
1Weill Cornell Medical College, Department of Psychiatry, New York 10021, USA. acleon@med.cornell.edu
Abstract:
Several Bonferroni-type adjustments have been proposed to control for family wise type I error among multiple tests. However, many of the approaches disregard the correlation among endpoints. This can result in a conservative hypothesis testing strategy. The James procedure is an alternative approach that accounts for multiplicity among correlated continuous endpoints. Here a simulation study compares four Bonferroni-type alpha-adjustments (Bonferroni, Dunn-Sidák, Holm, and Hochberg) and the James p-value adjustment when used for multiple correlated binary variables. These procedures provided adequate protection against familywise type I error for correlated binary endpoints, albeit, at times, in an overly cautious manner. That is, when correlations among endpoints exceed 0.60, the result is somewhat conservative for the approaches that do not account for those correlations. Among the adjustments examined, the James approach appears to be the uniformly preferred method. Analyses of data from a randomized controlled clinical trial of treatments for mania in bipolar disorder are used to illustrate the application of the multiplicity adjustments.
Related Concept Videos
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Interpreting ¹H NMR Signal Splitting: The (n + 1) Rule
¹H NMR Signal Multiplicity: Splitting Patterns
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Friedman Two-way Analysis of Variance by Ranks
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...