Adjusting O'Brien's test to control type I error for the generalized nonparametric Behrens-Fisher problem
Related Experiment Video
Updated: Aug 17, 2026

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
Published on: September 8, 2021
Peng Huang1, Barbara C Tilley, Robert F Woolson
1Department of Biostatistics, Bioinformatics and Epidemiology, Medical University of South Carolina, Charleston, South Carolina 29425, USA. huangp@musc.edu
Abstract:
O'Brien (1984, Biometrics 40, 1079-1087) introduced a simple nonparametric test procedure for testing whether multiple outcomes in one treatment group have consistently larger values than outcomes in the other treatment group. We first explore the theoretical properties of O'Brien's test. We then extend it to the general nonparametric Behrens-Fisher hypothesis problem when no assumption is made regarding the shape of the distributions. We provide conditions when O'Brien's test controls its error probability asymptotically and when it fails. We also provide adjusted tests when the conditions do not hold. Throughout this article, we do not assume that all outcomes are continuous. Simulations are performed to compare the adjusted tests to O'Brien's test. The difference is also illustrated using data from a Parkinson's disease clinical trial.
Related Concept Videos
Behrens–Fisher Test
This test is...
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Errors In Hypothesis Tests
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
Fisher's Exact Test

