Related Experiment Video
Updated: Oct 10, 2025

Rare Event Detection Using Error-corrected DNA and RNA Sequencing
Published on: August 3, 2018
The Role of Family-wise Error Rate in Determining Statistical Significance
Kristen J Nicholson1, Matthew Sherman1, Srikanth N Divi1,2
1Department of Orthopaedic Surgery, Rothman Institute, Thomas Jefferson University, Philadelphia, PA.
Abstract:
The threshold for statistical significance is determined by the maximum allowable probability of Type I error (α). For studies that test multiple hypotheses or make multiple comparisons, the probability of at least 1 Type I error (family-wise error rate; FWER) increases as the number of hypotheses/comparisons increase. It is generally best practice to set the acceptable threshold for FWER to be less than or equal to α. Bonferroni correction and Tukey honestly significant difference test are 2 of the more common methods to control for FWER. When doing exploratory analysis or evaluating secondary outcomes of a study, it may not be necessary or desirable to control for FWER, which reduces the power of the study. However, deciding to control for FWER should be decided during the design of the study.
Related Concept Videos
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
Significance Testing: Overview
Fisher's Exact Test
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Errors In Hypothesis Tests
Wald-Wolfowitz Runs Test II
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...

