Related Experiment Video
Updated: Apr 11, 2026

A Within-Subject Experimental Design using an Object Location Task in Rats
Published on: May 6, 2021
Controlling for Multiple Tests
1The Rothman Institute at Thomas Jefferson University, Philadelphia, PA.
Abstract:
In a statistical test, the P-value is the likelihood that the observed results are just due to chance, and by convention a P-value of <0.05 is considered significant. However, this means that if a study performs 20 individual statistical analyses, assuming the null hypothesis is true in all of them, we expect one to fall below the P<0.05 threshold and give us a false positive. Advanced statistical tests should be used to prevent this from occurring.
Related Concept Videos
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Identifying Statistically Significant Differences: The F-Test
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Comparing the Survival Analysis of Two or More Groups
One-Way ANOVA: Unequal Sample Sizes

