Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Multiple Comparison Tests01:13

Multiple Comparison Tests

3.9K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.9K
Bonferroni Test01:10

Bonferroni Test

2.7K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.7K
Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

188
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
188
One-Way ANOVA: Equal Sample Sizes01:15

One-Way ANOVA: Equal Sample Sizes

3.3K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.3K
One-Way ANOVA01:18

One-Way ANOVA

7.9K
One-way ANOVA analyzes more than three samples categorized by one factor. For example, it can compare the average mileage of sports bikes. Here, the data is categorized by one factor - the company. However, one-way ANOVA cannot be used to simultaneously compare the sample mean of three or more samples categorized by two factors. An example of two factors would be sports bikes from different companies driven in different terrains, such as a desert or snowy landscape. Here, two-way ANOVA is used...
7.9K
Comparing Experimental Results: Student's t-Test01:09

Comparing Experimental Results: Student's t-Test

1.6K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
1.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Household mobility responses to weather extremes in Kyrgyzstan.

Nature communications·2026
Same author

Design and Development of Firearm Information and Responsible Storage Techniques for U.S. Veterans (Veterans FIRST).

Military medicine·2026
Same author

Robust Wada boundaries and entropy scaling in pp-wave spacetimes.

Chaos (Woodbury, N.Y.)·2026
Same author

How Platform Trials Work.

NEJM evidence·2026
Same author

Spatial Learning in Naturalistic Search With Simulated Vision Loss.

Translational vision science & technology·2026
Same author

Mapping internal and lateral anterior intercostal artery perforator flaps with colour Doppler ultrasound: correlation between preoperative imaging and intraoperative findings in oncoplastic breast surgery.

Archives of gynecology and obstetrics·2026
Same journal

Public Health Response to Clade Ib Mpox with Multiple Exposures in Congregate Living Settings - New Hampshire, February 2025.

NEJM evidence·2026
Same journal

Berberine-Ursodeoxycholate - Bringing Traditional Chinese Medicine to Our World.

NEJM evidence·2026
Same journal

Outbreak of Legionnaires' Disease Associated with Cooling Tower Systems in Central Harlem.

NEJM evidence·2026
Same journal

Immunotherapy for Fertility in Autoimmune Premature Ovarian Insufficiency.

NEJM evidence·2026
Same journal

A Randomized Trial of Interval Likelihood Ratios for Clinical Decision-Making.

NEJM evidence·2026
Same journal

Evidence for Evidence-Based Medicine - A Call for Some Theory and a New Problem.

NEJM evidence·2026
See all related articles

Related Experiment Video

Updated: Jul 4, 2025

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

2.5K

The Problem of Multiple Comparisons.

Katherine S Takvorian1, Charles C Hardin1, Daniel Muller

  • 1Massachusetts General Hospital, 55 Fruit St, Boston, Massachusetts 02114.

NEJM Evidence
|February 6, 2024
PubMed
Summary
This summary is machine-generated.

Performing multiple statistical tests increases the chance of finding false associations. This video explains the problem of multiple comparisons in research to avoid spurious results.

More Related Videos

A Two-interval Forced-choice Task for Multisensory Comparisons
07:13

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

10.9K
The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
14:14

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups

Published on: May 13, 2022

5.9K

Related Experiment Videos

Last Updated: Jul 4, 2025

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

2.5K
A Two-interval Forced-choice Task for Multisensory Comparisons
07:13

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

10.9K
The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
14:14

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups

Published on: May 13, 2022

5.9K

Area of Science:

  • Statistics
  • Research Methodology

Background:

  • Multiple statistical hypothesis tests are common in research.
  • This practice can lead to the discovery of spurious associations by chance.

Discussion:

  • The core issue is inflated Type I error rates when multiple tests are conducted.
  • Understanding this problem is crucial for accurate data interpretation.

Key Insights:

  • Performing numerous statistical tests increases the likelihood of false positives.
  • Chance findings can be mistaken for genuine effects.

Outlook:

  • Emphasizes the need for careful consideration of statistical methods.
  • Promotes robust research practices to ensure result validity.