Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Bonferroni Test01:10

Bonferroni Test

2.7K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.7K
Multiple Comparison Tests01:13

Multiple Comparison Tests

3.8K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.8K
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

142
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
142
One-Way ANOVA: Unequal Sample Sizes01:15

One-Way ANOVA: Unequal Sample Sizes

5.7K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.7K
One-Way ANOVA: Equal Sample Sizes01:15

One-Way ANOVA: Equal Sample Sizes

3.2K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.2K
Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

134
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
134

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Small numbers of clusters in cluster randomised trials: a scoping review of problems and proposed solutions.

Journal of clinical epidemiology·2026
Same author

Implementation of a Mental Health Literacy e-Curriculum (MHLeC) in Malawi Universities: a feasibility cluster randomised trial protocol.

Pilot and feasibility studies·2026
Same author

The wood and the trees: estimands in cluster randomised trials.

Trials·2026
Same author

Improving outcomes in adult patients who self-harm-evaluating a brief psychological intervention in emergency departments (ASSURED): protocol of a randomised controlled clinical trial.

Trials·2026
Same author

Clinical efficacy of subsensory sacral neuromodulation in adults with faecal incontinence: The SUBSoNIC crossover randomised controlled trial and cohort follow-up study.

Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland·2025
Same author

Covariate adjustment in cluster randomised trials: a practical guide.

BMJ (Clinical research ed.)·2025
Same journal

Harms Reporting Was Frequently Incomplete or Discordant in Biomedical Randomized Trials Published in 2023: A Meta-epidemiological Study.

Journal of clinical epidemiology·2026
Same journal

Using an Open Science Checklist in Grant Proposal Reviews to Predict Reproducibility of Funded Publications.

Journal of clinical epidemiology·2026
Same journal

A comparison of five statistical methods used to analyse longitudinal EORTC QLQ-C30 quality of life scores in randomised controlled trials: a simulation study.

Journal of clinical epidemiology·2026
Same journal

Sample Size Determination for Decision-centered Pragmatic Trials.

Journal of clinical epidemiology·2026
Same journal

Many multicenter randomized controlled trials do not account for center effect: a methodological review.

Journal of clinical epidemiology·2026
Same journal

Patient Acceptability of the Modified Zelen Approach to Randomized Trials - A Survey of the CAPS THA Cohort.

Journal of clinical epidemiology·2026
See all related articles

Related Experiment Video

Updated: May 30, 2025

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
09:27

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

9.9K

To adjust, or not to adjust, for multiple comparisons.

Richard Hooper1

  • 1Wolfson Institute of Population Health, Queen Mary University of London, London, UK.

Journal of Clinical Epidemiology
|January 26, 2025
PubMed
Summary
This summary is machine-generated.

Interpreting multiple hypothesis tests requires careful consideration of adjustments. While some argue against corrections, regulatory demands, especially in pharmaceutical trials, often necessitate them for error rate control.

Keywords:
BonferroniFalse discovery rateFamily-wise error rateMultiple testingMultiplicitySequential testing

More Related Videos

Strategies for Assessing Autistic-Like Behaviors in Mice
07:38

Strategies for Assessing Autistic-Like Behaviors in Mice

Published on: September 20, 2024

820
The Attentional Set Shifting Task: A Measure of Cognitive Flexibility in Mice
09:15

The Attentional Set Shifting Task: A Measure of Cognitive Flexibility in Mice

Published on: February 4, 2015

27.2K

Related Experiment Videos

Last Updated: May 30, 2025

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
09:27

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

9.9K
Strategies for Assessing Autistic-Like Behaviors in Mice
07:38

Strategies for Assessing Autistic-Like Behaviors in Mice

Published on: September 20, 2024

820
The Attentional Set Shifting Task: A Measure of Cognitive Flexibility in Mice
09:15

The Attentional Set Shifting Task: A Measure of Cognitive Flexibility in Mice

Published on: February 4, 2015

27.2K

Area of Science:

  • Biostatistics
  • Epidemiology
  • Clinical Trials

Background:

  • Multiple hypothesis testing presents challenges in interpreting results.
  • Epidemiological literature often argues against multiplicity adjustments.
  • Regulatory requirements, particularly in pharmaceutical trials, can mandate adjustments.

Purpose of the Study:

  • To explore the complexities of adjusting interpretations for multiple hypothesis tests.
  • To review arguments for and against multiplicity adjustments.
  • To provide guidance on navigating these issues in scientific research.

Main Methods:

  • Review of existing literature on multiplicity in hypothesis testing.
  • Discussion of frequentist approaches to error rate control.
  • Analysis of contrasting viewpoints in epidemiological and regulatory contexts.

Main Results:

  • Significant debate exists regarding the necessity and methods of multiplicity adjustment.
  • Regulatory bodies often require adjustments, influencing trial interpretation.
  • The formal basis for adjustment is frequently linked to frequentist error rate control.

Conclusions:

  • There is no universal agreement on multiplicity adjustment.
  • Balancing statistical rigor with regulatory compliance is crucial.
  • Further reading is suggested for a comprehensive understanding.