Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Multiple Comparison Tests01:13

Multiple Comparison Tests

4.6K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
4.6K
Bonferroni Test01:10

Bonferroni Test

3.5K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
3.5K
Comparing Experimental Results: Student's t-Test01:09

Comparing Experimental Results: Student's t-Test

6.3K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
6.3K
Identifying Statistically Significant Differences: The F-Test01:14

Identifying Statistically Significant Differences: The F-Test

4.1K
The F-test is used to compare two sample variances to each other or compare the sample variance to the population variance. It is used to decide whether an indeterminate error can explain the difference in their values. The underlying assumptions that allow the use of the F-test include the data set or sets are normally distributed, and the data sets are independent of each other. The test statistic F is calculated by dividing one variance by another. In other words, the square of one standard...
4.1K
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

550
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
550
One-Way ANOVA01:18

One-Way ANOVA

14.4K
One-way ANOVA analyzes more than three samples categorized by one factor. For example, it can compare the average mileage of sports bikes. Here, the data is categorized by one factor - the company. However, one-way ANOVA cannot be used to simultaneously compare the sample mean of three or more samples categorized by two factors. An example of two factors would be sports bikes from different companies driven in different terrains, such as a desert or snowy landscape. Here, two-way ANOVA is used...
14.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Adaptive Health Technology Assessment - value and limitations to inform resource allocation in India.

Health economics, policy, and law·2026
Same authorSame journal

Qualitative research - Part 1.

Perspectives in clinical research·2026
Same author

Patient and public involvement in cancer care and research: the Indian perspective.

Ecancermedicalscience·2026
Same author

Advancements and perspectives of neoadjuvant immunotherapy in resectable non-small cell lung cancer.

Current problems in cancer·2026
Same author

Addressing low-value care (LVC) in Asia: a narrative review of Choosing Wisely and other initiatives across Asia.

BMJ open quality·2026
Same author

Robotic Ivor Lewis oesophagectomy with intrathoracic hybrid anastomosis.

Multimedia manual of cardiothoracic surgery : MMCTS·2026

Related Experiment Video

Updated: Mar 21, 2026

A Standardized Protocol for Preference Testing to Assess Fish Welfare
07:29

A Standardized Protocol for Preference Testing to Assess Fish Welfare

Published on: February 22, 2020

7.5K

Common pitfalls in statistical analysis: The perils of multiple testing.

Priya Ranganathan1, C S Pramesh2, Marc Buyse3

  • 1Department of Anaesthesiology, Tata Memorial Centre, Mumbai, Maharashtra, India.

Perspectives in Clinical Research
|May 4, 2016
PubMed
Summary

Multiple testing inflates false-positive rates when analyzing data across multiple time-points, subgroups, or endpoints. This article reviews the risks and mitigation strategies for multiple statistical testing.

Keywords:
Biostatisticsdata interpretationmultiplicitystatistical significance

More Related Videos

Using a Comparative Species Approach to Investigate the Neurobiology of Paternal Responses
07:59

Using a Comparative Species Approach to Investigate the Neurobiology of Paternal Responses

Published on: September 19, 2011

13.2K
Flypub To Study Ethanol Induced Behavioral Disinhibition and Sensitization
08:13

Flypub To Study Ethanol Induced Behavioral Disinhibition and Sensitization

Published on: May 18, 2020

7.1K

Related Experiment Videos

Last Updated: Mar 21, 2026

A Standardized Protocol for Preference Testing to Assess Fish Welfare
07:29

A Standardized Protocol for Preference Testing to Assess Fish Welfare

Published on: February 22, 2020

7.5K
Using a Comparative Species Approach to Investigate the Neurobiology of Paternal Responses
07:59

Using a Comparative Species Approach to Investigate the Neurobiology of Paternal Responses

Published on: September 19, 2011

13.2K
Flypub To Study Ethanol Induced Behavioral Disinhibition and Sensitization
08:13

Flypub To Study Ethanol Induced Behavioral Disinhibition and Sensitization

Published on: May 18, 2020

7.1K

Area of Science:

  • Statistics
  • Biostatistics
  • Data Analysis

Background:

  • Multiple testing occurs when datasets undergo repeated statistical analysis.
  • This can involve multiple time-points, subgroups, or endpoints within a single study.
  • A key concern is the increased likelihood of false-positive findings.

Purpose of the Study:

  • To elucidate the consequences of multiple testing in statistical analysis.
  • To explore and present various methodologies for addressing multiple testing issues.

Main Methods:

  • Review of statistical principles related to hypothesis testing.
  • Discussion of common scenarios leading to multiple testing.
  • Exploration of established and emerging methods for multiple testing correction.

Main Results:

  • Multiple testing significantly amplifies the probability of Type I errors (false positives).
  • Various statistical methods exist to control the overall error rate.
  • The choice of method depends on the specific research context and goals.

Conclusions:

  • Understanding and managing multiple testing is crucial for valid scientific interpretation.
  • Appropriate statistical methods are essential to mitigate false-positive findings.
  • Researchers must carefully consider multiple testing implications in study design and analysis.