Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

One-Way ANOVA01:18

One-Way ANOVA

8.0K
One-way ANOVA analyzes more than three samples categorized by one factor. For example, it can compare the average mileage of sports bikes. Here, the data is categorized by one factor - the company. However, one-way ANOVA cannot be used to simultaneously compare the sample mean of three or more samples categorized by two factors. An example of two factors would be sports bikes from different companies driven in different terrains, such as a desert or snowy landscape. Here, two-way ANOVA is used...
8.0K
Proteomics01:33

Proteomics

7.5K
A proteome is the entire set of proteins that a cell type produces. We can study proteomes using the knowledge of genomes because genes code for mRNAs, and the mRNAs encode proteins. Although mRNA analysis is a step in the right direction, not all mRNAs are translated into proteins.
Proteomics is the study of proteomes' function. It involves the large-scale systematic study of the proteome to denote the protein complement expressed by a genome. Scientist Mark Wilkins coined the term...
7.5K
One-Way ANOVA: Equal Sample Sizes01:15

One-Way ANOVA: Equal Sample Sizes

3.3K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.3K
Statistical Methods to Analyze Parametric Data: ANOVA01:12

Statistical Methods to Analyze Parametric Data: ANOVA

444
Analysis of Variance, or ANOVA, is a powerful statistical technique used to analyze parametric data, primarily in research and experimental studies. It's designed to compare the means of two or more groups, assisting researchers in identifying any significant differences between these group means. There are two main types of ANOVA based on the complexity of the analysis: one-way and two-way.
One-way ANOVA is applied when a single independent variable or factor is scrutinized. It compares...
444
Bonferroni Test01:10

Bonferroni Test

2.8K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.8K
Two-Way ANOVA01:17

Two-Way ANOVA

2.7K
The two-way ANOVA is an extension of the one-way ANOVA. It is a statistical test performed on three or more samples categorized by two factors - a row factor and a column factor. Ronald Fischer mentioned it in 1925 in his book 'Statistical Methods for Researchers.'
The two-way ANOVA analysis initially begins by stating the null hypothesis that there is an interaction effect between the two factors of a dataset. This effect can be visualized using line segments formed by joining the...
2.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Performance Is Not All You Need! Comment on "Unsupervised Machine Learning for Differential Analysis in Proteomics".

Analytical chemistry·2026
Same author

Fudging the volcano-plot without dredging the data.

Nature communications·2024
Same author

Challenging Targets or Describing Mismatches? A Comment on Common Decoy Distribution by Madej et al.

Journal of proteome research·2022
Same author

An analysis of proteogenomics and how and when transcriptome-informed reduction of protein databases can enhance eukaryotic proteomics.

Genome biology·2022
Same author

Can Omics Biology Go Subjective because of Artificial Intelligence? A Comment on "Challenges and Opportunities for Bayesian Statistics in Proteomics" by Crook et al.

Journal of proteome research·2022
Same author

ProMetIS, deep phenotyping of mouse models by combined proteomics and metabolomics analysis.

Scientific data·2021

Related Experiment Video

Updated: Jul 25, 2025

A Streamlined Approach for Mass Spectrometry-Based Proteomics Using Selected Tissue Regions
09:00

A Streamlined Approach for Mass Spectrometry-Based Proteomics Using Selected Tissue Regions

Published on: April 18, 2025

736

Controlling for false discoveries subsequently to large scale one-way ANOVA testing in proteomics: Practical

Thomas Burger1

  • 1Univ. Grenoble Alpes, CNRS, CEA, INSERM, ProFI, EDyP, Grenoble, France.

Proteomics
|June 25, 2023
PubMed
Summary

This review examines how to correctly apply statistical tests when comparing many biological samples at once. It specifically looks at combining broad screening tests with detailed follow-up comparisons to ensure that researchers do not report false findings in large datasets.

Keywords:
biomarker discoverydata processingfalse discovery rate (FDR)one way analysis of variance (OW-ANOVA)post-hoc tests (PHTs)quantitative proteomicsstatistical significancemultiple testing correctionomics data analysisexperimental design

Frequently Asked Questions

More Related Videos

Robust Comparison of Protein Levels Across Tissues and Throughout Development Using Standardized Quantitative Western Blotting
08:13

Robust Comparison of Protein Levels Across Tissues and Throughout Development Using Standardized Quantitative Western Blotting

Published on: April 9, 2019

14.2K
An Optimized Quantitative Pull-Down Analysis of RNA-Binding Proteins Using Short Biotinylated RNA
07:55

An Optimized Quantitative Pull-Down Analysis of RNA-Binding Proteins Using Short Biotinylated RNA

Published on: February 17, 2023

3.8K

Related Experiment Videos

Last Updated: Jul 25, 2025

A Streamlined Approach for Mass Spectrometry-Based Proteomics Using Selected Tissue Regions
09:00

A Streamlined Approach for Mass Spectrometry-Based Proteomics Using Selected Tissue Regions

Published on: April 18, 2025

736
Robust Comparison of Protein Levels Across Tissues and Throughout Development Using Standardized Quantitative Western Blotting
08:13

Robust Comparison of Protein Levels Across Tissues and Throughout Development Using Standardized Quantitative Western Blotting

Published on: April 9, 2019

14.2K
An Optimized Quantitative Pull-Down Analysis of RNA-Binding Proteins Using Short Biotinylated RNA
07:55

An Optimized Quantitative Pull-Down Analysis of RNA-Binding Proteins Using Short Biotinylated RNA

Published on: February 17, 2023

3.8K

Area of Science:

  • Statistical bioinformatics and proteomics research
  • Computational biology focusing on false discovery rate control

Background:

Researchers often struggle to balance statistical power with accuracy when analyzing massive biological datasets. Standard methods frequently fail to account for the complex dependencies inherent in high-throughput screening. This gap motivated a closer look at how multiple testing corrections interact during data processing. Prior work has established that simple adjustments are insufficient for complex experimental designs. No prior work had resolved the confusion surrounding sequential testing strategies in large-scale proteomics. That uncertainty drove the need for a comprehensive evaluation of current statistical practices. Scientists require clear guidance to avoid reporting spurious associations in their results. This review addresses the urgent need for robust frameworks in modern omics research.

Purpose Of The Study:

The aim of this article is to survey various ways to orchestrate statistical procedures in proteomics data processing workflows. It addresses the challenge of testing for differential abundance across hundreds or thousands of features simultaneously. The authors seek to clarify how different statistical safeguards interact when multiple biological conditions are under investigation. This work explores the complexities of combining omnibus tests with subsequent follow-up comparisons. The researchers intend to provide a comprehensive overview of the pros and cons associated with these methods. This effort helps practitioners navigate the difficult landscape of multiple testing corrections in omics research. The study focuses on establishing practical considerations for maintaining validity in large-scale experiments. By synthesizing current knowledge, the authors provide a guide for improving the reliability of statistical outcomes.

Main Methods:

The authors conducted a systematic survey of existing statistical workflows used in high-throughput biological research. They evaluated how different combinations of omnibus tests and follow-up comparisons function within these pipelines. The team reviewed the mathematical foundations of various correction procedures to identify potential conflicts. Their approach involved comparing the advantages and limitations of different orchestration strategies for multiple testing. They examined how these methods handle large datasets containing thousands of individual features. The study synthesized evidence from diverse analytical practices to provide practical recommendations for researchers. This review focused on the practical implementation of statistical safeguards in complex experimental designs. The authors utilized a comparative framework to highlight the trade-offs inherent in different data processing choices.

Main Results:

The review identifies that the interaction between omnibus tests and follow-up procedures creates significant complexity for data analysis. It demonstrates that these two components represent distinct categories of multiple testing corrections. The authors report that failing to account for these differences can lead to unreliable findings in large-scale studies. They show that various orchestration strategies offer different balances between sensitivity and error control. The findings indicate that researchers often overlook the dependencies between these correction steps when designing their workflows. The analysis reveals that the choice of procedure directly influences the number of features identified as differentially abundant. The authors observe that no single method is universally superior for all types of omics data. Their work confirms that careful selection of statistical pipelines is vital for maintaining the integrity of proteomics results.

Conclusions:

The authors suggest that selecting an appropriate statistical pipeline depends heavily on the specific experimental goals. They emphasize that combining omnibus tests with follow-up procedures requires careful planning to maintain validity. The review highlights that no single approach serves all analytical needs across every dataset. Researchers should prioritize transparency when reporting their chosen correction methods to allow for proper interpretation. The team notes that the interaction between different correction types remains a significant hurdle for practitioners. They propose that future workflows must explicitly account for these dependencies to minimize errors. The synthesis indicates that standardizing these protocols could improve the reliability of proteomics findings. Finally, the authors advocate for deeper engagement with statistical theory when designing omics experiments.

The researchers propose that combining omnibus tests with post-hoc comparisons requires careful orchestration to manage multiple testing corrections. This approach prevents the inflation of errors when evaluating differential abundance across numerous biological conditions simultaneously.

The authors evaluate the one-way analysis of variance framework as a primary tool for identifying global differential abundance. This statistical model serves as the foundation for subsequent refinement through various follow-up tests in proteomics workflows.

A technical necessity arises because omnibus tests and follow-up procedures represent distinct types of multiple test corrections. These methods interact in complex ways, requiring specific strategies to ensure that the overall false discovery rate remains controlled.

The authors examine how different correction procedures influence the final output in large-scale datasets. They emphasize that the choice of correction method significantly alters the interpretation of differential abundance across thousands of features.

The researchers measure the effectiveness of various orchestration strategies by assessing their pros and cons. They focus on how these combinations impact the reliability of findings when testing hundreds or thousands of features.

The authors imply that practitioners must adopt more rigorous statistical standards to avoid reporting false discoveries. They suggest that current reliance on standard procedures may be insufficient without deeper consideration of the underlying mathematical dependencies.