Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Cause and Effect01:53

Cause and Effect

While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a confounding variable, is actually causing the systematic movement in our variables of interest. For instance, as sales in ice cream increase, so does the overall rate of crime. Is it possible that indulging in your favorite flavor of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone?
Reason and Intuition01:37

Reason and Intuition

The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the brain can only use...
Hindsight Biases01:12

Hindsight Biases

Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
Behavioral Genetics and Its Designs01:23

Behavioral Genetics and Its Designs

Behavior genetics explores how genetic inheritance influences human behavior. It focuses on how genes, passed from parents to offspring, contribute to the development of behavioral traits and tendencies. This branch of genetics seeks to understand the complex interplay between inherited genetic factors and environmental influences in shaping our behaviors.
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...
Theory of Attribution I: Correspondent Inference Theory01:15

Theory of Attribution I: Correspondent Inference Theory

Correspondent inference theory, proposed by Jones and Davis in 1965, seeks to explain how individuals infer stable personality traits from observed behaviors. It suggests that people attribute actions to underlying dispositions rather than external circumstances, particularly when the behavior appears intentional and socially significant.Voluntary Behavior and Dispositional AttributionAccording to this theory, individuals are more likely to attribute behavior to personal traits when it appears...
Parallel Processing01:20

Parallel Processing

The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Quantifying motor-cognitive reserve using a novel multi-modal stress test.

Brain communications·2025
Same author

Correction for multiple comparisons should be ubiquitous.

Nature human behaviour·2025
Same author

Assessment of ability realization using the 4th version of the Spinal Cord Independence Measure.

The journal of spinal cord medicine·2024
Same author

Discussion on "Optimal test procedures for multiple hypotheses controlling the familywise expected loss" by Willi Maurer, Frank Bretz, and Xiaolei Xun.

Biometrics·2023
Same author

Developing a length of stay prediction model for newborns, achieving better accuracy with greater usability.

International journal of medical informatics·2023
Same author

A multi-lab experimental assessment reveals that replicability can be improved by using empirical estimates of genotype-by-lab interaction.

PLoS biology·2023
Same journal

When to Adjust for Multiple Testing: A Unifying Guiding Principle.

Biometrical journal. Biometrische Zeitschrift·2026
Same journal

Ensuring Quality in Preclinical Research: The Importance of Being Human.

Biometrical journal. Biometrische Zeitschrift·2026
Same journal

Addressing Cluster-Level Treatment Effect Heterogeneity in Sample Size Determination for Hierarchical 2 × 2 Factorial Designs.

Biometrical journal. Biometrische Zeitschrift·2026
Same journal

A Multiple Imputation Approach to Distinguish Curative From Life-Prolonging Effects in the Presence of Missing Covariates.

Biometrical journal. Biometrische Zeitschrift·2026
Same journal

Tests for Categorical Data Beyond Pearson: A Distance Covariance and Energy Distance Approach.

Biometrical journal. Biometrische Zeitschrift·2026
Same journal

Nonparametric Estimation of the Patient-Weighted While-Alive Estimand.

Biometrical journal. Biometrische Zeitschrift·2026
See all related articles

Related Experiment Video

Updated: Jun 6, 2026

Using Informational Connectivity to Measure the Synchronous Emergence of fMRI Multi-voxel Information Across Time
07:12

Using Informational Connectivity to Measure the Synchronous Emergence of fMRI Multi-voxel Information Across Time

Published on: July 1, 2014

Simultaneous and selective inference: Current successes and future challenges.

Yoav Benjamini1

  • 1Department of Statistics and Operations Research, Tel Aviv University, Israel. ybenja@tau.ac.il

Biometrical Journal. Biometrische Zeitschrift
|December 15, 2010
PubMed
Summary
This summary is machine-generated.

This article reviews the current state of statistical methods for handling multiple testing problems. It highlights how the field has grown but also notes that the variety of available techniques can confuse researchers. The author suggests that statisticians must better align their theoretical goals with the practical needs of users. By focusing on real-world applications like clinical trial safety and brain imaging, the field can remain relevant and effective. The work emphasizes choosing the right statistical approach based on specific research objectives, such as whether the goal is decision-making or scientific reporting.

Keywords:
error rate controlstatistical powerclinical trial safetydata analysis frameworks

Frequently Asked Questions

More Related Videos

A Two-interval Forced-choice Task for Multisensory Comparisons
07:13

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

Related Experiment Videos

Last Updated: Jun 6, 2026

Using Informational Connectivity to Measure the Synchronous Emergence of fMRI Multi-voxel Information Across Time
07:12

Using Informational Connectivity to Measure the Synchronous Emergence of fMRI Multi-voxel Information Across Time

Published on: July 1, 2014

A Two-interval Forced-choice Task for Multisensory Comparisons
07:13

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

Area of Science:

  • Statistical methodology and Multiple Comparisons research
  • Data science and computational statistics applications

Background:

The past ten years represent a significant period of growth for statistical approaches addressing multiple testing. Prior research has shown that this expansion provided many new ways to manage error rates and statistical power. That uncertainty drove a need for clarity, as the sheer volume of available techniques now creates confusion for practitioners. No prior work had resolved how to best navigate this complex landscape of competing methodologies. It was already known that failing to align theoretical frameworks with user requirements poses a substantial risk to scientific integrity. This gap motivated a critical examination of how statisticians select their analytical tools. The current environment demands a more structured approach to matching statistical objectives with practical research outcomes. Addressing these challenges remains a primary concern for the future of the field.

Purpose Of The Study:

The aim of this article is to address the challenges inherent in modern statistical inference and multiple comparisons research. The author seeks to clarify how the field can better serve the needs of researchers. This work investigates the confusion caused by the rapid proliferation of new statistical concepts and methods. The study intends to provide a framework for aligning theoretical goals with practical user requirements. By examining the distinction between testing and estimation, the author clarifies common analytical objectives. The research also explores the differences between scientific reporting and decision-making processes. The author motivates this inquiry by highlighting the potential risks posed by the current methodological complexity. Finally, the work aims to identify new application areas that require focused statistical attention to ensure future relevance.

Main Methods:

The review approach involves a critical evaluation of existing statistical frameworks developed over the last decade. The author examines the proliferation of concepts related to error control and power calculations. This analysis identifies the disconnect between theoretical goals and the practical requirements of end-users. The study design centers on synthesizing current challenges within the broader context of data analysis. The author evaluates specific application domains to illustrate the necessity of aligning methods with research objectives. This process includes a focused discussion on safety evaluations within clinical trial environments. The approach also incorporates an assessment of functional magnetic resonance imaging as a case study for emerging analytical needs. The review concludes by proposing a strategy to improve the selection of appropriate statistical tools.

Main Results:

Key findings from the literature indicate that the field has experienced a second golden era of development. The author reports that this growth has produced an overwhelming variety of concepts for managing error rates. The analysis reveals that this expansion currently confuses practitioners and creates a significant threat to effective research. The study identifies that matching theoretical goals to user needs is the primary solution to this problem. The author presents an aggregated safety assessment methodology as a specific advancement for clinical trial analysis. The findings suggest that functional magnetic resonance imaging is an under-explored area requiring new statistical attention. The literature review demonstrates that the vitality of the field depends on addressing current problems. The results emphasize that the choice between testing, estimation, and decision-making must be clear to the user.

Conclusions:

The author posits that the continued relevance of this research area depends on addressing genuine analytical needs. Future progress requires a tighter integration between theoretical developments and the practical goals of statistical users. Researchers should prioritize aligning their objectives with the specific requirements of scientific reporting or decision-making processes. The synthesis suggests that simplifying the choice of methods will help mitigate the risks posed by current methodological complexity. New application areas, such as clinical trial safety assessments, offer promising avenues for future investigation. Functional magnetic resonance imaging represents another domain where these statistical challenges require further attention. The work emphasizes that matching methods to goals is a responsibility shared by the entire community. Ultimately, success hinges on the ability to adapt to evolving demands in modern data analysis.

The author proposes matching theoretical goals to user objectives before selecting methods. This prevents confusion caused by the current abundance of error rate and power concepts, unlike older approaches that prioritized method development over practical application.

The researcher highlights functional Magnetic Resonance Imaging as a key domain. This field presents unique challenges for multiple testing that have received less attention compared to traditional clinical trial safety analysis.

The author argues that safety analysis in clinical trials necessitates an aggregated assessment methodology. This approach is required to handle the complexity of simultaneous inference, contrasting with standard individual testing procedures.

The author treats scientific reporting as a distinct goal from decision-making. These categories serve as the primary data types for aligning statistical objectives, whereas previous frameworks often conflated these two distinct analytical purposes.

The author observes that the field has generated a vast array of error rate and power definitions. This phenomenon creates a barrier for users, unlike the more limited set of metrics available in earlier decades.

The author claims that the future vitality of the field depends on addressing real-world statistical needs. This perspective contrasts with a focus on purely theoretical advancements, which the author suggests may lead to stagnation.