Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Bonferroni Test01:10

Bonferroni Test

2.7K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.7K
Multiple Comparison Tests01:13

Multiple Comparison Tests

3.9K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.9K
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

198
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
198
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data01:16

Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data

129
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
129
Testing a Claim about Standard Deviation01:19

Testing a Claim about Standard Deviation

2.4K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.4K
Comparing Experimental Results: Student's t-Test01:09

Comparing Experimental Results: Student's t-Test

1.6K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
1.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Interactions of blood biomolecules with early rhythm control in atrial fibrillation patients: Exploratory analysis of the EAST-AFNET 4 Biomolecule Study.

Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology·2026
Same author

Early treatment of Atrial fibrillation for Stroke prevention Trial in acute STROKE (EAST-STROKE): protocol for an international investigator-initiated, prospective, randomised, open, blinded endpoint assessment (PROBE) interventional multi-centre trial.

European stroke journal·2026
Same author

Kidney disease increases the risk of cardiovascular events in patients with device-detected atrial fibrillation: NOAH-AFNET 6.

Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology·2026
Same author

Which transgender and gender diverse groups benefit most from E-health? Subgroup analyses of the randomized controlled trial i<sup>2</sup>TransHealth in Germany.

International journal of transgender health·2026
Same author

Implementation of the German Clinical Practice Guideline for Multimorbidity Using a Digital Tool in Primary Care: Pilot Cluster Randomized Clinical Trial.

JMIR aging·2025
Same author

Prevalence and severity of atrial cardiomyopathy in patients with recently diagnosed atrial fibrillation and stroke risk factors and its association with early rhythm control: a secondary analysis of EAST-AFNET 4.

Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology·2025

Related Experiment Video

Updated: Jun 30, 2025

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease
06:16

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease

Published on: August 9, 2024

407

Statistical inference for diagnostic test accuracy studies with multiple comparisons.

Max Westphal1,2, Antonia Zapf3,2

  • 1Fraunhofer Institute for Digital Medicine MEVIS, Bremen, Germany.

Statistical Methods in Medical Research
|March 15, 2024
PubMed
Summary
This summary is machine-generated.

This study addresses multiple testing in diagnostic accuracy studies. Pairs Bootstrap procedures offer effective family-wise error rate control and competitive statistical power, outperforming traditional methods in simulations.

Keywords:
Diagnosismedical testingmodel selectionmultiple testingpredictionprognosis

More Related Videos

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
08:36

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment

Published on: April 19, 2024

508
A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.5K

Related Experiment Videos

Last Updated: Jun 30, 2025

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease
06:16

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease

Published on: August 9, 2024

407
Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
08:36

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment

Published on: April 19, 2024

508
A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.5K

Area of Science:

  • Biostatistics
  • Diagnostic Test Evaluation
  • Statistical Methodology

Background:

  • Diagnostic accuracy studies evaluate index tests against reference standards.
  • Index test selection often occurs before validation, violating study design assumptions.
  • This leads to a multiple testing problem, potentially inflating error rates.

Purpose of the Study:

  • To investigate multiple comparison procedures for family-wise error rate control in diagnostic accuracy studies.
  • To adapt conventional multiplicity adjustment methods for co-primary hypothesis problems.
  • To compare the performance of various statistical approaches in realistic and least-favorable scenarios.

Main Methods:

  • Conducted an extensive simulation study comparing five multiple comparison procedures.
  • Included parametric (maxT, Bonferroni), non-parametric, and Bayesian approaches.
  • Implemented all methods in the open-source R package 'cases' for reproducibility.

Main Results:

  • Parametric methods (maxT, Bonferroni) are simple but may inflate Type I error rates with small sample sizes.
  • Pairs Bootstrap procedures demonstrated effective family-wise error rate control in finite samples.
  • Bootstrap methods also exhibited competitive statistical power compared to other approaches.

Conclusions:

  • Pairs Bootstrap procedures are recommended for family-wise error rate control in diagnostic accuracy studies.
  • These methods provide a robust solution to the multiple testing problem in this context.
  • The 'cases' R package facilitates the application and reproduction of these findings.