Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Sign Test for Matched Pairs01:17

Sign Test for Matched Pairs

353
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
353
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data01:16

Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data

390
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
390
Errors In Hypothesis Tests01:14

Errors In Hypothesis Tests

5.7K
When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
5.7K
Wilcoxon Signed-Ranks Test for Matched Pairs01:09

Wilcoxon Signed-Ranks Test for Matched Pairs

410
The Wilcoxon signed-rank test for matched pairs evaluates the null hypothesis by combining the ranks of differences with their signs. It essentially tests whether the median of the differences in a population of matched pairs is zero. Since the test incorporates more information than the sign test, it generally yields more trustable conclusions. This test also does not require the data to follow a normal distribution, but two conditions must be met for it to be applicable: (1) the data must...
410
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

526
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
526
Testing a Claim about Population Proportion01:24

Testing a Claim about Population Proportion

3.8K
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
3.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Large language models enable prognostic stratification of cancer patients using real-world clinical notes.

PLOS digital health·2026
Same author

Back-transformations in random-effects meta-analysis-Impact and interpretation.

Research synthesis methods·2026
Same author

Adapting tree-based multiple imputation methods for multilevel data? A simulation study.

Behavior research methods·2026
Same author

Host-adapted enzymatic deconstruction of acetylated xylan limits immune activation and facilitates mutualistic colonization of monocot roots.

Molecular plant·2026
Same author

Permutation Tests Based on the Copula-Graphic Estimator and Their Use for Survival Tree Construction.

Statistics in medicine·2026
Same author

CESA7 and microtubules pattern complex secondary cell walls in explosive fruit of Cardamine hirsuta.

The Plant cell·2026

Related Experiment Video

Updated: Dec 28, 2025

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.8K

A cautionary tale on using imputation methods for inference in matched-pairs design.

Burim Ramosaj1, Lubna Amro1, Markus Pauly1

  • 1Faculty of Statistics, Institute of Mathematical Statistics and Applications in Industry, Technical University of Dortmund, Dortmund 44227, Germany.

Bioinformatics (Oxford, England)
|February 13, 2020
PubMed
Summary

Machine learning imputation methods like random forests may lead to inaccurate statistical inference, inflating errors or reducing power in matched pair analyses. Researchers should be cautious when using these techniques for valid statistical inference.

More Related Videos

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
14:14

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups

Published on: May 13, 2022

6.2K
A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

2.9K

Related Experiment Videos

Last Updated: Dec 28, 2025

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.8K
The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
14:14

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups

Published on: May 13, 2022

6.2K
A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

2.9K

Area of Science:

  • Biostatistics
  • Computational Biology
  • Genomics

Background:

  • Imputation of missing data is a common statistical practice in biomedical research.
  • Non-parametric methods, such as random forest imputation, often outperform traditional methods like MICE in imputation performance.
  • The impact of these advanced imputation techniques on the validity of statistical inference remains largely unexamined.

Purpose of the Study:

  • To investigate the validity of machine learning imputation methods for statistical inference on mean differences in incompletely observed data.
  • To compare the performance of random forest imputation against traditional methods and an approach using only observed data.

Main Methods:

  • Extensive simulation studies were conducted to evaluate imputation performance.
  • Analysis included modifying test statistics using Rubin's multiple imputation rule.
  • An illustrative dataset from a breast cancer gene study was analyzed.

Main Results:

  • Machine learning imputation schemes can inflate Type I error rates.
  • These methods may result in reduced statistical power in small-to-moderate matched pairs.
  • Even after applying Rubin's rule, inferential validity concerns persist.

Conclusions:

  • The use of machine learning imputation methods requires careful consideration due to potential impacts on statistical inference.
  • Researchers should be aware of the risks of inflated Type I errors and reduced power.
  • Alternative approaches or cautious application is recommended for valid inference in incomplete datasets.