Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

6.3K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.3K
Mismatch Repair01:20

Mismatch Repair

5.0K
Organisms are capable of detecting and fixing nucleotide mismatches that occur during DNA replication. This sophisticated process requires identifying the new strand and replacing the erroneous bases with correct nucleotides. Mismatch repair is coordinated by many proteins in both prokaryotes and eukaryotes.
The Mutator Protein Family Plays a Key Role in DNA Mismatch Repair
The human genome has more than 3 billion base pairs of DNA per cell. Prior to cell division, that vast amount of genetic...
5.0K
Censoring Survival Data01:09

Censoring Survival Data

172
Survival analysis is a statistical method used to analyze time-to-event data, often employed in fields such as medicine, engineering, and social sciences. One of the key challenges in survival analysis is dealing with incomplete data, a phenomenon known as "censoring." Censoring occurs when the event of interest (such as death, relapse, or system failure) has not occurred for some individuals by the end of the study period or is otherwise unobservable, and it might have many different...
172
Weighted Mean00:57

Weighted Mean

5.3K
While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
5.3K
Assumptions of Survival Analysis01:15

Assumptions of Survival Analysis

171
Survival models analyze the time until one or more events occur, such as death in biological organisms or failure in mechanical systems. These models are widely used across fields like medicine, biology, engineering, and public health to study time-to-event phenomena. To ensure accurate results, survival analysis relies on key assumptions and careful study design.
171
Truncation in Survival Analysis01:09

Truncation in Survival Analysis

263
Truncation in survival analysis refers to the exclusion of individuals or events from the dataset based on specific criteria related to the time of the event. This exclusion can happen in two primary forms: left truncation and right truncation.
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
263

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Large Language Models and Their Applications in Mental Health: Scoping Review.

JMIR mental health·2026
Same author

Blood plasma proteomic biomarkers for forecasting transition to psychosis in an Asian cohort.

Translational psychiatry·2026
Same author

The 2025 Westlake Autumn Symposium for Al Proteomics and Virtual Cell.

Genomics, proteomics & bioinformatics·2026
Same author

Predicting Ultra-High Risk Outcomes Using Linguistic and Acoustic Measures From High-Risk Social Challenge Recordings: mHealth Longitudinal Cohort Exploratory Study.

JMIR formative research·2025
Same author

Protrec2: tissue-specific network-based missing protein recovery method.

Briefings in bioinformatics·2025
Same author

Glioportal: a comprehensive transcriptomic resource unveiling ligand-mediated mesenchymal transition in glioblastoma.

Neuro-oncology·2025

Related Experiment Video

Updated: Aug 9, 2025

Rare Event Detection Using Error-corrected DNA and RNA Sequencing
10:36

Rare Event Detection Using Error-corrected DNA and RNA Sequencing

Published on: August 3, 2018

12.2K

The importance of batch sensitization in missing value imputation.

Harvard Wai Hann Hui1,2, Weijia Kong1,2, Hui Peng1,2

  • 1Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, 636921, Singapore.

Scientific Reports
|February 22, 2023
PubMed
Summary

Careless missing value imputation (MVI) can negatively impact batch correction in data analysis. Explicitly considering batch effects during imputation, like in the self-batch method (M2), improves results and reduces errors.

More Related Videos

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.6K
Infinium Assay for Large-scale SNP Genotyping Applications
13:33

Infinium Assay for Large-scale SNP Genotyping Applications

Published on: November 19, 2013

39.1K

Related Experiment Videos

Last Updated: Aug 9, 2025

Rare Event Detection Using Error-corrected DNA and RNA Sequencing
10:36

Rare Event Detection Using Error-corrected DNA and RNA Sequencing

Published on: August 3, 2018

12.2K
A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.6K
Infinium Assay for Large-scale SNP Genotyping Applications
13:33

Infinium Assay for Large-scale SNP Genotyping Applications

Published on: November 19, 2013

39.1K

Area of Science:

  • Bioinformatics
  • Computational Biology
  • Data Science

Background:

  • Missing values and batch effects are common challenges in complex data analysis.
  • Existing methods for missing value imputation (MVI) and batch correction often operate independently.
  • The confounding impact of MVI on downstream batch correction has not been thoroughly investigated.

Purpose of the Study:

  • To investigate the impact of different missing value imputation strategies on subsequent batch correction.
  • To evaluate the performance of global, self-batch, and cross-batch imputation methods in the presence of batch effects.
  • To provide recommendations for optimal imputation strategies in omics data analysis.

Main Methods:

  • Simulated data analysis to model three imputation strategies: global (M1), self-batch (M2), and cross-batch (M3).
  • Validation of simulation findings using real-world proteomics and genomics datasets.
  • Assessment of batch correction efficacy and statistical error rates for each imputation strategy.

Main Results:

  • The self-batch imputation strategy (M2), which considers batch covariates, significantly enhances batch correction and reduces statistical errors.
  • Global (M1) and cross-batch (M3) imputation methods can lead to batch-effect dilution and irreversible increases in intra-sample noise.
  • This noise introduced by non-considerate MVI is unremovable by standard batch correction algorithms, leading to false positives and negatives.

Conclusions:

  • Explicitly accounting for batch effects during missing value imputation is crucial for accurate downstream analysis.
  • Careless imputation strategies that ignore covariates like batch effects should be avoided to prevent data misinterpretation.
  • The findings underscore the importance of integrated approaches for handling missing values and batch effects in omics data.