Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Detection of Gross Error: The Q Test

Detection of Gross Error: The Q Test

When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...

Improving Translational Accuracy

Improving Translational Accuracy

Improving Translational Accuracy

Improving Translational Accuracy

Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...

Data Validation

Data Validation

Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:

Accuracy and Precision

Accuracy and Precision

Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value. Highly accurate...

Accuracy and Precision

Accuracy and Precision

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Measuring quality of DNA sequence data via degradation.

PloS one·2022

Same author

Specified Certainty Classification, with Application to Read Classification for Reference-Guided Metagenomic Assembly.

ArXiv·2021

Same author

Comparing record linkage software programs and algorithms using real-world data.

PloS one·2019

Same author

A Bayesian spatio-temporal approach for real-time detection of disease outbreaks: a case study.

BMC medical informatics and decision making·2014

Same author

A spatio-temporal absorbing state model for disease and syndromic surveillance.

Statistics in medicine·2012

Same author

Estimation of propensity scores using generalized additive models.

Statistics in medicine·2008

Same journal

MetaboNet-Bench: A Multi-modal Benchmark for Glucose Forecasting in Type 1 Diabetes.

ArXiv·2026

Same journal

A Positron Range Correction with Texture Preservation Framework in PET Imaging.

ArXiv·2026

Same journal

Automated optimization of force field parameters against ensemble-averaged measurements with Bayesian Inference of Conformational Populations.

ArXiv·2026

Same journal

Droplet Fusion as a Relaxation Process: Comparison with Shape Recovery of Newtonian and Viscoelastic Droplets.

ArXiv·2026

Same journal

Ridge-filter crosstalk in conformal proton FLASH planning: dependence on beamlet pitch and iterative mitigation.

ArXiv·2026

Same journal

Electrochemical DNA Hairpin Sensors for Differentiating Small Molecule Intercalation from Minor Groove Binding.

ArXiv·2026

See all related articles

Search research articles

Related Experiment Videos

Effects of Training Data Quality on Classifier Performance.

Alan F Karr¹, Regina Ruane²

¹Department of Statistics, Operations and Data Science, Temple University, Philadelphia PA 19122 and Fraunhofer USA Center Mid-Atlantic, Riverdale MD 20737.

|March 11, 2026

Summary

This summary is machine-generated.

Classifier performance in DNA assembly degrades significantly with lower quality training data. All tested classifiers fail similarly when data quality drops, leading to incorrect results.

Related Experiment Videos

Area of Science:

Bioinformatics
Computational Biology
Machine Learning

Background:

Classifier performance is crucial for analyzing biological data.
The quality of training data is a critical, yet often overlooked, factor in classifier reliability.
Metagenomic assembly relies on accurate classification of short DNA reads.

Purpose of the Study:

To quantify the impact of training data quality on classifier performance.
To investigate classifier behavior under data degradation in metagenomic assembly.
To compare the robustness of different classification algorithms.

Main Methods:

Conducted extensive numerical experiments on classifier performance.
Degraded training data quality using multiple mechanisms.
Evaluated four types of classifiers: Bayes classifiers, neural nets, partition models, and random forests.
Assessed individual classifier behavior and inter-classifier congruence.

Main Results:

All four classifiers exhibited breakdown-like behavior as training data quality decreased.
Classifiers transitioned from mostly correct to coincidentally correct predictions.
Degradation led to classifiers making the same errors, indicating a loss of distinct decision-making.
Spatial heterogeneity emerged: increased distance between training and analysis data resulted in degenerated decisions and increased classifier congruence.

Conclusions:

Classifier performance is highly sensitive to training data quality.
Metagenomic assembly classifiers show consistent failure modes when data quality is compromised.
Understanding training data limitations is essential for reliable bioinformatics analyses.