Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Detection of Gross Error: The Q Test

Detection of Gross Error: The Q Test

When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Outcome Measurement in Real World Studies of Revascularisation for Chronic Limb Threatening Ischaemia: a Scoping Review and Framework for Appraisal.

European journal of vascular and endovascular surgery : the official journal of the European Society for Vascular Surgery·2026

Same author

Methods for incorporating test result information within the high-dimensional propensity score framework: application in UK electronic health record data.

BMC medical research methodology·2026

Same author

Utilisation patterns of systemic anticancer therapy (SACT) in patients with advanced non-small cell lung cancer (NSCLC) in England.

BMJ oncology·2026

Same author

Age, patient experience and satisfaction with breast cancer care: a cohort study using linked national cancer patient experience survey and cancer registry data.

BMJ open·2026

Same author

Days alive and out of hospital after burr-hole drainage for chronic subdural haematoma: a national cohort study using Hospital Episode Statistics in England.

BMJ open·2026

Same author

Implementing quality improvement in vascular services: a qualitative study.

BMJ open quality·2026

Search research articles

Related Experiment Video

Updated: Aug 9, 2025

Quantitative Analysis of Cell Edge Dynamics during Cell Spreading

Quantitative Analysis of Cell Edge Dynamics during Cell Spreading

Published on: May 22, 2021

The DetectDeviatingCells algorithm was a useful addition to the toolkit for cellwise error detection in observational

Laura Viviani¹, Ian R White², Elizabeth J Williamson³

¹Faculty of Public Health and Policy, Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, 15-17 Tavistock Place, London WC1H 9SH, UK.

Journal of Clinical Epidemiology

|February 22, 2023

Summary

This summary is machine-generated.

The DetectDeviatingCells (DDC) algorithm shows strong performance in detecting data anomalies in continuous variables. It excels at identifying complex transcription errors, outperforming other methods for nuanced data quality issues.

Keywords:

Data quality DetectDeviatingCells Error detection Mahalanobis distance Outlier Robust statistics

More Related Videos

Rare Event Detection Using Error-corrected DNA and RNA Sequencing

Rare Event Detection Using Error-corrected DNA and RNA Sequencing

Published on: August 3, 2018

Area-based Image Analysis Algorithm for Quantification of Macrophage-fibroblast Cocultures

Area-based Image Analysis Algorithm for Quantification of Macrophage-fibroblast Cocultures

Published on: February 15, 2022

Related Experiment Videos

Last Updated: Aug 9, 2025

Quantitative Analysis of Cell Edge Dynamics during Cell Spreading

Quantitative Analysis of Cell Edge Dynamics during Cell Spreading

Published on: May 22, 2021

Rare Event Detection Using Error-corrected DNA and RNA Sequencing

Rare Event Detection Using Error-corrected DNA and RNA Sequencing

Published on: August 3, 2018

Area-based Image Analysis Algorithm for Quantification of Macrophage-fibroblast Cocultures

Area-based Image Analysis Algorithm for Quantification of Macrophage-fibroblast Cocultures

Published on: February 15, 2022

Area of Science:

Data Science
Biostatistics
Observational Research

Background:

Data quality is crucial for reliable research findings.
Identifying and correcting errors in observational datasets is a significant challenge.
Existing error detection methods have limitations in handling complex or subtle data anomalies.

Purpose of the Study:

To evaluate the error detection performance of the DetectDeviatingCells (DDC) algorithm.
To compare the DDC algorithm's effectiveness against other established error detection approaches.
To assess the DDC algorithm's ability to identify both simple and complex data errors in continuous variables.

Main Methods:

Simulated height and weight data for individuals aged 2-20 years.
Introduced predetermined error patterns into a proportion of height values.
Applied the DDC algorithm alongside descriptive statistics, plots, fixed-threshold rules, and Mahalanobis distance methods.
Evaluated performance using sensitivity, specificity, likelihood ratios, predictive values, and receiver operating characteristic (ROC) curves.

Main Results:

All methods demonstrated excellent specificity in error detection.
Multivariable and robust methods, including DDC, showed higher sensitivity.
The DDC algorithm performed comparably to other robust multivariable methods.
DDC outperformed other methods in detecting complex error patterns, such as plausible transcription errors, while performance was similar for gross errors.

Conclusions:

The DDC algorithm demonstrates significant potential for enhancing error detection in observational data.
Its ability to identify complex errors makes it a valuable tool for improving data quality.
The findings suggest DDC can contribute to more robust and reliable research outcomes.