Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Quantifying and Rejecting Outliers: The Grubbs Test

Quantifying and Rejecting Outliers: The Grubbs Test

Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...

Extraction: Advanced Methods

Extraction: Advanced Methods

Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...

Data Validation

Data Validation

Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:

Data Collection by Observations

Data Collection by Observations

Data collection refers to a systematic way of obtaining, observing, measuring, and analyzing accurate information. Observational studies are one of the most widely used methods of data collection. It involves collecting data by observing the behavior and physical characteristics of a sample without making any modifications to the sample.
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...

Cleaning, Sterilization, and Disinfection

Cleaning, Sterilization, and Disinfection

Cleaning, disinfection, and sterilization are the methods that help to break the infection chain and prevent disease.
Cleaning
The cleaning process usually involves using water with detergents or enzymatic cleaner and removing foreign material from objects and surfaces, including organic material such as body fluids or inorganic material like soil. Cleaning is performed before high-level disinfection and sterilization because foreign materials on the cover of the devices interfere with process...

Detection of Gross Error: The Q Test

Detection of Gross Error: The Q Test

When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Robust end-to-end stratification of amyotrophic lateral sclerosis patients via recurrent variational autoencoder and consensus clustering.

Journal of biomedical informatics·2026

Same author

Environmental Personal Exposure Clusters to Investigate Multiple Sclerosis and Amyotrophic Lateral Sclerosis Progression.

Studies in health technology and informatics·2026

Same author

A novel Vector-Symbolic Architecture for graph encoding and its application to viral pangenome-based species classification.

BioData mining·2026

Same author

DBSCAN applied to EHRs data from patients with glioblastoma clusters patients based on cytosolic Hsp70 protein, sex, and brain subventricular zone.

BioData mining·2026

Same author

Correction: A differential process mining analysis of COVID-19 management for cancer patients.

Frontiers in oncology·2026

Same author

Data-driven probabilistic mapping of the spatial and molecular landscape of glioma.

Brain communications·2026

Same journal

Detection, communication, and individual identification with deep audio embeddings: A case study with North Atlantic right whales.

PLoS computational biology·2026

Same journal

Exploring the structural lexicon of the Proteome via Metric Geometry.

PLoS computational biology·2026

Same journal

Linking retinal sampling in neural encoding models to temporal profiles of visual processing in humans.

PLoS computational biology·2026

Same journal

CAdir: Joint clustering of cells and genes for single-cell transcriptomics with visualization-driven cluster quality assessment.

PLoS computational biology·2026

Same journal

Systematic design of auxotrophic strains and media conditions to probe metabolic functions in E. coli.

PLoS computational biology·2026

Same journal

Neuronal excitability and parameter variability in the Hodgkin-Huxley model.

PLoS computational biology·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Aug 17, 2025

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

Eleven quick tips for data cleaning and feature engineering.

Davide Chicco¹, Luca Oneto^2,3, Erica Tavazzi⁴

¹Institute of Health Policy Management and Evaluation, University of Toronto, Toronto, Ontario, Canada.

Plos Computational Biology

|December 15, 2022

Summary

This summary is machine-generated.

Effective data cleaning and feature engineering are crucial preprocessing steps for reliable scientific computational analysis. This guide offers quick tips to avoid common mistakes for researchers in any field.

More Related Videos

Experimental and Data Analysis Workflow for Soft Matter Nanoindentation

Experimental and Data Analysis Workflow for Soft Matter Nanoindentation

Published on: January 18, 2022

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Published on: August 16, 2020

Related Experiment Videos

Last Updated: Aug 17, 2025

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

Experimental and Data Analysis Workflow for Soft Matter Nanoindentation

Experimental and Data Analysis Workflow for Soft Matter Nanoindentation

Published on: January 18, 2022

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Published on: August 16, 2020

Area of Science:

Computational statistics and machine learning applications across diverse scientific disciplines.

Background:

Data preprocessing, including data cleaning and feature engineering, is essential for robust scientific outcomes.
Inexperienced researchers often struggle with these critical preprocessing steps, leading to inefficient or inaccurate analyses.

Purpose of the Study:

To provide practical guidelines and quick tips for effective data cleaning and feature engineering.
To help researchers avoid common pitfalls in data preprocessing for computational studies.

Main Methods:

Development of practical recommendations for data cleaning.
Guidance on feature engineering techniques.
Focus on avoiding common errors and inefficiencies.

Main Results:

A set of actionable tips for improving data preprocessing.
Guidelines applicable to bioinformatics, health informatics, and general scientific research.
Enhanced understanding of feature engineering and data cleaning importance.

Conclusions:

Properly executed data cleaning and feature engineering significantly enhance the reliability of computational analyses.
These guidelines aim to empower researchers to achieve more solid outcomes and discoveries.