Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Exploratory analysis of data sets with missing elements and outliers.

A Smoliński, B Walczak, J W Einax

    Chemosphere
    |October 5, 2002
    PubMed
    Summary
    This summary is machine-generated.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    Probability-driven 3D pharmacophore mapping of antimycobacterial potential of hybrid molecules combining phenylcarbamoyloxy and N-arylpiperazine fragments.

    SAR and QSAR in environmental research·2018
    Same author

    In silico estimation of basic activity-relevant parameters for a set of drug absorption promoters.

    SAR and QSAR in environmental research·2017
    Same author

    What can go wrong at the data normalization step for identification of biomarkers?

    Journal of chromatography. A·2014
    Same author

    High-dimensional nested analysis of variance to assess the effect of production season, quality grade and steam pasteurization on the phenolic composition of fermented rooibos herbal tea.

    Talanta·2013
    Same author

    FTIR spectroscopic characterization of differently cultivated food related yeasts.

    The Analyst·2013
    Same author

    Simultaneous determination of Solvent Yellow 124 and Solvent Red 19 in diesel oil using fluorescence spectroscopy and chemometrics.

    Talanta·2012
    Same journal

    Reactivity and environmental fate of emerging contaminants in wastewater treatment systems: A reactive continuum framework approach.

    Chemosphere·2026
    Same journal

    Vinasse fertigation modifies soil-microbiota-plant interactions and metabolism in sugarcane.

    Chemosphere·2026
    Same journal

    Corrigendum to 'Exposure to the Polychlorinated biphenyl mixture Aroclor 1254 elicits neurological and cardiac developmental effects in early life stage zebrafish (Danio rerio)' [Chemosphere 371 (2025), 144023].

    Chemosphere·2026
    Same journal

    Microplastic footprints in freshwater ecosystems: Raman spectroscopy of microplastics as indicator of anthropopressure in Northeastern Poland's lakes.

    Chemosphere·2026
    Same journal

    Estimation of VOC emissions from an electric vehicle interior as a function of cabin air temperature using a selected ion tube flow mass spectrometer (SIFT-MS) measurement.

    Chemosphere·2026
    Same journal

    A direct SPE clean-up after protein precipitation methodology to remove endogenous steroid sulfate MRM interferences for PFAS analysis of serum samples by isotope dilution LC-MS/MS.

    Chemosphere·2026
    See all related articles

    This study introduces a robust strategy for analyzing incomplete datasets by initially estimating missing values using robust partial least squares (PLS). Outliers are identified and replaced, enabling final model construction with the expectation-maximization algorithm.

    Area of Science:

    • Chemometrics
    • Data Analysis
    • Statistical Modeling

    Background:

    • Handling contaminated datasets with missing values is a significant challenge in multivariate data analysis.
    • Existing methods may struggle with outliers and imputation simultaneously, affecting model accuracy.

    Purpose of the Study:

    • To develop a general and robust strategy for exploring contaminated datasets with missing elements.
    • To integrate outlier detection and imputation for improved data preprocessing.

    Main Methods:

    • Robust partial least squares (PLS) for initial estimation of missing elements.
    • Robust distance metrics for identifying outlying elements.
    • Expectation-maximization (EM) algorithm for final model construction, integrated with Principal Component Analysis (PCA) and TUCKER3 models.

    Related Experiment Videos

    Main Results:

    • Successful identification and replacement of outlying elements in contaminated datasets.
    • Effective initial estimation of missing values using robust PLS.
    • Construction of reliable final models using the EM algorithm after data cleaning.

    Conclusions:

    • The proposed strategy provides a robust framework for handling complex datasets with both missing values and outliers.
    • This approach enhances the reliability of multivariate data analysis, particularly in chemometrics and related fields.
    • The integration of robust methods and EM algorithm offers a powerful tool for data exploration and modeling.