Mislabeling (label noise) - an often overlooked issue in chemometrics
A L Pomerantsev1, O Ye Rodionova1
1Semenov Federal Research Center for Chemical Physics RAS, Kosygin Str. 4, Moscow, 119991, Russia.
Background:
In supervised learning, errors can arise in label values. This fact is well known in machine learning (ML), where it has been studied since the late 1960s, but is often ignored in chemometrics. The main reason for mislabeling is human errors when supervision is carried out by a person. It is also inevitable in cases where a continuous process is divided into stages for their subsequent supervised discrimination. Another reason is the imperfection of an instrumental method, which poorly reflects the differences between classes.
Results:
This paper pursues two goals. The first one is to introduce the concept of mislabeling in chemometrics. The second goal is to share our experience in solving mislabeling problems that arise in real-world examples. In our opinion, the most appropriate approach is the integration of the domain knowledge with the outlier detection methods, which should be based on probabilistic (soft) classifiers. This approach is used systematically and is illustrated by three cases that employ both well-established and new methods.
Significance:
Mislabeling is a real problem that can occur across a variety of applications, reaching up to 20%, and in some areas, such as medicine, this rate can be even higher. There is no doubt that mislabeling deserves investigation and correction. In mission-critical fields, particularly in medicine, the cost of an error caused by mislabeled data can be significant, measured not only in financial losses but also in human lives.
Related Concept Videos
MALDI-TOF Mass Spectrometry
¹H NMR: Interpreting Distorted and Overlapping Signals
As Δν decreases and the signals move closer, the doublets appear increasingly distorted. The intensities of the inner lines increase at the cost of those of the outer lines as the signals are slanted or...
Tandem Mass Spectrometry
Inductively Coupled Plasma-Mass Spectrometry (ICP-MS): Interferences
NMR Spectroscopy: Chemical Shift Overview
For instance, the proton...
Chromatographic Methods: Terminology


