Workflow for the Supervised Learning of Chemical Data: Efficient Data Reduction-Multivariate Curve Resolution
Samira Beyramysoltan1, Hamid Abdollahi2, Rabi A Musah1
1Department of Chemistry, University at Albany, State University of New York, 1400 Washington Avenue, Albany, New York 12222, United States.
Abstract:
A new method termed efficient data reduction-multivariate curve resolution (EDR-MCR) has been devised for classification of high-dimensional data. The method introduces the coupling of EDR and MCR as a new strategy for data splitting, variable selection, and supervised classification of high dimensionality data. The method reduces data dimensionality and selects the training set using principal component analysis (PCA) and convex geometry prior to data classification. Then, the reduced data are categorized using an MCR model, in which numerical constraints are imposed to resolve the data into classes and readily interpretable pure component signal weights. The performance of the EDR and supervised MCR methods were tested for their ability to enable discrimination between the constituents of two benchmark and two high-dimensional data sets. The results were compared with the output of the application of different data splitting methods including iterative random selection (IRS), Kennard-Stone (KS), and discrimination methods including partial least-squares-discriminant analysis (PLS-DA) and the ensemble-learning frameworks of linear discriminant analysis (LDA), k-nearest neighbors (KNN), classification and regression trees (CART), and support vector machine (SVM). Overall, EDR resulted in comparable results with other data splitting methods despite the small size of the training set samples that it created. The proposed MCR approach, in comparison with other commonly used supervised techniques, has the advantages of speed in implementation, tuning of fewer parameters, flexibility in the analysis of data characterized by low sample numbers and class imbalances, improved accuracy from the inclusion of additional system information in the form of numerical constraints, and the ability to resolve pure components signal weights.
Related Concept Videos
Calibration Curves: Linear Least Squares
For data that follow a straight line, the standard method for fitting is the linear...
Inductive Effects on Chemical Shift: Overview
Chemical Equilibria: Systematic Approach to Equilibrium Calculations
The first step is to identify all the chemical reactions involved, The...
Experimental Determination of Chemical Formula
The Small x Assumption
Classification of Titrimetric Analysis Based on Reaction Types
Titrations between an acid and a base lead to neutralization reactions that form...


