Outlier Identification Method Based on Multi-Model Weighted Consensus in Conjunction With Monte Carlo...

The accurate identification and removal of outliers are fundamental to the development of a robust model.

Exclusively relying on a single model for outlier detection may be insufficient for the proper identification of all outliers. This study examines the identification of anomalous data using the multi-model consensus technique to address issues of false positives, false negatives, and model reliance inherent in the identification process using a singular model.

This study introduces a method called Monte Carlo cross-validation in conjunction with multiple models of Weighted Consensus for outlier identification (MCWC, Monte Carlo Weighted Consensus). The proposed method integrates Monte Carlo random sampling with three distinct modeling methods: Partial Least-Squares Regression (PLSR), Gaussian process regression (GPR), and support vector regression (SVR). This integration allows for the amalgamation of predictions from each model, facilitating the identification of outliers effectively.

This study employed a dataset comprising 305 sorghum samples as the experimental foundation. The predictive model for sorghum protein was built using the data after removing outliers using the single model method and the MCWC method, respectively. The experimental results indicate that the dataset, which was obtained by removing outliers using a single modeling method, is appropriate for further modeling with the same method. However, it is not suitable for modeling with other methods due to issues related to model dependence. After applying the MCWC method to remove outliers, the average R2 of the model prediction set was found to be 0.8525. In contrast, the average R2 of the model prediction set, obtained by applying the Monte Carlo method combined exclusively with PLSR for outlier removal, is 0.8037.

The MCWC method exhibits superior accuracy in identifying outliers and effectively addresses challenges such as false positive, false negative, and model dependence in the process of identifying near-infrared spectral outliers. This enhances the overall predictive performance of the calibration model for spectral quantitative analysis.

A multi-model dynamic weighted consensus outlier identification for near-infrared spectroscopy (NIRS) data is proposed. This dynamic weighting method effectively addresses the biases that can occur with simple averaging. The data after removing outliers using consensus methods is more suitable for modeling with a wider range of models.