A fast progressive spectrum denoising combined with partial least squares algorithm and its application in online...

Fourier transform infrared (FTIR) spectroscopy is an important method in analytical chemistry. A material can be qualitatively and quantitatively analyzed from its FTIR spectrum. Spectrum denoising is commonly performed before online FTIR quantitative analysis. The average method requires a long time to collect spectra, which weakens real-time online analysis. The Savitzky-Golay smoothing method makes peaks smoother with the increase of window width, causing useful information to be lost. The sparse representation method is a common denoising method, that is used to reconstruct spectrum. However, for the randomness of noise, we can't achieve the sparse representation of noise. Traditional sparse representation algorithms only perform denoising once, and the noise can not be removed completely. FTIR spectrum denoising should therefore be performed in a progressive way. However, it is difficult to determine to what degree of denoising is required. Here, a fast progressive spectrum denoising combined with partial least squares method was developed for online FTIR quantitative analysis. Two real sample data sets were used to test the performance of the proposed method. The experimental results indicated that the progressive spectrum denoising method combined with the partial least squares method performed markedly better than other methods in terms of root mean squared error of prediction and coefficient of determination in the FTIR quantitative analysis.