基于张量产品的二维相关数据预处理方法,用于中国手工造纸的拉曼光谱
Chunsheng Yan1, Si Luo2, Linquan Cao3
1Zhejiang University Library, Hangzhou 310058, China; State Key Laboratory of Modern Optical Instrumentation, Hangzhou 310058, China.
概括
两种新方法,交叉相关性 (CCM) 和二维相关性 (TDCM),显著提高了中国手工造纸的拉曼光谱分析. TDCM预处理,特别是TDACM,大大提高了机器学习模型的准确性,在KNN和RF模型中接近100%.
科学领域:
- 频谱学是一种光谱学.
- 材料科学 材料科学 材料科学
- 化学测量 化学测量 化学测量
背景情况:
- 拉曼光谱对于分析中国手工造纸等材料至关重要.
- 预处理原始光谱数据对于准确的分析和机器学习模型性能至关重要.
- 现有的方法可能无法完全捕捉复杂样本分析的微妙光谱变化.
研究的目的:
- 引入新的预处理方法:用于拉曼光谱的交叉相关性 (CCM) 和二维相关性 (TDCM).
- 评估CCM,TDCM (包括TDSCM和TDACM) 的有效性,以及对机器学习模型准确性的基线删除.
- 使用不同的预处理技术,比较无监督 (PCA) 和监督 (SVM-LR,KNN,RF) 模型的性能.
主要方法:
- 开发并应用交叉关联方法 (CCM) 来扩大光谱维度.
- 实施二维相关联方法 (TDCM),包括同步 (TDSCM) 和异步 (TDACM),以创建N×N光谱矩阵.
- 利用四种机器学习模型 (PCA-LR,SVM-LR,KNN,RF) 来分析中国手工造纸的预处理拉曼光谱.
主要成果:
- 主要组件分析 (PCA) 模型在所有数据类型中显示了近乎完美的R平方值.
- 对于监督模型 (SVM-LR,KNN,RF),R平方值连续改进:原始数据<基线删除
- 两维异步关联方法 (TDACM) 的预处理导致KNN和射频模型的R平方值接近1 ,几乎提高了100%的准确性.
结论:
- CCM和TDCM是拉曼光谱数据分析的有效预处理技术.
- TDACM预处理显著提高了监督机器学习模型 (KNN,RF) 对中国手工纸张分析的准确性.
- 监督模型的增强精度接近无监督PCA的精度,为光谱数据解释提供了强大的方法.
相关概念视频
Raman Spectroscopy: Overview
473
The underlying principle of Raman spectroscopy is based on the interaction between light and matter, specifically molecules' inelastic scattering of photons. When a monochromatic beam of light, typically from a laser source, interacts with a sample, most scattered light has the same frequency as the incident light. This is known as Rayleigh scattering.
However, a small fraction of the scattered light exhibits a frequency shift due to the exchange of energy between the incident photons and...
However, a small fraction of the scattered light exhibits a frequency shift due to the exchange of energy between the incident photons and...
473
Raman Spectroscopy Instrumentation: Overview
466
A conventional Raman spectrophotometer includes a laser source, a sample holding system, a wavelength selector, and a detector.
The monochromatic laser source, typically using visible or near-infrared radiation, generates a highly focused beam of light. This light interacts with the molecules of the sample, scattering some of the light. Liquid and gaseous samples are usually tested in ordinary glass capillaries, while solids can be analyzed as powders packed in capillaries or as potassium...
The monochromatic laser source, typically using visible or near-infrared radiation, generates a highly focused beam of light. This light interacts with the molecules of the sample, scattering some of the light. Liquid and gaseous samples are usually tested in ordinary glass capillaries, while solids can be analyzed as powders packed in capillaries or as potassium...
466
2D NMR: Overview of Homonuclear Correlation Techniques
245
Homonuclear correlation spectroscopy (COSY) is a powerful technique used in Nuclear Magnetic Resonance (NMR) spectroscopy to study the correlations between nuclei of the same type within a molecule. It provides information about scalar couplings between adjacent nuclei, which helps determine connectivity and structural information. There are several COSY variants, each with its unique strengths and experimental parameters.
COSY90 is the standard two-dimensional (2D) COSY experiment that...
COSY90 is the standard two-dimensional (2D) COSY experiment that...
245
2D NMR: Overview of Heteronuclear Correlation Techniques
234
Heteronuclear correlation spectroscopy is an analytical technique that investigates the coupling between different types of nuclei, often a proton and an X-nucleus, such as carbon-13 or nitrogen-15. This method is commonly used in nuclear magnetic resonance (NMR) spectroscopy to gain insights into complex chemical compounds' structural and compositional aspects. A typical heteronuclear correlation spectrum displays X-nucleus chemical shifts on one axis and a proton spectrum on the other...
234
2D NMR: Homonuclear Correlation Spectroscopy (COSY)
1.2K
Homonuclear correlation spectroscopy, or COSY, is a 2-dimensional NMR technique that provides information about coupled protons. Typically, the geminal and vicinal coupling are observed. For example, consider the COSY spectrum of ethyl acetate, where its 1D proton NMR spectrum is plotted along the vertical and horizontal axes with their corresponding chemical shift scale. Three spots on the diagonal corresponding to the three peaks in the 1D proton spectrum are called diagonal peaks. The COSY...
1.2K
2D NMR: Heteronuclear Single-Quantum Correlation Spectroscopy (HSQC)
777
Heteronuclear single-quantum correlation spectroscopy (HSQC) is a 2D NMR technique that reveals one-bond correlations between hydrogen and a heteronucleus. The HSQC experiment is similar to the heteronuclear correlation experiment (HETCOR) but is more sensitive. In the HSQC spectrum, the proton chemical shift is plotted on the horizontal F2 axis, while the 13C chemical shift is plotted on the vertical F1 axis. The corresponding proton and 13C spectra are also shown. The HSQC contour plot does...
777


