Related Experiment Video
Updated: Oct 18, 2026

Multimodal Nonlinear Hyperspectral Chemical Imaging Using Line-Scanning Vibrational Sum-Frequency Generation Microscopy
Published on: December 1, 2023
SpectralTAG: Functional group identification from infrared spectra via unified LLM and GNN textual graphs
Ziru Yu1, Jiheng Liang2, Zujie Xie3
1School of Electronics and Communication Engineering, Sun Yat-Sen University, Shenzhen 518107, China.
Background:
Spectral analysis underpins much of modern chemical characterization, yet extracting chemically meaningful interpretations from spectral signals remains constrained by the disconnect between data-driven pattern recognition and structured domain knowledge.
Results:
Here we present SpectralTAG, a unified graph-based reasoning framework that bridges this gap by representing infrared spectra, hierarchical chemical knowledge graphs, and scientific text within a common textual attribute graph (TAG). In this representation, continuous spectra are discretized into semantically annotated range nodes, aligned with functional-group and vibration-type entities from a chemical ontology, and augmented with task-specific prompt and response nodes, enabling a single graph backbone to support node-level functional group classification, edge-level peak-pair relationship judgment, and graph-level molecular classification tasks through large language model encoding and graph neural network inference, without task-specific architectural redesign. Evaluated on 306 organic molecules with infrared spectra, SpectralTAG achieves AUC > 0.98 on edge- and graph-level tasks across 24 encoder-GNN combinations, with LLaMa2-7b paired with R-GCN delivering the most consistent cross-task performance. The framework further supports multitask training with negligible performance trade-off and exhibits emerging zero-shot and few-shot generalization under disjoint label conditions.
Significance:
These results establish textual attribute graphs as a viable paradigm for unifying heterogeneous scientific data within a single reasoning architecture, with implications beyond spectroscopy for broader knowledge-enhanced scientific analysis.
More Related Videos
Related Concept Videos
IR Frequency Region: Fingerprint Region
The...
Infrared (IR) Spectroscopy: Overview
Different compounds display unique properties due to their...
IR Spectroscopy: Molecular Vibration Overview
Stretching vibrations are vibrational motions that occur along the bond line, changing the bond length or distance between two bonded atoms. They are further distinguished as symmetric or asymmetric. In symmetric stretching, the...
Applications of IR Spectroscopy: Overview
IR Spectrum
Transmittance is defined as the ratio of the radiant power passing through a sample to that from the radiation's source. Multiplying the transmittance by 100 gives the percent transmittance (%T), which varies between 100% (no absorption) and 0% (complete...
Raman Spectroscopy: Overview
However, a small fraction of the scattered light exhibits a frequency shift due to the exchange of energy between the incident photons and the...

