Related Experiment Video
Updated: May 14, 2026

Multimodal Nonlinear Hyperspectral Chemical Imaging Using Line-Scanning Vibrational Sum-Frequency Generation Microscopy
Published on: December 1, 2023
USF-Net: Infrared-Visible Image Fusion via Unified Semantics and Context Modulation
Dingding Fu1, Zhongguo Li1, Wenbin Fan2
1School of Mechanical Engineering, Jiangsu University of Science and Technology, Zhenjiang 212100, China.
None:
Infrared-visible image fusion aims to integrate structural details, natural appearance, and thermal target information from two source modalities, thereby improving visual perception in complex scenes. However, under challenging conditions such as low illumination, noise, low contrast, and overexposure, existing methods often struggle to stably preserve cross-modal shared features (CMSF) while effectively highlighting single-modal specific features (SMSF). In addition, the absence of real fusion labels limits effective supervised learning. To address these issues, this paper proposes a unified semantic-guided fusion network, termed USF-Net, which jointly models the shared and specific features of infrared and visible images under a unified semantic representation and dynamically adjusts the fusion strategy according to imaging contexts. Specifically, the Shared Feature Alignment and Enhancement (SFAE) module is designed to strengthen consistent modeling of common features across modalities, while the Specific Feature Reweighting Fusion (SFRF) module selectively enhances modality-specific features to achieve stable and controllable fusion. Moreover, the constructed real fusion labels are incorporated into the loss function for collaborative training. Experimental results on multiple public datasets demonstrate that USF-Net achieves superior fusion performance under diverse complex imaging conditions.
Related Concept Videos
Infrared (IR) Spectroscopy: Overview
Different compounds display unique properties due to their...
Ultraviolet and Visible (UV–Vis) Spectroscopy: Overview
IR Frequency Region: Fingerprint Region
The...
IR Spectrometers
IR Spectrum
Transmittance is defined as the ratio of the radiant power passing through a sample to that from the radiation's source. Multiplying the transmittance by 100 gives the percent transmittance (%T), which varies between 100% (no absorption) and 0% (complete...
IR Spectroscopy: Molecular Vibration Overview
Stretching vibrations are vibrational motions that occur along the bond line, changing the bond length or distance between two bonded atoms. They are further distinguished as symmetric or asymmetric. In symmetric stretching, the...
