Related Experiment Video
Updated: Jul 5, 2026

Multimodal Cross-Device and Marker-Free Co-Registration of Preclinical Imaging Modalities
Published on: October 27, 2023
Discrepancy-Guided Complementary Fusion for Unsupervised Multimodal Anomaly Detection
Taehui Lee1, Seyoung Jeong1, Sang Jun Lee1
1Division of Electronic Engineering, Jeonbuk National University, 567 Baekje-daero, Deokjin-gu, Jeonju 54896, Republic of Korea.
None:
In industrial inspection, subtle defects often appear as local variations in appearance or geometry, making reliable anomaly detection challenging. A single sensing modality can miss important defect cues, while multimodal inspection combines appearance and geometric information to represent industrial objects more comprehensively. Many existing multimodal anomaly detection methods adopt early fusion strategies that integrate features at an early stage of the network. Such early integration can dilute modality-specific anomaly responses and cause anomaly smoothing, leading to degraded detection and localization performance. To address these challenges, we propose a reconstruction-based unsupervised multimodal anomaly detection framework integrating Discrepancy-Guided Complementary Fusion (DGCF) and Noise to Feature (N2F). Specifically, DGCF reduces anomaly smoothing by exploiting cross-modal discrepancies to extract complementary information, rather than directly summing or concatenating features from different modalities. Furthermore, N2F injects Gaussian noise into the feature space to regularize feature reconstruction and encourage the decoder to learn robust normal representations. Experimental results on the MVTec 3D-AD and Eyecandies datasets demonstrate the effectiveness of the proposed method. The proposed method achieves 97.3% I-AUROC, 99.6% P-AUROC, and 97.6% AUPRO on MVTec 3D-AD, and 94.8% I-AUROC, 98.6% P-AUROC, and 93.4% AUPRO on Eyecandies.