A New Multi-Modal Data Fusion Framework for Delamination Detection in Concrete Bridge Decks

Bridge decks are continuously subjected to high environmental exposure, traffic loading, and material aging, leading to progressive delamination which can negatively affect structural integrity and public safety. More specifically, subsurface delamination of concrete and corroded steel reinforcement must be repaired to keep the decks operational. Among non-destructive evaluation techniques, Ground-Penetrating Radar (GPR) and Infrared Thermography (IRT) offer complementary capabilities for detecting subsurface and near-surface defects; however, effective GPR-IRT data fusion remains challenging due to fundamental differences in sensing principles, spatial resolution and sensitivity. This study introduces a Physics-Enhanced Multi-Modal Fusion (PE-MMF) framework that integrates GPR and IRT data to improve delamination detection in reinforced concrete bridge decks. The proposed approach leverages transfer learning, cross-modal attention mechanisms, and gated fusion to enable robust learning from heterogeneous sensor inputs. Furthermore, a systematic feature selection protocol is integrated to identify physically meaningful indicators that remain consistent across different bridges, enhancing generalization capability. The framework is trained and validated using the publicly available SDNET2021 dataset, comprising co-registered GPR and IRT measurements from five in-service bridge decks with verified delamination ground truth. Results demonstrate substantial performance improvements, with average F1-score gains of up to 55% over IRT-based methods and 25% over GPR-based methods across all tested bridges. Comparative analysis against state-of-the-art methods confirmed the superior generalization capability of the proposed multi-modal approach over single-modality approaches. The findings highlight the potential of deep learning-based sensor fusion as a scalable and data-efficient decision-support tool to prioritize regions for detailed physical investigation during long-term infrastructure monitoring.