Prediction of chronic obstructive pulmonary disease based on multimodal data and deep learning
Haoran Deng1, Xuchun Ding1, Shiping Zhu1
1Department of Respiratory and Critical Care Medicine, Hangzhou TCM Hospital Affiliated to Zhejiang Chinese Medical University, Hangzhou 310007, Zhejiang, China.
Abstract:
To address the issues of insufficient utilization of multimodal information, modal heterogeneity, and data gaps leading to poor model generalization in early prediction of chronic obstructive pulmonary disease (COPD), a deep learning-based multimodal dynamic fusion network (MMDF-Net) is proposed. This model integrates chest CT images, pulmonary function indicators, and environmental exposure data. It aligns image and non-image features via a dual-tower cross-modal contrastive learning module, mitigating semantic differences across modalities. A conditional generative adversarial network is used to generate high-fidelity environmental exposure data, reducing reliance on data completeness. A dynamic gating fusion mechanism adaptively adjusts multimodal weights based on patient smoking history, age, and other attributes to suppress noise. On the COPD Gene dataset, MMDF-Net achieves an area under the curve (AUC) of 0.92, a sensitivity of 92.3%, and a specificity of 88.7%, significantly outperforming single-modal models and dynamically adjusting weights according to disease stage. These results demonstrate that this multimodal dynamic fusion strategy can effectively address data heterogeneity and individual differences, providing technical support for precise early intervention in COPD.
Related Concept Videos
Chronic Obstructive Pulmonary Disease-I: Introduction
Chronic Obstructive Pulmonary Disease
Smoking is a primary risk factor for COPD, with over 80% of patients having a history of it. Patients typically experience progressive dyspnea or labored breathing, frequent coughing, and recurrent pulmonary infections. Many eventually succumb to respiratory failure, characterized by...
Chronic Obstructive Pulmonary Disease-IV: Assessement and Diagnostic Studies
Medical History
Chronic Obstructive Pulmonary Disease-II: Pathophysiology
Chronic Inflammation
Chronic Obstructive Pulmonary Disease-V: Management
Smoking Cessation
COPD: Pathogenesis and Clinical Features
The primary cause for the onset of COPD is cigarette smoking and exposure to air pollution. These hazardous factors initiate a chain reaction within the lungs, resulting in chronic inflammation, damage to the airways, and a...


