Related Experiment Video
Updated: Aug 6, 2026

A 3D Digital Model for the Diagnosis and Treatment of Pulmonary Nodules
Published on: May 19, 2023
Transparent chest radiograph foundation model enables explainable human disease profiling
Chin Lin1,2, Kai-Chieh Chen1,2, Jun-Wei Huang3
1Medical Technology Education Center, School of Medicine, College of Medicine, National Defense Medical University, Taipei, Taiwan, R.O.C.
Abstract:
Chest radiography (CXR) is widely accessible, and its ability to capture subtle manifestations of systemic disease remains underexplored. We developed a contrastively pretrained multimodal CXR foundation model using large-scale image-report pairs and evaluated its capacity to predict diverse human diseases. Using 1074 phecodes derived from electronic health records, we trained linear probes on frozen image embeddings and validated performance across three independent cohorts (n = 90,911; n = 79,786; n = 60,282). The model significantly predicted 554 prevalent and 457 incident phenotypes, with 60 prevalent and 42 incident phenotypes demonstrating consistently high discrimination across all datasets. To enhance interpretability, both diseases and 57 radiologist-curated CXR features were embedded into a shared representation space. This co-embedding analysis identified 28 phenotype clusters driven by recognizable imaging patterns, including cardiomegaly, atherosclerosis, and ground-glass opacities, and enabled reconstruction of most predictions with strong explanatory performance (R² ≥ 0.85). Importantly, the embeddings captured imaging signatures associated with near-term cardiovascular events and critical illness. These findings demonstrate that CXR foundation model embeddings encode rich, clinically relevant information beyond conventional interpretation, providing a scalable and interpretable framework for comprehensive disease profiling and a foundation for future prospective validation.
Related Concept Videos
X-ray Imaging
Imaging Studies for Cardiovascular System III: X-Ray
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...

