Related Experiment Video
Updated: Jan 8, 2026

Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities
Published on: October 27, 2023
The Application of Foundation Models in Radiology: Bridging Images, Reports, and Beyond
Abstract:
The use of AI in radiology is rapidly transitioning towards the use of foundation models that learn universal representations from large-scale imaging and multimodal clinical data. In this review, we outline the key technical components of these models, including self-supervised encoders, fusion modules for feature alignment, and task-specific decoders, and further summarize the recent work in three categories: 1) image-only models, trained on millions of unlabeled radiology scans to enable robust transfer learning with minimal annotation, 2) Chest X-ray image-report models, which leverage large chest X-ray-reported corpora for joint visual and textual embedding, and 3) image-report models for other modalities, which fuse volumetric images with structured reports or clinical metadata. We further discuss the relevant evaluation strategies, including vision-centric, language-centric, and benchmark-based metrics, and outline approaches for clinical validation. Finally, we highlight the persistent challenges in the application of these models, and propose future directions for multimodal integration and human-AI collaboration to advance personalized radiology.
More Related Videos
Related Concept Videos
Radiological Investigation I: X-ray and CT
Imaging Studies III: Computed Tomography
Imaging Studies for Cardiovascular System III: X-Ray
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...
Imaging Studies I: CT and MRI
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
Computed Tomography
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
Positron Emission Tomography
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...

