Foundation Models in Radiology: What, How, Why, and Why Not
Magdalini Paschali1, Zhihong Chen1, Louis Blankemeier1
1From the Stanford Center for Artificial Intelligence in Medicine and Imaging, 1701 Page Mill Rd, Palo Alto, CA 94304 (M.P., Z.C., L.B., M.V., A.Y., C.B., C.L., S.G., A.C.); Departments of Radiology (M.P., Z.C., A.Y., C.L., S.G., A.C.), Electrical Engineering (L.B.), Computer Science (M.V.), Medicine (C.L.), and Biomedical Data Science (C.L., A.C.), Stanford University, Stanford, Calif; and Department of Diagnostic and Interventional Radiology, University Hospital Zurich, University of Zurich, Zurich, Switzerland (C.B.).
Abstract:
Recent advances in artificial intelligence have witnessed the emergence of large-scale deep learning models capable of interpreting and generating both textual and imaging data. Such models, typically referred to as foundation models (FMs), are trained on extensive corpora of unlabeled data and demonstrate high performance across various tasks. FMs have recently received extensive attention from academic, industry, and regulatory bodies. Given the potentially transformative impact that FMs can have on the field of radiology, radiologists must be aware of potential pathways to train these radiology-specific FMs, including understanding both the benefits and challenges. Thus, this review aims to explain the fundamental concepts and terms of FMs in radiology, with a specific focus on the requirements of training data, model training paradigms, model capabilities, and evaluation strategies. Overall, the goal of this review is to unify technical advances and clinical needs for safe and responsible training of FMs in radiology to ultimately benefit patients, providers, and radiologists.
More Related Videos
Related Concept Videos
Radiological Investigation I: X-ray and CT
X-ray Imaging
Positron Emission Tomography
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
Imaging Studies I: CT and MRI
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
Computed Tomography
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
Imaging Studies for Cardiovascular System III: X-Ray
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...


