Related Experiment Video
Updated: Oct 28, 2026

Multi-modal Pulmonary Imaging: Using Complementary Information from CT and Hyperpolarized 129Xe MRI to Evaluate Lung Structure-Function
Published on: April 12, 2024
MedVersa: A Generalist Foundation Model for Diverse Medical Imaging Tasks
Hong-Yu Zhou1,2, Julián Nicolás Acosta1, Subathra Adithan3
1Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.
Background:
Current medical artificial intelligence (AI) systems are often limited to narrow, task-specific applications, which constrains their impact on routine clinical care. Generalist models that can learn from multimodal inputs and produce flexible outputs across imaging workflows may better support scalable, real-world deployment.
Methods:
We developed MedVersa, a generalist foundation model trained on tens of millions of compiled medical instances from diverse imaging scenarios. MedVersa is designed to accept heterogeneous inputs, including images and clinical text, and generate outputs such as classifications, segmentations, and narrative reports. We evaluated MedVersa on nine medical imaging tasks against leading task-specialized systems, and we conducted blinded radiologist assessments of AI-generated and human-written reports, as well as prospective user studies measuring report-writing time and discrepancy rates.
Results:
Across tasks, MedVersa achieved performance that was competitive with or exceeded that of specialist systems. In blinded evaluations of chest radiograph reports, radiologists judged AI-generated and human-written reports to be clinically equivalent in 64% of all cases, with equivalence rising to 91% for normal studies. In user studies, the use of MedVersa was associated with notable reductions in report writing time and clinically relevant discrepancies compared with standard reporting workflows.
Conclusions:
MedVersa demonstrates that a single, flexible, multimodal foundation model can match or surpass task-specialized medical imaging systems while supporting radiologist efficiency and consistency. These findings highlight the potential of generalist multimodal AI systems to advance AI-enabled medical imaging workflows and augment clinical expertise.
Related Concept Videos
Imaging Studies I: CT and MRI
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
Imaging Studies III: Computed Tomography
Radiological Investigation II: MRI and Ventilation Perfusion Scan
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
Computed Tomography
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
Radiological Investigation I: X-ray and CT
Magnetic Resonance Imaging