Related Experiment Video
Updated: Oct 25, 2026

Multimodal Cross-Device and Marker-Free Co-Registration of Preclinical Imaging Modalities
Published on: October 27, 2023
Toward truly agentic radiology AI: A multimodal architecture framework and differentiated implementation roadmap
Tai-Lin Irene Lee1, Vidya Sankar Viswanathan1, Elias G Kikano2
1Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, GA, USA.
Abstract:
Agentic artificial intelligence(AI) represents a structural transition from task-specific tools to autonomous systems capable of goal-oriented, multi-step reasoning. However, translating this potential into radiology requires a fundamental shift from text-dominated architectures to avision-first approachthat engages the specialty's diagnostic core. In this paper, we characterize the multimodal challenge distinguishing radiology from text-centric domains, where high-dimensional images serve as the primary diagnostic substrate rather than supplementary data. We reviewthree image-text coupling architectures, their clinical capabilities, limitations, and deployment feasibility. These include output-level coupling through sequential image-text pipelines, representation-level coupling through contrastive aligned dual encoders, and token-level coupling through generative vision-language models. To guide development, we introduce afive-level taxonomy of autonomy(Levels 1-5), establishing clear validation checkpoints and regulatory expectations for increasing machine independence, from text-based workflow automation to fully autonomous closed-loop systems. We emphasize that interoperability via standardized protocols, includingDICOMweb, HL7-FHIR, Model Context Protocol (MCP), and Agent2Agent (A2A), is as critical as the AI models themselves. Finally, we address critical implementation guardrails, including mitigatingalgorithmic hallucinations, defending againstadversarial prompt injection, and preserving human diagnostic proficiency amidst the risk of AI-induced skill decay. This comprehensive roadmap provides a structured path for integrating autonomous visual reasoning into modern medical imaging environments.
Related Concept Videos
Radiological Investigation I: X-ray and CT
Computed Tomography
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
Radiological Investigation II: MRI and Ventilation Perfusion Scan
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
Radiological Investigation III: Pulmonary Angiogram and PET Scan
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Imaging Studies III: Computed Tomography
Imaging Studies I: CT and MRI
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
