Related Experiment Video
Updated: Apr 23, 2026
High-Resolution Cardiac Positron Emission Tomography/Computed Tomography for Small Animals
Published on: December 16, 2022
Comparative evaluation of large language models for generating CAD-RADS 2.0-compliant diagnostic conclusions in
Giovanni Lorusso1, Giorgio Ruscino1, Alessia Spitaleri2
1Interdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari "Aldo Moro", Bari, Italy.
Objectives:
Coronary computed tomography angiography (CCTA) has become a cornerstone in non-invasive CAD diagnosis and risk stratification. To standardize reporting and improve clinical decision-making, the CAD-RADS 2.0 system was introduced. This study evaluates the performance of four LLMs, GPT-4o, Gemini 2.0 Flash, DeepSeek V, and Copilot in generating CAD-RADS 2.0-compliant conclusions from standardized CCTA reports.
Materials And Methods:
A total of 196 anonymized CCTA reports were retrospectively analyzed. Each LLM was prompted to provide CAD-RADS 2.0 classifications and follow-up recommendations. Ground truth labels were assigned by a senior radiologist. Performance metrics (accuracy, precision, recall, F1-score), execution times, and agreement (Cohen's kappa) with expert interpretation were computed. Interobserver agreement between junior and senior radiologists was also assessed.
Results:
LLMs demonstrated good-to-excellent agreement with expert classifications: DeepSeek V (κ = 0.771), Copilot (κ = 0.761), GPT-4o (κ = 0.759), and Gemini 2.0 Flash (κ = 0.634). DeepSeek V achieved the highest accuracy (91.83%). Intra-model consistency was perfect (κ = 1). However, LLMs failed to assign CAD-RADS modifiers. ChatGPT-4o provided the most accurate follow-up recommendations (71.94%). All LLMs outperformed radiologists in execution time (3-9 s vs. 15-20 s; p < 0.05).
Conclusions:
Generic LLMs demonstrate promising performance in automating CAD-RADS 2.0 classification from CCTA reports. However, limitations in modifier assignment and recommendation accuracy highlight areas for refinement before clinical integration.
Critical Relevance Statement:
This study explores the potential of large language models to facilitate standardized CAD-RADS 2.0 reporting from coronary CT angiography, highlighting a possible avenue to support workflow efficiency and clinical decision-making in non-invasive coronary artery disease evaluation.
Key Points:
LLMs demonstrated strong potential in automating CAD-RADS 2.0-compliant structured reporting for CCTA. LLMs could significantly enhance efficiency in radiological reporting. LLMs need further optimization before clinical integration.
More Related Videos
05:32Retrospective Cardiac Gating with A Prototype Small-Animal X-ray Computed Tomograph
Published on: February 21, 2025
12:15Tissue Preparation Techniques for Contrast-Enhanced Micro Computed Tomography Imaging of Large Mammalian Cardiac Models with Chronic Disease
Published on: February 8, 2022
Related Concept Videos
01:28Imaging Studies for Cardiovascular System V: CT
01:20Imaging Studies for Cardiovascular System III: X-Ray
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...
01:25Imaging Studies for Cardiovascular System VI: Calcium -Scoring CT
01:10Computed Tomography
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...