多模式的LLM如何解释CT扫描? 一个自我评估框架用于分析分析
Qingqing Zhu1, Benjamin Hou2,3, Tejas Sudarshan Mathai2
1National Center for Biotechnology Information, National Library of Medicine.
ArXiv
|October 1, 2025
概括
一个新的框架,GPTRadScore,评估AI用于CT扫描解释. 虽然目前的模型显示出有希望的结果,但微调显著提高了准确性,解决了更好的放射学AI的数据限制.
科学领域:
- 医学成像人工智能 医学成像人工智能
- 放射学工作流的优化 工作流的优化
背景情况:
- 自动化的CT扫描解释可以减少放射科医生的工作量.
- 有限的数据集和评估标准阻碍了AI的发展.
研究的目的:
- 介绍GPTRadScore,这是放射学多模式LLM的新型评估框架.
- 在生成CT扫描描述时评估像GPT-4V,Gemini Pro Vision,LLaVA-Med和RadFM这样的AI模型.
主要方法:
- GPTRadScore使用GPT-4进行分解,并将人工智能生成的描述与黄金标准句子进行比较.
- 对身体部位,位置和寻找类型的准确性进行分析.
- 将发布临床医生注释的基准数据集.
主要成果:
- GPTRadScore与临床医生的评估有很高的相关性,表现优于传统指标.
- GPT-4V和双子座Pro Vision显示出潜力,但需要改进训练数据.
- 微调RadFM显著提高了准确性:位置 (3.41%至12.8%),身体部位 (29.12%至53%) 和类型 (9.24%至30%).
结论:
- GPTRadScore为放射学AI提供了一个强大的评估方法.
- 模型性能受到训练数据限制的严重影响.
- 微调证明了一条可行的途径,可以提高医疗图像解释中的AI准确性.
更多相关视频
相关概念视频
Imaging Studies I: CT and MRI
795
Introduction: MRI and CT scans are crucial advancements in medical imaging techniques, playing a vital role in diagnosing conditions related to the gastrointestinal (GI) system. Each scan serves distinct purposes, targets specific areas, and requires unique nursing duties.
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
795
Imaging Studies III: Computed Tomography
284
DefinitionComputed Tomography (CT) of the genitourinary (GU) tract is a non-invasive imaging modality that utilizes X-rays and computer processing to generate detailed cross-sectional images of the urinary system, encompassing the kidneys, ureters, bladder, and adjacent structures such as the adrenal glands.PurposeCT scans of the GU tract serve several diagnostic and therapeutic purposes, including:Diagnosis of Urinary Tract Diseases: Detects kidney stones, tumors, cysts, and congenital...
284
Imaging Studies for Cardiovascular System V: CT
284
Cardiac computed tomography (CT) scanning is an advanced cardiac imaging technique that utilizes CT technology, with or without intravenous (IV) contrast, to produce accurate cross-sectional virtual slices of specific areas of the heart, coronary circulation, and major blood vessels such as the aorta, pulmonary veins, and arteries. The computer processes these slices to generate three-dimensional images. Multidetector CT (MDCT) is a rapid form of CT scanning that captures multiple slices...
284


