多式联网大型语言模型在放射学测试案例中的诊断性能:即时工程和输入条件的影响
Taewon Han1, Woo Kyoung Jeong1, Jaeseung Shin1
1Department of Radiology and Center for Imaging Sciences, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea.
克劳德3.5索内特在放射图像的诊断准确度方面领先,表现优于GPT-4o和Gemini-1.5-Pro. 人工智能生成的提示和描述性文本显著改善了大型语言模型 (LLM) 的性能.
科学领域:
- 医疗成像中的人工智能
- 放射学 人工智能 诊断 诊断
- 医疗保健中的机器学习
背景情况:
- 多模式大语言模型 (LLM) 显示了医学图像解释的潜力.
- 评估LLM诊断准确性需要严格的测试,使用各种输入和提示.
- 快速工程显著影响LLM在复杂任务中的性能.
研究的目的:
- 评估三种领先的多式LLM (Claude 3.5 Sonnet,GPT-4o,Gemini-1.5-Pro) 在放射图像解释中的诊断准确性.
- 评估不同快速工程策略对LLM诊断性能的影响.
- 确定输入条件 (仅成像与带有描述文本的成像) 对诊断准确性的影响.
主要方法:
- 分析了67个来自韩国医学超声波协会的放射性测试案例.
- 测试了三个多式联络LLM (Claude 3.5 Sonnet,GPT-4o,Gemini-1.5-Pro) 的六种提示类型,包括人工智能生成的提示.
- 仅使用成像对结合成像和描述性文本输入的诊断准确性的比较.
主要成果:
- 克劳德3.5索内特实现了最高的仅成像精度 (46.3%),其次是GPT-4o (43.5%) 和Gemini-1.5-Pro (39.8%).
- 与基本提示相比,人工智能生成的提示在所有模型中提高了整体准确性.
- 整合描述性文本显著提高了所有测试的LLM的诊断准确性 (例如,克劳德3.5索内特从46.3%增加到66.2%).
结论:
- 克劳德 3.5 索内特在这个放射学测试数据集中表现出卓越的诊断准确性.
- 人工智能生成的提示和包含描述性文本是提高放射学LLM绩效的有效策略.
- 进一步的研究是有必要的,以优化在临床诊断设置LLM应用.
更多相关视频
05:56Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application
Published on: April 14, 2023
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
相关概念视频
Radiological Investigation II: MRI and Ventilation Perfusion Scan
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
Radiological Investigation III: Pulmonary Angiogram and PET Scan
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Positron Emission Tomography
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
Radiological Investigation I: X-ray and CT
Imaging Studies I: CT and MRI
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
Imaging Studies III: Gastrointestinal Motility Studies and Virtual Colonoscopy
Radionuclide Testing
Radionuclide testing is a sophisticated medical technique for assessing gastrointestinal motility. It focuses on gastric emptying and colonic transit time. Radioactive markers track the movement of food through the digestive system, providing insights into gastrointestinal disorders.
In gastric emptying studies, a meal's liquid and...
