评估遵守加拿大放射学指南,使用RAG启用的LLM进行偶然肝胆病发现
Nicholas Dietrich1,2, Brett Stubbert3
1Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
概括
检索增强生成 (RAG) 显著改善了大型语言模型 (LLM) 对于肝脏发现的加拿大放射学指南的遵守. 通过RAG增强的LLM为基于证据的临床决策提供了一个有希望的工具.
科学领域:
- 医疗信息学 医疗信息学
- 人工智能在医学中的应用
- 放射学决策支持 放射学决定支持
背景情况:
- 大型语言模型 (LLM) 显示出临床决策支持的潜力.
- 目前的LLM往往缺乏最新的临床指南整合.
- 检索增强生成 (RAG) 提供了一种动态整合外部信息的方法.
研究的目的:
- 评估GPT-4o和o1-miniLLM在遵守加拿大放射学指南方面的表现.
- 评估RAG对附带肝胆病发现的准则遵守的影响.
- 为了将RAG支持的LLM与其非RAG同行进行比较.
主要方法:
- 开发了一个定制的RAG架构,以整合指南建议.
- 用临床病例 (319) 来提示带有和没有RAG的LLMs.
- 分析了准则遵守率,阅读方便性,成绩水平和响应时间.
主要成果:
- RAG显著提高了GPT-4o (81.7%至97.2%) 和o1-mini (79.3%至95.1%) 的坚持率.
- 支持RAG的模型显示阅读方便性更好,分数更低.
- 响应时间随着RAG略有增加,但仍然在临床上可接受.
结论:
- 支持RAG的LLM大大提高了对肝胆病发现的放射学指南的遵守.
- 这种方法有望改善临床环境中的基于证据的护理.
- 在更广泛的临床应用中进一步验证RAG是合理的.
更多相关视频
相关概念视频
Radiological Investigation III: Pulmonary Angiogram and PET Scan
79
Radiological investigations are paramount in the diagnosis and management of various pulmonary diseases. Two essential investigations are the Pulmonary Angiogram and the Positron Emission Tomography (PET) Scan.
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
79
Radiological Investigation I: X-ray and CT
198
Radiological investigations, including X-rays and computed tomography (CT) scans, are critical for diagnosing and evaluating various medical conditions. These imaging techniques provide valuable insights into the body's internal structures, aiding in the detection of abnormalities, assessment of disease progression, and development of treatment strategies. This article delves into two primary radiological investigations, chest X-rays and CT scans, outlining their purpose, procedures, and...
198


