EchoLLM:用轻量级,开源的大型语言模型提取回声心电图实体.
Jonathan Chi1, Yazan Rouphail2, Ethan Hillis2
1Goergen Institute for Data Science and Artificial Intelligence, University of Rochester, Rochester, NY 14627, United States.
JAMIA open
|August 14, 2025
概括
开源大型语言模型 (LLM) 显示出从心声回声图报告中提取临床数据的前景. Gemma2:9b-instruct在这个任务中取得了最高的性能,证明了有效的信息提取.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 临床数据提取
背景情况:
- 大型语言模型 (LLM) 在临床信息提取方面比传统方法具有优势.
- 专有LLM带来了与隐私和成本有关的挑战,限制了可访问性.
- 开源的LLM为临床应用提供了可行的替代方案.
研究的目的:
- 评估14个开源大语言模型 (LLM) 来从心声图报告中提取临床相关的发现.
- 评估在临床信息提取工作流程中实施开源LLM的可行性.
- 为了比较不同开源LLM在这个特定任务上的表现.
主要方法:
- 14个开源的LLM模型被用于从507个心声回声图报告中提取实体.
- 报告由医疗保健专业人员手动注释并进行裁决.
- 对9个提取的实体使用精度,回忆和F1分数来衡量性能.
主要成果:
- Gemma2:9b-instruct表现出最高的性能,精度,回忆和F1分数分别为0.973,0.959和0.965.
- 腓3:3.8b-迷你指令的精度最低 (0.831).
- 杰玛:7b-instruct表现出最低的回忆率 (0.382) 和F1得分 (0.392).
结论:
- 开源的LLM可用于从心声回声图报告中提取实体.
- 这种方法可以支持临床研究和医疗保健服务.
- 使用开源模型可促进更高效的计算和数据提取.
相关概念视频
Imaging Studies for Cardiovascular System I:Echocardiography
489
Cardiac imaging studies encompass a wide range of noninvasive and minimally invasive techniques designed to visualize the heart's structure and function in detail. One such technique is echocardiography, which uses high-frequency ultrasound waves to produce detailed images of the heart, known as echocardiograms.
Indications: Echocardiography is utilized to diagnose heart failure, valve disorders, and myocardial infarction. It also assesses cardiac structures' size, shape, and motion,...
Indications: Echocardiography is utilized to diagnose heart failure, valve disorders, and myocardial infarction. It also assesses cardiac structures' size, shape, and motion,...
489
Imaging Studies for Cardiovascular System II:Types of Echocardiography
395
Echocardiography plays a role in assessing cardiac health and detecting heart conditions, with various types providing critical insights for diagnosis and treatment.
Types of Echocardiography
Transthoracic Echocardiography (TTE)
TTE is the most common type of echocardiogram which involves placing a transducer on the patient's chest, emitting sound waves to create heart images. TTE is invaluable for evaluating the heart's size, structure, and motion, making it particularly useful for...
Types of Echocardiography
Transthoracic Echocardiography (TTE)
TTE is the most common type of echocardiogram which involves placing a transducer on the patient's chest, emitting sound waves to create heart images. TTE is invaluable for evaluating the heart's size, structure, and motion, making it particularly useful for...
395


