生成型人工智能和自然语言处理模型的工程,以准确识别心律失常的复发.
Ruibin Feng1, Kelly A Brennan1, Zahra Azizi1
1Department of Medicine, Stanford University, CA (R.F., K.A.B., Z.A., J.G., B.D., H.J.C., P.G., P.C., M. Pedron, S.R.-C., Y.B.D., H.D.L., T.B., M. V. P, M.R., A.J.R., S.M.N.).
Circulation. Arrhythmia and electrophysiology
|December 16, 2024
概括
快速工程显著提高了大型语言模型 (LLM) 在解释电子健康记录 (EHR) 进行诊断的准确性. 这种技术提高了LLM的性能,而不需要专门的医学知识,使EHR数据更容易获得.
科学领域:
- 人工智能在医学中的应用
- 医疗保健的自然语言处理.
背景情况:
- 大型语言模型 (LLM) 在公共数据方面表现出色,但在电子健康记录 (EHR) 等私人来源方面却很困难.
- 提示工程是一种潜在的方法,可以提高LLM准确性,用于在没有领域专业知识的情况下解释EHR数据.
研究的目的:
- 系统地测试提示工程技术,以提高LLM在解释微妙诊断问题的电子健康记录时的准确性.
- 评估快速工程是否能够使LLM能够以专家级准确度从EHR识别临床终点.
主要方法:
- 在GPT-4-turbo上设计和测试了快速工程策略,使用125名心律障碍患者的490张EHR笔记.
- 将LLM性能与基于规则的NLP和基于BERT的模型进行比较,以识别复发性心律失常.
- 在GPT-3.5-turbo和Jurassic-2 LLMs中验证的发现.
主要成果:
- 现成的GPT-4-turbo精度为64.3%,随着快速工程 (理性,结构化输出,示例) 的使用,精度增加到91.4%.
- 快速设计的LLM性能明显超过了传统的NLP和BERT模型 (P<0.05).
- 在不同的LLM中观察到一致的准确性改进.
结论:
- 快速工程使LLM能够准确地从EHR中识别临床终点,超过NLP方法.
- 法学士准确度近似的专家表现,不需要特定领域的知识.
- 这些快速工程策略可以应用于其他领域,用于非专家的自动化数据分析.
相关概念视频
Mechanism of Cardiac Arrhythmias
886
Arrhythmias are irregular heart rhythms occurring when the heart's electrical impulses become abnormal. These disturbances can lead to various symptoms, depending on their severity and the underlying cause. Some common factors contributing to arrhythmias include hypoxia, ischemia, electrolyte imbalances, excessive catecholamine exposure, drug toxicity, and muscle overstretching. Arrhythmias can be classified into two main types based on the rate and site of origin of abnormal heart rhythms.
886
Disturbances in Heart Rhythm
898
Arrhythmia or dysrhythmia refers to an abnormal heart rhythm caused by a defect in the heart's conduction system. It can cause the heart to beat irregularly, too quickly, or too slowly, leading to symptoms like chest pain, shortness of breath, and fainting. Factors such as stress, caffeine, alcohol, nicotine, cocaine, certain drugs, congenital defects, diseases, and electrolyte abnormalities can trigger arrhythmias.
Arrhythmias are categorized by their speed, rhythm, and origin. A slow...
Arrhythmias are categorized by their speed, rhythm, and origin. A slow...
898
Pulse rhythm
759
Pulse rhythm refers to the pattern of pulsations within specific intervals, offering valuable insights into the regularity or irregularity of the heart's beats as observed through the pattern of pulsation within specific intervals. A regular pulse exhibits a consistent heart rate with uniform waveforms and pulsation force, variations of which can be classified as normal, weak, or bounding.
Conversely, an irregular pulse pattern is termed dysrhythmia, stemming from disruptions in cardiac...
Conversely, an irregular pulse pattern is termed dysrhythmia, stemming from disruptions in cardiac...
759


