使用本地大型语言模型提取药物信息
Phillip Richter-Pechanski1, Marvin Seiferling2, Christina Kiriakou3
1Section of Bioinformatics and Systems Cardiology, Klaus Tschira Institute for Integrative Computational Cardiology, Im Neuenheimer Feld 669, 69120 Heidelberg, DE, Germany; Department of Internal Medicine III, University Hospital, Im Neuenheimer Feld 410, 69120 Heidelberg, DE, Germany; German Center for Cardiovascular Research (DZHK) - Partner site Heidelberg/Mannheim, Im Neuenheimer Feld 669, 69120 Heidelberg, DE, Germany; Informatics for Life, Im Neuenheimer Feld 669, 69120 Heidelberg, DE, Germany; Department of Computational Linguistics, Heidelberg University, Im Neuenheimer Feld 325, 69120 Heidelberg, DE, Germany.
精心调整的本地大语言模型 (LLM) 从临床文本中实现了最先进的药物提取,提高了准确性和透明度. 这些模型为现实世界医疗环境提供了高效可靠的解决方案.
科学领域:
- 医疗信息学
- 自然语言处理
- 人工智能
背景情况:
- 从非结构化的临床文本中提取药物信息至关重要,但由于人工的努力和错误,
- 目前的自动化方法面临诸如专业知识需求,时间限制,IT基础设施和透明度需求等限制.
- 生成型大语言模型 (LLM) 和参数高效微调提供了有前途的解决方案.
研究的目的:
- 评估本地LLM用于自动,端到端的药物信息提取.
- 在英语和德语临床数据集上评估微调的LLM的性能.
- 使用可解释性技术提高预测的透明度.
主要方法:
- 使用本地LLM进行命名实体识别和关系提取.
- 使用格式限制指令和自动反管道进行评估.
- 应用了代币级的Shapley值来可视化和量化代币贡献.
主要成果:
- 精心调整的拉玛模型在英语数据上取得了新的最先进的结果,提高了F1得分高达10个百分点. 对于药物不良事件和6 pp. 因为药物原因.
- 拉玛在德国数据集上建立了一个新的基准,比传统方法高出16个百分点. 微型平均F1分数
- OpenBioLLM在结构化输出和经历幻觉方面出现了局限性.
结论:
- 精心调整的本地开源生成LLM超越了当前的药物信息提取方法.
- 这些模型在临床环境中提供了高性能和有限的资源,在英语和德语中都是有效的.
- 沙普利值提高了预测透明度,有助于临床决策.
相关概念视频
Local Anesthetics: Pharmacokinetics
Local Anesthetics: Chemistry and Structure-Activity Relationship
Drug Nomenclature
Local Anesthetics: Mechanism of Action
Local anesthetics are amphiphilic molecules consisting of a hydrophobic aromatic part linked to a hydrophilic group by an ester or amide linkage. They are weak bases and are usually available as salts, which increases their solubility and stability. Once administered, LAs exist in the body either...
Pharmacokinetic Models: Overview
There are three primary types of models: empirical, compartment, and physiological. Empirical models, with minimal...
Local Anesthetics: Common Agents and Their Applications
Cocaine is an ester of benzoic acid and methylecgogine. It is used to anesthetize and vasoconstrict locally. Currently, it is used primarily for topical applications. It is beneficial for surgeries on the upper respiratory tract, providing anesthesia and shrinking the mucosa. Cocaine in the form of cocaine hydrochloride is...


