将一个大型语言模型与以前的深度学习模型对药物不良事件的命名实体识别进行比较
Théophile Tiffet1,2, Alexis Pikaar3, Béatrice Trombert-Paviot1,2
1Public health and medical information unit, Saint Etienne University Hospital, France.
Studies in health technology and informatics
|August 23, 2024
概括
微调深度学习模型改善了对药物不良事件的命名实体识别 (NER),而不是使用大型语言模型进行少量学习. 虽然方便,但几次射击的学习是很方便的.
科学领域:
- 计算语言学计算语言学
- 生物医学信息学是生物医学信息学.
- 人工智能的人工智能是人工智能.
背景情况:
- 深度学习模型在微调大数据集时显著提高命名实体识别 (NER) 性能.
- 大型语言模型 (LLM) 通过带有提示的上下文学习为新任务提供了短暂的学习能力.
- 短暂的学习需要最小的例子,使其适合数据稀缺的场景.
研究的目的:
- 为了比较最先进的深度学习模型的性能,对PubMed摘要进行了微调,与LLM使用药物不良事件 (ADE) 的少数射击学习进行了比较.
- 评估不同机器学习方法在从生物医学文本中识别药物不良事件时的有效性.
主要方法:
- 微调一个最先进的深度学习模型 (Hussain等). 在PubMed摘要的大体上为ADE NER.
- 使用一个大型语言模型 (ChatGPT-3.5),为ADE NER提供少量学习,提供最小的示例和说明.
- 通过这两种方法获得的F1分数的直接比较.
主要成果:
- 微调的深度学习模型实现了显著更高的F1-Score (97.6%) 与使用少数射击学习 (86.0%) 的ChatGPT-3.5模型相比,对于ADE NER.
- 在这个特定的NER任务中,对大量数据的微调产生了优越的性能,而不是少数人学习.
- 短暂的学习证明了便利性,但对ADE识别的准确性较低.
结论:
- 微调具有大量数据的深度学习模型仍然是高性能不良药物事件命名实体识别的优越方法.
- 当培训数据有限时,使用LLM的短暂学习是一种切实可行的替代方案,尽管目前的表现较差.
- 未来的研究应该探索先进的提示技术与新的LLM如GPT-4,并调查微调策略LLM如GPT-3.5.5.
相关概念视频
Pharmacovigilance
795
Post-marketing surveillance is a critical component of pharmaceutical regulation, often uncovering unanticipated adverse drug reactions (ADRs) once a drug is widely used over an extended period.
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
795
Drug Nomenclature
1.7K
During the development of a new pharmaceutical, the manufacturer initially assigns a code name to the drug. Once approved, the drug receives a United States Adopted Name (USAN)—a generic, nonproprietary designation. Upon being listed in the United States Pharmacopeia, this nonproprietary name becomes the drug's official name. Additionally, the manufacturer assigns a proprietary name or trademark, which serves as the brand name under which the drug is marketed. It is worth noting that...
1.7K
Combined Effects of Drugs: Antagonism
8.4K
The combined effects of drugs can result in various interactions, of which an important type is antagonism. Antagonism is a mechanism where one drug inhibits or counteracts the effects of another drug. Antagonism can occur through various means, including receptor binding, allosteric modulation, functional interaction, chemical reactions, and pharmacokinetic processes.
The most common type is receptor antagonism, where one drug acts as an antagonist to block the effects of another drug by...
The most common type is receptor antagonism, where one drug acts as an antagonist to block the effects of another drug by...
8.4K
Combined Effects of Drugs: Synergism
3.8K
Synergism is a useful mechanism where combining two or more drugs is more effective than each constituent used alone. Such combinations are also called supra-additive interactions. The drugs collectively enhance the final therapeutic effect by acting on different targets. Another advantage is that the low dose of each constituent drug is sufficient to achieve the desired effect. This helps reduce the duration of therapy and lower the adverse effects of these drugs.
Such synergistic combinations...
Such synergistic combinations...
3.8K
Drug Regulation
1.3K
Drug regulation encompasses the management of drug usage by evaluating its safety and efficacy through assessments conducted by regulatory authorities. Regrettably, the history of drug regulation is marred by several catastrophic events. One such incident is the Elixir Sulfanilamide tragedy, in which the toxic compound diethyl glycol was included in a sweet-tasting medication, leading to numerous fatalities. This event prompted the enactment of the Food, Drug, and Cosmetic Act in 1938. Under...
1.3K
Drug Discovery: Overview
7.7K
Drug discovery is a multifaceted process involving extensive screening, testing, and optimization of lead compounds to identify potential new drugs for therapeutic use. It combines several approaches, including screening large numbers of natural products, chemical modification of known active molecules, identification of new drug targets, and rational design based on biological mechanisms and drug-receptor structure. These approaches are carried out in both academic research laboratories and...
7.7K


