开发大型语言模型来检测在x上的帖子中的不良药物事件
Yu Deng1, Yunzhao Xing1, Jason Quach2
1Data & Statistical Sciences, AbbVie Inc, North Chicago, Illinois, USA.
Journal of biopharmaceutical statistics
|September 20, 2024
概括
大型语言模型 (LLM) 可以有效地从社交媒体数据中识别药物不良事件 (ADEs). 在检测ADEs方面,RoBERTa-large表现出卓越的性能,突出的是LLMs.
科学领域:
- 药监和药物安全 药监和药物安全
- 自然语言处理自然语言处理.
- 计算语言学 计算语言学
背景情况:
- 药物不良事件 (ADEs) 是住院,发病率和死亡率的重要原因.
- 营销后监测对于药物安全至关重要,传统上依靠像FAERS这样的系统.
- 社交媒体提供了丰富的,非结构化的患者数据,以加强药物安全研究.
研究的目的:
- 在社交媒体数据中开发和评估用于自动化药物不良事件 (ADE) 分类的大型语言模型 (LLM).
- 为了比较各种微调的LLM和ChatGPT提示策略用于ADE检测的性能.
- 在社交媒体中识别ADE的关键语言特征.
主要方法:
- 精细调整了几个LLM,包括BERT-base,Bio_ClinicalBERT,RoBERTa和RoBERTa-large在X (以前的Twitter) 数据上的数据.
- 尝试使用ChatGPT的几次提示和微调的ChatGPT模型.
- 使用诸如灵敏度,特异性,PPV,NPV,精度,F1测量和AUC等指标进行全面的模型评估.
主要成果:
- RoBERTa-large获得了0.8的最高F1测量值,超过了其他评估的模型.
- 一个微调的ChatGPT模型实现了值得尊敬的F1测量值0.75.
- 功能重要性分析确定了"退出","干燥","口腔"和""等术语作为ADEs的重要指标.
结论:
- 在营销后药物安全监测中,LLM显示出增加ADE检测的巨大潜力.
- 罗伯特大和微调的ChatGPT模型为ADEs分析社交媒体数据提供了有希望的性能.
- 确定的临床相关特征强调了LLM在理解非结构化文本中的药物安全信号方面的价值.
相关概念视频
Pharmacovigilance
786
Post-marketing surveillance is a critical component of pharmaceutical regulation, often uncovering unanticipated adverse drug reactions (ADRs) once a drug is widely used over an extended period.
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
786
Drug Regulation
1.3K
Drug regulation encompasses the management of drug usage by evaluating its safety and efficacy through assessments conducted by regulatory authorities. Regrettably, the history of drug regulation is marred by several catastrophic events. One such incident is the Elixir Sulfanilamide tragedy, in which the toxic compound diethyl glycol was included in a sweet-tasting medication, leading to numerous fatalities. This event prompted the enactment of the Food, Drug, and Cosmetic Act in 1938. Under...
1.3K
Drug Nomenclature
1.7K
During the development of a new pharmaceutical, the manufacturer initially assigns a code name to the drug. Once approved, the drug receives a United States Adopted Name (USAN)—a generic, nonproprietary designation. Upon being listed in the United States Pharmacopeia, this nonproprietary name becomes the drug's official name. Additionally, the manufacturer assigns a proprietary name or trademark, which serves as the brand name under which the drug is marketed. It is worth noting that...
1.7K
Drug Dependence
988
Medications are typically administered to achieve therapeutic effects. Some drugs can modify an individual's mood and perception, frequently resulting in various enjoyable experiences. However, this can result in drug dependency, a condition marked by continuous drug use despite potential negative consequences. Drug dependency primarily falls into two categories: psychological and physical dependence. Psychological dependence occurs when the pleasurable feelings induced by the drug...
988
Drugs Affecting Neurotransmitter Release or Uptake
994
Certain drugs can affect how neurotransmitters called catecholamines, are released or taken back up in the adrenergic neuron. They can have different effects on the body's sympathetic transmission. Reserpine, a natural compound found in the Rauwolfia shrub, blocks a transporter called vesicular monoamine transporter (VMAT), which leads to a buildup of catecholamines in the cell and reduces sympathetic transmission. Another drug called guanethidine works in multiple ways, including blocking...
994
Drug Discovery: Overview
7.6K
Drug discovery is a multifaceted process involving extensive screening, testing, and optimization of lead compounds to identify potential new drugs for therapeutic use. It combines several approaches, including screening large numbers of natural products, chemical modification of known active molecules, identification of new drug targets, and rational design based on biological mechanisms and drug-receptor structure. These approaches are carried out in both academic research laboratories and...
7.6K


