基于变压器的ADR检测模型:与大型语言模型进行交叉药物验证和比较
Minjung Kim1, Kyoung Eun Kim1, Jae-Hee Kwon1
1College of Pharmacy and Graduate School of Pharmaceutical Sciences, Ewha Womans University, Seoul, Republic of Korea.
Therapeutic advances in drug safety
|December 22, 2025
概括
大型语言模型 (LLM) 在从社交媒体数据中检测药物不良反应 (ADR) 方面明显优于基于变压器的模型. 聊天GPT 4o-mini在关于GLP-1受体激动剂的推文中在识别ADR方面表现出卓越的表现.
科学领域:
- 药监和计算语言学.
- 机器学习在药物安全监测中的应用.
背景情况:
- 药物不良反应 (ADRs) 是关键的安全问题.
- 社交媒体提供了有价值的实时患者数据,但需要先进的处理.
- 自然语言处理 (NLP) 和转移学习是分析非结构化文本的关键.
研究的目的:
- 在关于GLP-1受体激动剂的推特上评估微调ADR分类的变压器模型.
- 将这些模型与最先进的大型语言模型 (LLM) 进行比较.
主要方法:
- 使用ADR数据集微调BERT基础,BERTweet基础和GPT-2模型.
- 在396条提及GLP-1受体激动剂的推特上测试模型.
- 使用F1分数评估性能,并与ChatGPT 4o,ChatGPT 4o-mini和Gemini 2.5 Flash进行比较.
主要成果:
- 在微调变压器模型中,BERTweet-base获得了最高的F1得分 (0.729).
- LLMs表现出卓越的表现,ChatGPT 4o-mini获得了0.948.8的F1得分.
- 在ADR分类中,LLM在微调变压器模型中的表现大大超过了微调变压器模型.
结论:
- 微调的变压器模型显示了在社交媒体上检测ADR的潜力.
- 最先进的LLM,特别是ChatGPT 4o-mini,为药物监督提供了显著改进的功能.
- 在实时药物安全监测方面,LLM是一个强大的进步.
相关概念视频
Pharmacovigilance
1.6K
Post-marketing surveillance is a critical component of pharmaceutical regulation, often uncovering unanticipated adverse drug reactions (ADRs) once a drug is widely used over an extended period.
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
1.6K
Therapeutic Drug Monitoring: Drug Analysis Methods
157
Therapeutic Drug Monitoring (TDM) is a clinical practice that measures specific drug levels in a patient's blood or body tissues to tailor drug therapy effectively. This monitoring is critical for managing drugs with narrow therapeutic indices like digoxin and phenytoin, ensuring they are both safe and effective. For instance, monitoring theophylline levels in asthma patients involves precision and sensitivity to adjust doses according to individual responses to therapy, ensuring efficacy and...
157
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models
223
Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
223

