语言模型对生物医学基准标准中的药物名称具有惊人的脆弱性
Jack Gallifant1, Shan Chen2,3,4, Pedro Moreira1,5
1MIT.
概括
大型语言模型 (LLM) 显示,当品牌药物被通用名称取代时,医疗问题答案任务的性能下降. 训练前数据集中的测试数据污染可能解释了这种脆弱性.
科学领域:
- 人工智能的人工智能
- 医疗信息学 医疗信息学
- 自然语言处理自然语言处理.
背景情况:
- 医学知识依赖于上下文,需要在自然语言的语义变化中进行一致的推理.
- 患者沟通往往使用品牌药物 (如Advil,Tylenol),而不是通用药物,这对医疗AI构成了挑战.
- 评估医疗AI对这些变异的稳定性对于可靠的临床应用至关重要.
研究的目的:
- 创建一个新的稳定性数据集,RABBITS,用于评估医学基准上的LLM绩效.
- 评估替代品牌和仿制药名称对LLM准确性的影响.
- 确定医疗LLMs性能下降的潜在原因.
主要方法:
- 开发了RABBITS数据集,用于品牌通用药物名称替代的医生专家注释.
- 评估了基于开源和API的大型语言模型 (LLM) 的医疗问答数据集 (MedQA,MedMCQA).
- 在药物名称替代之前和之后分析了性能差异.
主要成果:
- 在药物名称交换后,在LLM中观察到1-10%的持续性绩效下降.
- 开源和基于API的LLM都表现出这种脆弱性.
- 分析表明,前培训数据集中的潜在测试数据污染是导致因素.
结论:
- 由于药物命名的变化,LLM在医疗问题答复任务中表现出脆弱性.
- 子数据集为评估和改善医疗保健中的LLM稳定性提供了宝贵的资源.
- 缓解测试数据污染和增强语境理解对于可靠的医疗AI至关重要.
相关概念视频
Drug Nomenclature
3.0K
During the development of a new pharmaceutical, the manufacturer initially assigns a code name to the drug. Once approved, the drug receives a United States Adopted Name (USAN)—a generic, nonproprietary designation. Upon being listed in the United States Pharmacopeia, this nonproprietary name becomes the drug's official name. Additionally, the manufacturer assigns a proprietary name or trademark, which serves as the brand name under which the drug is marketed. It is worth noting that...
3.0K
Pharmacokinetic Models: Overview
1.8K
Pharmacokinetic models utilize mathematical analysis to achieve a detailed quantitative understanding of a drug's life cycle within the body. They are instrumental in simulating a drug's pharmacokinetic parameters, predicting drug concentrations over time, optimizing dosage regimens, linking concentrations with pharmacologic activity, and estimating potential toxicity.
There are three primary types of models: empirical, compartment, and physiological. Empirical models, with minimal...
There are three primary types of models: empirical, compartment, and physiological. Empirical models, with minimal...
1.8K
Drug Discovery: Overview
10.9K
Drug discovery is a multifaceted process involving extensive screening, testing, and optimization of lead compounds to identify potential new drugs for therapeutic use. It combines several approaches, including screening large numbers of natural products, chemical modification of known active molecules, identification of new drug targets, and rational design based on biological mechanisms and drug-receptor structure. These approaches are carried out in both academic research laboratories and...
10.9K
Drug Biotransformation: Overview
3.5K
Pharmaceutical substances known as xenobiotics are predominantly lipophilic and nonionized. This enables them to permeate lipid bilayers, such as cell membranes, and interact with intracellular target receptors. Lipophilic drugs have an advantage in crossing biological barriers and reaching their intended sites of action. However, lipophilic drugs often have a restricted capacity for renal expulsion or elimination from the body. When these drugs enter the kidneys and undergo glomerular...
3.5K
Drug Regulation
2.7K
Drug regulation encompasses the management of drug usage by evaluating its safety and efficacy through assessments conducted by regulatory authorities. Regrettably, the history of drug regulation is marred by several catastrophic events. One such incident is the Elixir Sulfanilamide tragedy, in which the toxic compound diethyl glycol was included in a sweet-tasting medication, leading to numerous fatalities. This event prompted the enactment of the Food, Drug, and Cosmetic Act in 1938. Under...
2.7K
Prescription, Nonprescription and Orphan Drugs
1.1K
Prescription drugs require a prescription from a medical practitioner and can only be obtained from a pharmacy. They have many applications, including treating pain, anxiety, and hypertension.
The misuse and addiction to prescription drugs is a growing problem that can affect people of all age groups, specifically teenagers. This can happen when prescription medications are used in ways not intended by the prescriber, such as taking someone else's prescription or using medication for...
The misuse and addiction to prescription drugs is a growing problem that can affect people of all age groups, specifically teenagers. This can happen when prescription medications are used in ways not intended by the prescriber, such as taking someone else's prescription or using medication for...
1.1K


