大型语言模型和北美药剂师执照考试 (NAPLEX) 实践问题
Alexa Ehlert1, Benjamin Ehlert2, Binxin Cao1
1University of North Carolina at Chapel Hill, UNC Eshelman School of Pharmacy, Division of Pharmaceutical Outcomes and Policy, Chapel Hill, NC, USA.
American journal of pharmaceutical education
|September 22, 2024
概括
与GPT-3.5和Chatsonic相比,GPT-4在药房执照考试问题上表现出更高的准确性. 这种大型语言模型 (LLM) 显示出药学教育的前景,特别是在药物不良反应 (ADR) 问题上.
科学领域:
- 人工智能在药房教育中的应用
- 医疗保健的自然语言处理.
背景情况:
- 标准化检查对于药房许可至关重要.
- 大型语言模型 (LLM) 越来越能够处理复杂的信息.
- 评估LLM在药学等专业领域的表现是必不可少的.
研究的目的:
- 评估不同LLM在回答药房执照考试实践问题的准确性.
- 在标准化药房测试中比较GPT-3.5,GPT-4和Chatsonic的性能.
主要方法:
- 三个LLM (GPT-3.5,GPT-4,Chatsonic) 在两个实践问题集 (McGraw Hill,RxPrep) 上进行了测试.
- 问题被分类为药物不良反应 (ADR),场景,治疗和选择所有类型.
- 奇二测试用于分析模型和问题类型之间的精度差异.
主要成果:
- GPT-4实现了最高的准确性 (麦格罗山的87%;RxPrep的83.5%).
- 所有模型在选择所有问题上的表现都很差.
- 在ADR问题上,GPT-4的准确性明显高 (96.1%),高于其他类型的问题.
结论:
- 在药房执照考试实践问题上,GPT-4显著超过了GPT-3.5和Chatsonic.
- 士学位,特别是GPT-4,显示了提高药学教育的潜力,特别是在ADRs等领域.
- 对LLM在制药培训中的应用进行进一步的研究是有必要的.
相关概念视频
01:09Clearance Models: Physiological Models
53
Drug clearance is a critical pharmacokinetic process involving the irreversible removal of drugs from the body through various organs over a specified time period. Physiological models are indispensable in determining organ-specific clearance, defined by the proportion of the drug eliminated per unit of time from the organ's blood volume.
The organ's clearance rate depends on the blood flow to the organ and the extraction ratio (E). The extraction ratio describes the organ's...
The organ's clearance rate depends on the blood flow to the organ and the extraction ratio (E). The extraction ratio describes the organ's...
53
01:17Clearance Models: Noncompartmental Models
46
Clearance is a pharmacokinetic parameter traditionally defined by compartment models, signifying the rate at which a drug is expelled from the body. However, a noncompartmental model offers an alternative method for assessing clearance, primarily employing empirical data obtained after administering a single drug dose.
The noncompartmental approach capitalizes on extensive sampling data, correlating the volume of distribution to systemic exposure and the administered dosage. This method enables...
The noncompartmental approach capitalizes on extensive sampling data, correlating the volume of distribution to systemic exposure and the administered dosage. This method enables...
46
01:07Physiological Pharmacokinetic Models: Incorporating Hepatic Transporter-Mediated Clearance
34
Drug transporters are critical in drug absorption, distribution, and excretion processes. They should be included in physiological-based pharmacokinetic (PBPK) models, which help predict human drug disposition. However, predicting this is challenging during drug development, especially when liver transport is involved. However, with a realistic representation of body transport processes, an accurate model may be possible.
A recent model describes pravastatin's hepatobiliary excretion,...
A recent model describes pravastatin's hepatobiliary excretion,...
34
01:29Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
45
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
45
00:59Model-Independent Approaches for Pharmacokinetic Data: Noncompartmental Analysis
51
Noncompartmental analyses offer an alternative method for describing drug pharmacokinetics without relying on a specific compartmental model. In this approach, the drug's pharmacokinetics are assumed to be linear, with the terminal phase log-linear. This assumption allows for simplified analysis and interpretation of the drug's behavior in the body.
One important characteristic of noncompartmental analyses is that drug exposure increases proportionally with increasing doses. This...
One important characteristic of noncompartmental analyses is that drug exposure increases proportionally with increasing doses. This...
51
01:25Clearance Models: Compartment Models
56
Clearance measures drug elimination from the central compartment, including plasma and highly perfused organs like kidneys and liver. Its calculation varies depending on pharmacokinetic models and administration routes. The one-compartment model, for instance, portrays the pharmacokinetics of polar drugs such as aminoglycoside antibiotics administered intravenously and readily excreted in urine. In this case, clearance is influenced by the terminal rate constant (λz) and the total volume...
56