在处方安全评估中评估ChatGPT的性能:对人工智能辅助处方的影响
1Trauma and Orthopaedics, Chelsea and Westminster Hospital NHS Foundation Trust, London, GBR.
Cureus
|December 5, 2024
概括
人工智能 (AI) 模型ChatGPT通过了处方安全评估 (PSA),在医疗保健方面表现有前途. 然而,它在数据解释方面的局限性表明,人工智能是一种补充工具,而不是取代人类临床判断.
科学领域:
- 医学教育 医学教育
- 医疗保健中的人工智能
- 临床能力评估临床能力评估
背景情况:
- 人工智能的快速发展需要对医疗保健应用进行评估.
- 处方安全评估 (PSA) 是一个英国标准,用于初级医生处方能力.
研究的目的:
- 评估ChatGPT (GPT-4) 通过PSA测试的能力.
- 分析ChatGPT在不同PSA考试部分的表现.
主要方法:
- 聊天GPT (GPT-4) 在四个官方的PSA实践论文中进行了测试.
- 每篇论文进行了三项独立试验.
- 答案使用官方PSA标记方案进行评估,并计算总和子部分分数.
主要成果:
- 聊天GPT的平均得分从66.33%到85.67%不等,始终超过了可用的通过分数.
- 在"药物不良反应" (87.50%) 和"信息传递" (88.89%) 方面,表现较高.
- 在"数据解释" (44.44%) 中观察到显著的局限性,试验的可变性.
结论:
- 聊天GPT证明了通过PSA的潜力,并在事实上的召回领域表现出色.
- 数据解释的局限性凸显了当前AI在复制复杂临床判断方面的差距.
- 聊天GPT可以支持安全的处方,但尚未取代人类处方者.
更多相关视频
相关概念视频
Pharmacovigilance
773
Post-marketing surveillance is a critical component of pharmaceutical regulation, often uncovering unanticipated adverse drug reactions (ADRs) once a drug is widely used over an extended period.
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
773
Cognitive Enhancers: Cholinesterase Inhibitors and NMDA Receptor Antagonists
96
Cognitive enhancers, also known as "smart drugs," are substances used to enhance memory, mental alertness, and concentration. These can be natural or synthetic and improve cognition in conditions like Alzheimer's disease (AD) and other neurodegenerative diseases. Some common examples include caffeine, amphetamines, methylphenidate, modafinil, arecoline, donepezil, vortioxetine, and piracetam. These enhancers work on the principle of synaptic plasticity and altered circuit function.
96
Issues And Trends In Healthcare Delivery System
5.6K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
5.6K
Direct-Acting Cholinergic Agonists: Therapeutic Uses
689
Direct-acting cholinergic agonists have many therapeutic uses in various medical fields. Choline esters, including acetylcholine, have limited clinical utility due to their non-selectivity and short duration of action. Still, acetylcholine and carbachol are applied topically during ophthalmologic surgery to induce miosis. Pilocarpine, a muscarinic and ganglionic stimulator, effectively treats open-angle glaucoma and alleviates xerostomia and dry mouth caused by radiotherapy or Sjögren...
689
Nonlinear Pharmacokinetics: Dependence of Elimination Half-Life and Dose Clearance
81
The elimination half-life and drug clearance of drugs following nonlinear kinetics can vary with dosage. The Michaelis-Menten parameters and drug concentration influence these factors. As the dose increases, the elimination half-life tends to lengthen, resulting in a reduction in clearance and a disproportionately larger area under the curve. The total clearance can be derived from the Michaelis-Menten equation for drugs following a one-compartment model.
A study on guinea pigs examined the...
A study on guinea pigs examined the...
81
Alzheimer's Disease: Treatment
163
Alzheimer's Disease (AD), a neurodegenerative disorder, is pathologically identified by amyloid plaques and neurofibrillary tangles composed of tau protein. AD pharmacotherapy aims to manage cognitive symptoms, delay disease progression, and treat behavioral symptoms. The treatment is primarily symptomatic and palliative, with no definitive disease-modifying therapy available. Cholinesterase inhibitors, including donepezil (Aricept), rivastigmine (Exelon), and galantamine (Razadyne), are...
163


