评估一个定制的大型语言模型 (DELSTAR) 和其解决与妄想相关的药物相关问题的能力:一个定量探索性研究
Katharina Teresa Spagl1, Edward William Watson2, Adam Jatowt3
1Department of Clinical Pharmacy, Institute of Pharmacy, Innsbruck University, Innrain 80, 6020, Innsbruck, Austria.
International journal of clinical pharmacy
|April 10, 2025
概括
一个新的AI工具DELSTAR显示出作为临床药房研究助理的前景,用于预防与药物相关的妄想. 虽然它超过了传统的审查,但需要进一步优化,以获得可靠的数据使用和性能.
科学领域:
- 人工智能在药房中的应用
- 临床药学研究 临床药学研究
- 药物监督 药物监督 药物监督
背景情况:
- 与药物相关的妄想在临床环境中构成了重大挑战.
- 目前用于预防妄想的研究方法缺乏全面的评估策略.
- 大型语言模型 (LLM) 提供了作为高级研究助理的潜力.
研究的目的:
- 开发和评估一个定制的LLM (DELSTAR) 用于临床药房研究妄.
- 评估DELSTAR在解决复杂研究问题的能力,质量和绩效.
- 为医疗保健领域特定的LLM建立一个强大的评估框架.
主要方法:
- 德尔斯特作为质量评估的"定制GPT"和性能测试的Python管道.
- 质量指标包括陈述准确性和数据可信度.
- 性能指标包括F1-Score,灵敏度,特异性,AUC和AUC-ROC曲线,使用封闭和开放的模型.
主要成果:
- 德尔斯塔提供了比传统的系统文献评论更准确和更全面的信息 (p < 0.05).
- 基础模型GPT-3.5和GPT-4o显示出高可靠性;GPT-4o和Llama3-70b在数据集2中领先,GPT-3.5和GPT-4o在数据集3中领先.
- 没有一个单一的模型在所有指标上始终达到所有所需的性能值.
结论:
- 德尔斯塔显示出作为临床药房研究助理的潜力,其表现优于传统的系统文献评论.
- 在利用高质量的数据,引用实践和性能优化方面需要改进.
- GPT-4o,GPT-3.5和Llama3-70b是合适的基础模型,但微调DELSTAR对于提高药物环境中的灵敏度至关重要.
相关概念视频
Drug Therapy
32
The advent of drug therapy has profoundly shaped modern mental health care, providing targeted treatments for a range of psychological disorders. Psychotherapeutic drugs, classified into antianxiety, antidepressant, and antipsychotic medications, address symptoms across anxiety disorders, mood disorders, and schizophrenia. While these medications have transformed patient outcomes, they require careful management due to their potential side effects and limitations.
Antianxiety Medications
Antianxiety Medications
32
Psychosis: Goals of Pharmacotherapy
97
Antipsychotic drugs are a crucial treatment method for acute and chronic psychoses, bipolar illness, and behavioral disorders. The selection of these drugs depends on several factors, including the state of the disease, clinical judgment, possible drug interactions, and the patient's sensitivity to adverse effects. In immediate scenarios, such as delirium and dementia, short-term treatment with low doses of high-potency typical or atypical agents can effectively manage symptom exacerbation.
97
Alzheimer's Disease: Treatment
133
Alzheimer's Disease (AD), a neurodegenerative disorder, is pathologically identified by amyloid plaques and neurofibrillary tangles composed of tau protein. AD pharmacotherapy aims to manage cognitive symptoms, delay disease progression, and treat behavioral symptoms. The treatment is primarily symptomatic and palliative, with no definitive disease-modifying therapy available. Cholinesterase inhibitors, including donepezil (Aricept), rivastigmine (Exelon), and galantamine (Razadyne), are...
133


