对GPT-4在制造药学教育中有效考试项目的有效性的探索性评估
Benjamin Shultz1, Robert J DiDomenico1, Kristen Goliak1
1University of Illinois Chicago, Retzky College of Pharmacy, Chicago, IL, USA.
American journal of pharmaceutical education
|April 17, 2025
概括
GPT-4显示出产生药学考试问题的潜力,但需要大量的专家审查和验证. 需要进一步的研究来完善AI驱动的教育使用评估工具.
科学领域:
- 药房 教育 教育 药房 教育
- 人工智能在评估中的作用
- 教育测量教育的测量
背景情况:
- 在药学教育中创建高风险评估的传统方法是耗时的.
- 整合人工智能 (AI) 工具,如GPT-4,为高效的项目生成提供了一个潜在的解决方案.
研究的目的:
- 评估GPT-4在制造有效的药学学生治疗知识的多选题考试项目中的有效性.
- 评估人工智能生成的评估项目的心理测量属性.
主要方法:
- 一个GPT应用程序从药物治疗教科书中生成了60个基于案例的项目.
- 主题专家审查了有效性,难度和质量的项目.
- 对46名药学学生进行了38个问题的考试,并使用经典测试理论和拉什分析进行了心理测量分析.
主要成果:
- 在60个生成项目中,38个项目符合内容有效性标准,只有6个项目在没有修订的情况下被接受.
- 该检查显示中等可靠性,与之前的治疗检查相关.
- 项目分析表明问题难以定位和潜在的多维性.
结论:
- GPT-4是生成药房考试内容的初步工具,但有限制,需要进一步验证.
- 显著的人类监督和心理测量评估对于临床现实主义和适当的难度至关重要.
- 需要与更大的队列进行未来的研究,以确认AI在高风险的药房评估中的作用.
相关概念视频
Reliability and Validity
12.6K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.6K
Self-Report Tests of Personality
274
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
274
Assessment of the Gastrointestinal System I: Subjective Data
127
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
127
Pulmonary Function Tests
269
Pulmonary Function Tests (PFTs)
Pulmonary Function Tests are crucial diagnostic tools for assessing respiratory function, particularly in patients with chronic respiratory disorders. They comprehensively evaluate lung volumes, ventilatory function, breathing mechanics, diffusion, and gas exchange. These tests help diagnose pulmonary diseases and play a significant role in monitoring disease progression, evaluating disability, and assessing response to therapy.
PFTs involve using a spirometer, a...
Pulmonary Function Tests are crucial diagnostic tools for assessing respiratory function, particularly in patients with chronic respiratory disorders. They comprehensively evaluate lung volumes, ventilatory function, breathing mechanics, diffusion, and gas exchange. These tests help diagnose pulmonary diseases and play a significant role in monitoring disease progression, evaluating disability, and assessing response to therapy.
PFTs involve using a spirometer, a...
269
Preclinical Development: Overview
4.1K
Preclinical development consists of a series of tests that ensure the safety and efficacy of a new therapeutic compound before it is tested in humans. There are four main phases to this process. First, safety pharmacology tests are conducted to ensure the drug does not produce any acutely harmful effects. These tests examine parameters such as bronchoconstriction, cardiac dysrhythmias, blood pressure changes, and ataxia. Next, preliminary toxicological testing is performed to determine the...
4.1K


