在精神病学中使用ChatGPT来设计本科医学教育中的脚本一致性测试:混合方法研究研究
Alexandre Hudon1, Barnabé Kiepura1, Myriam Pelletier2
1Department of Psychiatry and Addictology, University of Montreal, Montreal, QC, Canada.
JMIR medical education
|April 10, 2024
概括
像ChatGPT这样的生成人工智能 (AI) 工具可以创建类似于专家制作的脚本对应性测试 (SCT),帮助医学教育. 需要进一步验证以确保人工智能生成的医学学习材料的教育有效性和准确性.
科学领域:
- 医疗教育 技术 技术 医学教育
- 医疗保健中的人工智能
- 临床推理评估评估
背景情况:
- 本科医学教育使用多种教学方法,包括临床场景和基于问题的评估.
- 脚本一致性测试 (SCT) 对于开发更高级的临床推理技能是有价值的.
- 像ChatGPT这样的生成人工智能为创建教学材料提供了潜力,以支持医学教育工作者.
研究的目的:
- 将人工智能生成的SCT (使用ChatGPT) 与专家创建的SCT进行比较.
- 评估三个关键组成部分:临床情景 (干),临床问题和专家意见.
- 评估医疗教育中人工智能辅助教学材料开发的可行性和质量.
主要方法:
- 一项混合方法研究评估了三个ChatGPT生成的SCT与三个专家创建的SCT.
- 一个预定义的框架被用于评估.
- 临床教育师和精神病学住院医生通过网络调查评估SCT,根据场景,问题和专家意见对其进行评分,并提供定性反.
主要成果:
- 102名受访者评估了SCT,在情景,临床问题或专家意见方面,在AI生成的版本和专家创建的版本之间没有显著差异.
- 受访者很难区分ChatGPT生成的SCT和专家生成的SCT.
- 聊天GPT展示了有效的SCT设计的潜力,与诊断标准保持一致,尽管场景可能是简单的或漫画化的.
结论:
- 这项研究是第一个在医疗技术快速发展的领域中检查AI支持的SCT设计.
- 聊天GPT显示作为一个工具生成医学教育材料的承诺.
- 进一步的研究和验证至关重要,以确认AI产生的医学培训内容的教育有效性和准确性.
关键词:
聊天GPT 聊天 在GPT 聊天准确度 准确度 准确度 准确度人工智能的人工智能是人工智能.临床问题 临床问题一致性脚本的脚本是一致性的脚本.设计 设计 设计 设计教育教育教育教育的教育.教育教育教育教育的教育.教育工作者教育工作者评价 评价 评价 评价学习学习学习学习学习学习机器学习是机器学习.医学教育 医学教育医学学习者 医学学习者精神病学是一种精神病学.支持支持支持支持支持教学教学教学教学教学教学教学教学教学教学工具 工具 工具 工具验证验证的时间更多相关视频
04:19A Computer-Based Platform for Aiding Clinicians in Eating Disorder Analysis and Diagnosis
Published on: May 10, 2022
3.8K
07:02A Computerized Test Battery to Study Pharmacodynamic Effects on the Central Nervous System of Cholinergic Drugs in Early Phase Drug Development
Published on: February 11, 2019
9.8K
相关概念视频
02:10Social Scripts
9.4K
People tend to know what behavior is expected of them in specific, familiar settings. A script is a person’s knowledge about the sequence of events expected in a specific setting (Schank & Abelson, 1977). Essentially, scripts are a particular kind of schema, one containing default values for the features within an event. In the restaurant example, the script's features include the props (e.g., tables, menu, food, and money), the roles to be played (e.g., customer and waiter),...
9.4K
01:17Cochran's Q Test
312
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
312
01:29Assessment of the Gastrointestinal System II: Health Perception Pattern
107
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
107