人工智能可以通过测试吗? 评估聊天机器人在儿科胃肠病学板式问题的得分
Annette G Roberts1,2, Reshma Patel1, Sharmilaa Babu1
1Division of Gastroenterology, Hepatology, and Nutrition Duke University Hospital Durham North Carolina USA.
JPGN reports
|February 16, 2026
概括
像ChatGPT-4o和微软Copilot这样的先进的人工智能聊天机器人证明了通过儿科胃肠病学自我评估的熟练程度. 这些人工智能工具对未来的儿科胃肠道委员会考试准备和表现充满希望.
科学领域:
- 医学教育 医学教育
- 人工智能在医学中的应用
- 儿科胃肠病学 儿科胃肠病学
背景情况:
- 美国儿科学会 (AAP) 儿科审查和教育计划 (PREP) ®胃肠病学 (GI) 自我评估对儿科胃肠病学家和为子专业委员会考试做准备的学员至关重要.
- 虽然人工智能聊天机器人已经在一般医学委员会考试中取得了成功,但它们在专门的儿科胃肠道委员会考试中的表现仍然没有得到评估.
研究的目的:
- 在2022-2024年AAP PREP® GI自我评估中评估微软Copilot,OpenAI ChatGPT-3.5和ChatGPT-4o的性能.
- 确定当前人工智能聊天机器人在通过儿科胃肠道学子专业委员会考试中的潜力.
主要方法:
- 从2022年到2024年,共使用了216个AAP PREP® GI自我评估问题.
- 这些问题被输入了三个人工智能聊天机器人:微软Copilot,OpenAI ChatGPT-3.5和ChatGPT-4o.
- 绩效根据已确定的通过分数 (>65%) 进行评估,并与首次参加测试的人的分数进行比较.
主要成果:
- 在这三年的评估中,OpenAI ChatGPT-4o和微软Copilot的分数均超过65%.
- OpenAI ChatGPT-3.5通过了2023年和2024年的评估,但在2022年的评估中失败了.
- 人工智能聊天机器人在解剖学,运动性和口腔/食道疾病方面表现最强,但在生理学,药理学和肝脏/胃/十二指肠疾病方面表现弱.
结论:
- 先进的AI聊天机器人,特别是OpenAI ChatGPT-4o和微软Copilot,在儿科胃肠道自我评估方面表现出一致的成功.
- 这些发现表明,复杂的人工智能聊天机器人具有在儿科胃肠病学委员会考试中表现良好的能力.
- OpenAI ChatGPT-3.5表现出局限性,突出了不同AI模型之间的性能变化.
相关概念视频
Assessment of the Gastrointestinal System II: Health Perception Pattern
512
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
512
Assessment of the Gastrointestinal System I: Subjective Data
700
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
700

