聊天GPT 3.5比耳鼻喉科的学员更聪明吗? 一项对董事会风格考试问题的比较研究
Jaimin Patel1, Peyton Robinson2, Elisa Illing1
1Department of Otolaryngology-Head and Neck Surgery, Indiana University School of Medicine, Indianapolis, IN, United States of America.
PloS one
|September 26, 2024
概括
人工智能 (AI) 平台ChatGPT在耳鼻喉科董事会考试中表现优于初级医学学员. 然而,ChatGPT并没有超过更高层次的实习生,这表明其当前形式的临床实用性有限.
科学领域:
- 医学教育 医学教育
- 人工智能在医学中的应用
- 耳鼻喉科 耳鼻喉科 耳鼻喉科
背景情况:
- 人工智能 (AI) 在医学教育和实践中的整合正在迅速发展.
- 评估像ChatGPT这样的人工智能平台与人类专业知识的能力对于理解它们的潜在角色至关重要.
研究的目的:
- 为了比较ChatGPT (3.5版本) 与不同教育水平的耳鼻喉学学员在板式考试问题上的表现.
- 评估实习生的教育水平与他们与ChatGPT相对的表现之间的关系.
主要方法:
- 对31名医学学生 (MS) 和17名耳鼻喉科住院医生 (OR) 进行了一组30个耳鼻喉科董事会式问题.
- 聊天GPT (3.5版本) 完成了相同的测试五次.
- 使用单向ANOVA与Tukey Post Hoc测试和回归分析进行了性能比较.
主要成果:
- 平均得分从MS1逐渐增加到PGY5.5.
- 聊天GPT的表现优于MS1,MS2和MS3的实习生 (p < 0.001到0.019).
- PGY4和PGY5居民的表现明显优于ChatGPT (分别为p=0.033和0.002),而MS4,PGY1,PGY2和PGY3学员的表现没有显著差异.
结论:
- 聊天GPT在耳鼻喉科董事会式问题上表现出熟练,超过初级学员.
- 与ChatGPT相比,更高层次的实习生拥有更好的知识和应用技能,特别是在复杂的医学推理中.
- 目前的人工智能模型,如ChatGPT,对于耳鼻喉科医生来说可能具有有限的临床实用性,因为需要超越背诵的先进临床判断.
相关概念视频
Intelligence
The term "intelligence" is complex because it refers to both behavior and individuals, and its interpretation varies across cultures. European Americans tend to link intelligence with reasoning and cognitive skills, while in Kenya, it is tied to responsible participation in family and social life. In Uganda, intelligence is seen as the ability to know the right actions and carry them out effectively, while the Iatmul people of Papua New Guinea associate it with the capacity to remember detailed...
Triarchic Theory of Intelligence
Robert Sternberg's triarchic theory of intelligence posits that intelligence is composed of three distinct but interrelated components: analytical, creative, and practical intelligence.
Self-Report Tests of Personality
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
Halo Effect
The halo effect is a cognitive bias in which an individual's overall impression influences judgments about their specific traits. This psychological phenomenon leads people to associate positive characteristics with those they perceive as generally good and negative characteristics with those they view as bad. This effect is particularly influential in social perception, professional evaluations, and decision-making processes.The Psychological Basis of the Halo EffectThe halo effect is rooted...


