人工智能聊天机器人在国家牙科执照考试中的表现
Chad Chan-Chia Lin1,2,3, Jui-Sheng Sun4,5, Chin-Hao Chang6
1School of Dentistry, College of Medicine, National Taiwan University, Taipei, Taiwan.
Journal of dental sciences
|October 3, 2025
概括
像Claude2,ChatGPT3.5和Gemini这样的人工智能 (AI) 聊天机器人在台湾牙科委员会考试中进行了测试. 没有人获得通过分数,这表明AI在基础知识方面表现出色,但在临床推理方面扎.
科学领域:
- 牙科教育 牙科教育
- 人工智能在医学中的应用
- 医学执照考试 医学执照考试
背景情况:
- 台湾牙科委员会考试评估了20个科目中的候选人.
- 考试使用多选项,单个答案的问题.
- 要求的最低通过分数为60%.
研究的目的:
- 评估AI驱动的聊天机器人 (Large Language Models:LLMs) 在台湾牙科考试中的表现.
- 在这些检查中比较ChatGPT3.5,Gemini和Claude2的准确性.
- 评估2021年至2023年的LLM成绩.
主要方法:
- 分析了20个受试者的2699个多选题 (8个基本,12个临床牙科).
- 有图像和表格的排除问题.
- 使用McNemar的测试进行统计分析,并将LLM结果与人类候选人资格率进行比较.
主要成果:
- 克劳德2实现了最高的整体精度 (54.89%),超过了ChatGPT3.5 (49.33%) 和双子座 (44.63%).
- 克劳德2在基本牙科 (59.73%) 和临床牙科 (52.45%),特别是口腔微生物学和牙科公共卫生方面表现出色.
- 没有一个LLM达到60%的合格门.
结论:
- 人工智能聊天机器人展示了基本牙科知识的优势.
- 目前的LLM在牙科执照所需的临床推理方面存在局限性.
- 人工智能需要进一步发展,以满足专业牙科检查标准.
相关概念视频
Non-equilibrium in the Cell
5.3K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
5.3K
Assessment of the Mouth
1.1K
A thorough mouth assessment, including inspection and palpation of the lips, gums, tongue, tonsils, uvula, and pharynx, is crucial in detecting potential health issues. Diseases ranging from oral cancer to systemic conditions like diabetes could be identified early through careful oral examination. This article provides a detailed guide on conducting a comprehensive mouth assessment.
Mouth Inspection
The inspection begins with visually examining the mouth for symmetry, color, and size.
Mouth Inspection
The inspection begins with visually examining the mouth for symmetry, color, and size.
1.1K

