评估人工智能平台在回答牙多选题方面的有效性:对聊天GPT和谷歌双子语言模型进行比较研究
Amr Ahmed Azhari1, Walaa Magdy Ahmed1, Abdulaziz Alhamadani2
1Department of Restorative Dentistry, Faculty of Dentistry, King Abdulaziz University, Jeddah P.O. Box 80200, Saudi Arabia.
Dentistry journal
|February 26, 2026
概括
与ChatGPT相比,Google Gemini在模拟考试中在回答牙损伤多选题方面表现出更高的准确性. 双子座获得了更高的分数和合格率,突出了其在教育评估中的潜力.
科学领域:
- 教育中的人工智能
- 牙损研究 牙损研究
- 自然语言处理自然语言处理.
背景情况:
- 大型语言模型 (LLM) 显示了教育应用的潜力.
- 在牙科等专业领域评估LLM准确度至关重要.
- 牙腐烂知识评估需要可靠的工具.
研究的目的:
- 为了比较ChatGPT和Google Gemini在回答牙多选题 (MCQ) 的准确性.
- 在各种模拟考试长度中评估LLM绩效.
- 为了确定LLMs对牙科教育评估的可靠性.
主要方法:
- 从已建立的问题库中使用了125个验证的牙损伤MCQ.
- 模拟了7个考试长度 (25-85个问题),每次LLM100次.
- 标准化提示被用于LLM响应,分析平均得分和通过率.
主要成果:
- 谷歌双子在所有考试长度 (p < 0.001) 中显著超过了ChatGPT.
- 双子座始终取得比ChatGPT更高的平均分数和通过率.
- 两种LLM都显示得分随考试时间的变化而变化,但双子座的表现更为稳定.
结论:
- 双子表现出优越的准确性和可靠性比ChatGPT对于牙损伤MCQs.
- 法律学士可能会与复杂的牙科内容作斗争,需要仔细的教育应用.
- 建议对人工智能辅助学习和更广泛的牙科领域评估进行进一步研究.
更多相关视频
05:49Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization
Published on: February 23, 2024
1.6K
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
1.7K
相关概念视频
01:08The Availability Heuristic
7.1K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
7.1K
01:16Non-equilibrium in the Cell
5.5K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
5.5K