在眼科专业考试中使用ChatGPT-4o语言模型的性能
Barbara Sławińska1, Dawid Jasiński2, Aleksander Jaworski3
1Department of Medicine, Specialist Medical Center in Polanica-Zdrój Named After St. John Paul II, Polanica-Zdrój, POL.
Cureus
|September 2, 2025
概括
在眼科专家考试中,ChatGPT-4o的准确率达到了78.3%,证明了AI在医学教育中的潜力. 它的信心水平与答案正确性相关,表明对评估AI响应可靠性的实用性.
科学领域:
- 医学教育
- 人工智能
- 眼科 眼科
背景情况:
- 像ChatGPT这样的人工智能语言模型在医学教育和知识评估中越来越重要.
- 之前的研究表明人工智能在医疗执照考试中的有效性,促使对其在专业培训中的作用进行调查.
- 这项研究探讨了人工智能在医疗专家培训过程中越来越有用的工具.
研究的目的:
- 评估波兰国家眼科专业考试 (PES) 的ChatGPT-4o模型的性能.
- 评估ChatGPT-4o的答案的准确性及其声明的信任度.
- 确定人工智能在眼科专家培训中的潜在教育用处.
主要方法:
- 该研究使用了官方的2024年春季PES眼科考试,包括120个多选题.
- 聊天GPT-4o提供了波兰语的考试规则和问题.
- 对医疗教育中心 (CEM) 密钥进行了验证,并分析了答案准确度 (1-5). 统计分析包括基平方和曼-惠特尼U测试.
主要成果:
- 聊天GPT-4o正确回答了94个问题 (78.3%),超过了通过分数.
- 在临床和理论问题之间没有发现显著的准确性差异 (p = 0. 709).
- 更高的信心水平与正确答案有显著的关联 (p < 0. 001),表明可靠的自我评估.
结论:
- ChatGPT-4o在眼科PES中表现出高效,强调了AI在专业医疗培训中的潜力.
- 模型的信任度可以作为响应准确性的重要指标.
- 进一步的研究和专家监督对于将人工智能纳入医学教育至关重要.
相关概念视频
Glaucoma: Overview
745
Glaucoma is an eye condition characterized by increased intraocular pressure that damages the retina and optic nerve, leading to irreversible blindness if left untreated. The human eye has various components, including the cornea, iris, pupil, lens, and optic nerve. Aqueous humor is secreted by the epithelium of the ciliary body in the posterior chamber and flows through the trabecular meshwork and canal of Schlemm, maintaining normal intraocular pressure. The trabecular meshwork and the canal...
745
Open Angle Glaucoma: Treatment
557
In open-angle glaucoma, the iridocorneal angle remains open, but the trabecular meshwork becomes stiff, slowing down the outflow of aqueous humor. This causes a buildup of aqueous humor in the anterior chamber, leading to a sudden increase in intraocular pressure. The treatment for open-angle glaucoma focuses on reducing the elevated intraocular pressure by either decreasing the secretion of aqueous humor or increasing its outflow.
Drugs such as carbonic anhydrase inhibitors, α2- and...
Drugs such as carbonic anhydrase inhibitors, α2- and...
557
Angle Closure Glaucoma: Treatment
669
Angle-closure glaucoma, or closed-angle glaucoma, is an eye condition where the iris bulges out and blocks the iridocorneal angle, resulting in a buildup of aqueous humor and increased intraocular pressure. Immediate medical attention is necessary due to the sudden onset of symptoms. The treatment for angle-closure glaucoma includes short-term and long-term approaches. Short-term treatment involves using eye drops like pilocarpine to lower intraocular pressure by increasing aqueous humor...
669


