评估聊天GPT在眼科科目式考试问题上的表现:一个元分析
Jiawen Wei1, Xiaoyan Wang1, Mingxue Huang1
1School of Nursing, Southwest Medical University, Luzhou, 646099, Sichuan Province, China.
Journal of medical systems
|July 4, 2025
概括
在眼科董事会式问题上,ChatGPT-4的准确性高于ChatGPT-3.5. 性能因问题类型,语言和主题而异,表明医疗教育中AI改进的领域.
科学领域:
- 人工智能在医学中的应用
- 眼科教育教育 眼科教育
- 自然语言处理自然语言处理.
背景情况:
- 将ChatGPT等人工智能 (AI) 工具集成到医学教育中需要严格的评估.
- 评估AI在回答专业医学检查问题上的准确性,对于理解AI的潜力和局限性至关重要.
研究的目的:
- 审查关于ChatGPT在眼科董事会风格问题中的准确性的经验研究.
- 分析影响准确性的因素,包括GPT版本,问题类型,语言和眼科子话题.
主要方法:
- 在主要的科学数据库中进行了全面的文献搜索,直到2025年3月.
- 数据提取和质量评估由两位独立审查员进行.
- 使用统计软件计算和分析准确率.
主要成果:
- GPT-4的整体精度达到73%,明显高于GPT-3.5的54%.
- 在基于文本 (77%) 的问题上,GPT-4的表现比基于图像 (55%) 的问题更好.
- 眼科主题的准确性各不相同,一般医学 (80%) 最高,临床光学 (55%) 最低.
结论:
- 对于眼科董事会式问题,GPT-4显示了比GPT-3.5更好的准确性.
- 人工智能性能受问题模式 (文本与图像) 和特定医疗领域的影响.
- 需要进一步的研究来增强AI的跨语言能力,并分析医疗应用中的错误模式.
相关概念视频
Glaucoma: Overview
777
Glaucoma is an eye condition characterized by increased intraocular pressure that damages the retina and optic nerve, leading to irreversible blindness if left untreated. The human eye has various components, including the cornea, iris, pupil, lens, and optic nerve. Aqueous humor is secreted by the epithelium of the ciliary body in the posterior chamber and flows through the trabecular meshwork and canal of Schlemm, maintaining normal intraocular pressure. The trabecular meshwork and the canal...
777
Open Angle Glaucoma: Treatment
583
In open-angle glaucoma, the iridocorneal angle remains open, but the trabecular meshwork becomes stiff, slowing down the outflow of aqueous humor. This causes a buildup of aqueous humor in the anterior chamber, leading to a sudden increase in intraocular pressure. The treatment for open-angle glaucoma focuses on reducing the elevated intraocular pressure by either decreasing the secretion of aqueous humor or increasing its outflow.
Drugs such as carbonic anhydrase inhibitors, α2- and...
Drugs such as carbonic anhydrase inhibitors, α2- and...
583
Angle Closure Glaucoma: Treatment
702
Angle-closure glaucoma, or closed-angle glaucoma, is an eye condition where the iris bulges out and blocks the iridocorneal angle, resulting in a buildup of aqueous humor and increased intraocular pressure. Immediate medical attention is necessary due to the sudden onset of symptoms. The treatment for angle-closure glaucoma includes short-term and long-term approaches. Short-term treatment involves using eye drops like pilocarpine to lower intraocular pressure by increasing aqueous humor...
702


