与眼科指南相比,大型语言模型提供了不一致的信息.
Andrea Taloni1,2,3,4, Antonia Carmen Sangregorio4, Giuseppe Alessio4
1Department of Translational Medicine, University of Ferrara, Ferrara, Italy.
Scientific reports
|July 2, 2025
概括
大型语言模型 (LLM) 显示与眼科指南的高度一致,但不一致的答案可能会危害患者. 需要进一步评估,以确保人工智能在医学中的安全临床整合.
科学领域:
- 眼科医生 眼科 眼科
- 人工智能的人工智能
- 医疗信息学 医疗信息学
背景情况:
- 美国眼科学会 (AAO) 制定了眼科的优先实践模式 (PPP) 准则.
- 大型语言模型 (LLM) 在医疗保健中越来越多地使用,需要评估它们是否遵守临床指南.
研究的目的:
- 评估五个领先的LLM与AAO PPP指导方针的响应一致性.
- 识别与LLM生成的眼科信息相关的潜在风险.
主要方法:
- 五个LLM (GPT-4o,GPT-o1,Claude 3.5 Sonnet,Gemini 1.5 Pro,DeepSeek-R1-Lite-Preview) 使用基于AAO PPP的开放式问题进行了查询.
- 三名盲目的调查人员评估了LLM的响应与指导方针的一致性.
- 评估了不一致答案的危害潜力,并注意到了文章引用.
主要成果:
- 一致率各不相同,克劳德3.5索内特 (92.5%) 和GPT-o1 (91.8%) 的一致率最高.
- 双子座1.5 Pro和DeepSeek-R1-Lite-Preview显示了更高的潜在有害的不一致答案率.
- 通过更多的引用引用,Gemini 1.5 Pro表现出卓越的透明度.
结论:
- 虽然LLM通常与眼科指南保持一致,但不一致的反应可能会对患者造成伤害.
- 潜在的危害包括延迟诊断和非最佳治疗建议.
- 持续的研究和仔细的实施对于在临床眼科中安全地整合人工智能至关重要.
相关概念视频
Glaucoma: Overview
782
Glaucoma is an eye condition characterized by increased intraocular pressure that damages the retina and optic nerve, leading to irreversible blindness if left untreated. The human eye has various components, including the cornea, iris, pupil, lens, and optic nerve. Aqueous humor is secreted by the epithelium of the ciliary body in the posterior chamber and flows through the trabecular meshwork and canal of Schlemm, maintaining normal intraocular pressure. The trabecular meshwork and the canal...
782
Open Angle Glaucoma: Treatment
586
In open-angle glaucoma, the iridocorneal angle remains open, but the trabecular meshwork becomes stiff, slowing down the outflow of aqueous humor. This causes a buildup of aqueous humor in the anterior chamber, leading to a sudden increase in intraocular pressure. The treatment for open-angle glaucoma focuses on reducing the elevated intraocular pressure by either decreasing the secretion of aqueous humor or increasing its outflow.
Drugs such as carbonic anhydrase inhibitors, α2- and...
Drugs such as carbonic anhydrase inhibitors, α2- and...
586
Angle Closure Glaucoma: Treatment
705
Angle-closure glaucoma, or closed-angle glaucoma, is an eye condition where the iris bulges out and blocks the iridocorneal angle, resulting in a buildup of aqueous humor and increased intraocular pressure. Immediate medical attention is necessary due to the sudden onset of symptoms. The treatment for angle-closure glaucoma includes short-term and long-term approaches. Short-term treatment involves using eye drops like pilocarpine to lower intraocular pressure by increasing aqueous humor...
705
Accessory Structures of the Eye
1.9K
Optical perception, or vision, is an extraordinary sense dependent on converting light signals received via the ocular organs. These organs, known as eyes, are securely positioned within the bony cavities of the skull, called orbits. The orbits serve a dual purpose: a protective shield for the ocular globes and a stable attachment point for the soft ocular tissues. The eye's external protective mechanisms include the eyelids, which are edged with lashes that act as a barrier against foreign...
1.9K


