评估聊天机器人对患者在绿眼病领域的问题的回答
Darren Ngiap Hao Tan1, Yih-Chung Tham2,3,4, Victor Koh1
1Department of Ophthalmology, National University Hospital, Singapore, Singapore.
Frontiers in medicine
|July 25, 2024
概括
聊天GPT在眼中表现出很好的准确性,在自我纠正后显著改善. 这种大型的语言模型对玻璃眼瘤信息有希望,但需要进一步验证.
科学领域:
- 眼科医生 眼科 眼科
- 人工智能的人工智能
- 医疗信息学 医疗信息学
背景情况:
- 公共可用的大型语言模型 (LLM) 正在越来越多地被用于医学应用.
- 评估LLM在特殊医学领域的准确性和安全性至关重要,如玻璃眼.
研究的目的:
- 为了评估ChatGPT的准确性,全面性和安全性,这是一个大型语言模型,在青光眼的子域中.
- 评估自我纠正对LLM答案的影响.
主要方法:
- 在诊断,治疗,手术和紧急情况下策划了24个临床相关的玻璃眼问题.
- 从ChatGPT (GPT-3.5) 的反应被一个由三位绿眼病专家组成的小组评估.
- 表现不佳的响应被提示进行自我纠正并重新评估.
主要成果:
- 专家小组对ChatGPT响应的平均得分为4.0分中的3.29.
- 在24个回答中,有7个 (29.2%) 最初得分为3或以下.
- 自行纠正后,完全准确答案的比例从30.6%增加到57.1% (p=0.026).
结论:
- 像ChatGPT这样的大型语言模型在玻璃眼病领域显示出潜力.
- 在LLMs的自我纠正能力可以显著提高响应质量.
- 进一步的研究和验证是必要的,以临床应用的LLMs在眼.
相关概念视频
Glaucoma: Overview
534
Glaucoma is an eye condition characterized by increased intraocular pressure that damages the retina and optic nerve, leading to irreversible blindness if left untreated. The human eye has various components, including the cornea, iris, pupil, lens, and optic nerve. Aqueous humor is secreted by the epithelium of the ciliary body in the posterior chamber and flows through the trabecular meshwork and canal of Schlemm, maintaining normal intraocular pressure. The trabecular meshwork and the canal...
534
Open Angle Glaucoma: Treatment
422
In open-angle glaucoma, the iridocorneal angle remains open, but the trabecular meshwork becomes stiff, slowing down the outflow of aqueous humor. This causes a buildup of aqueous humor in the anterior chamber, leading to a sudden increase in intraocular pressure. The treatment for open-angle glaucoma focuses on reducing the elevated intraocular pressure by either decreasing the secretion of aqueous humor or increasing its outflow.
Drugs such as carbonic anhydrase inhibitors, α2- and...
Drugs such as carbonic anhydrase inhibitors, α2- and...
422
Angle Closure Glaucoma: Treatment
468
Angle-closure glaucoma, or closed-angle glaucoma, is an eye condition where the iris bulges out and blocks the iridocorneal angle, resulting in a buildup of aqueous humor and increased intraocular pressure. Immediate medical attention is necessary due to the sudden onset of symptoms. The treatment for angle-closure glaucoma includes short-term and long-term approaches. Short-term treatment involves using eye drops like pilocarpine to lower intraocular pressure by increasing aqueous humor...
468


