流行的大型语言模型聊天机器人的准确性,全面性和自我意识在回答眼部症状查询时
Krithi Pushpanathan1,2, Zhi Wei Lim1, Samantha Min Er Yew1,2
1Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore.
iScience
|November 2, 2023
概括
聊天GPT-4.0在回答眼睛症状问题方面表现强,明显优于其他大型语言模型 (LLM). 虽然LLM是全面的,但在临床自我诊断中需要进一步验证.
科学领域:
- 眼科医生 眼科 眼科
- 人工智能的人工智能
- 医疗信息学 医疗信息学
背景情况:
- 对大语言模型 (LLM) 对健康自我诊断的兴趣日益增长.
- 需要在医疗环境中对LLM绩效进行系统评估.
研究的目的:
- 评估ChatGPT-3.5,ChatGPT-4.0和谷歌巴德的准确性和全面性,以响应眼部症状查询.
- 评估这些LLM聊天机器人的自我意识能力.
主要方法:
- 37个常见的眼部症状调查的系统评估.
- 三位眼科顾问对LLM反应进行了掩盖和随机评估.
- 对准确性 (差,边缘,好) 和全面性 (1-5级) 的评分.
主要成果:
- 聊天GPT-4.0获得了89.2%的"好"评分,明显超过了聊天GPT-3.5 (59.5%) 和谷歌巴德 (40.5%).
- 所有的LLM都表现出高的综合性评分 (4.6-4.7/5).
- 在所有测试的LLMs中,自我意识能力被评为不等于中等.
结论:
- 聊天GPT-4.0显示出提供对眼部症状查询准确和全面的响应的巨大潜力.
- 目前的LLM在自我意识方面存在局限性,需要进一步发展.
- 在临床采用自我诊断之前,严格的验证是必不可少的.
更多相关视频
12:55Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
8.5K
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
241
相关概念视频
Accessory Structures of the Eye
1.6K
Optical perception, or vision, is an extraordinary sense dependent on converting light signals received via the ocular organs. These organs, known as eyes, are securely positioned within the bony cavities of the skull, called orbits. The orbits serve a dual purpose: a protective shield for the ocular globes and a stable attachment point for the soft ocular tissues. The eye's external protective mechanisms include the eyelids, which are edged with lashes that act as a barrier against foreign...
1.6K
Glaucoma: Overview
595
Glaucoma is an eye condition characterized by increased intraocular pressure that damages the retina and optic nerve, leading to irreversible blindness if left untreated. The human eye has various components, including the cornea, iris, pupil, lens, and optic nerve. Aqueous humor is secreted by the epithelium of the ciliary body in the posterior chamber and flows through the trabecular meshwork and canal of Schlemm, maintaining normal intraocular pressure. The trabecular meshwork and the canal...
595
Assessment of Airway, Skin Color, and Use of Accessory Muscles
1.0K
A thorough assessment of respiratory health is paramount in clinical settings to identify and manage respiratory distress and ensure adequate oxygenation. This article elaborates on the critical aspects of respiratory evaluation, including airway assessment, skin color examination, and the observation of accessory muscle use, which are integral to effectively diagnosing and managing patients with respiratory conditions.
Introduction
The initial evaluation of a patient's respiratory system...
Introduction
The initial evaluation of a patient's respiratory system...
1.0K
Therapeutic Communication
4.5K
Communication is a lifelong learning process. Through therapeutic communication, nurses can collect relevant assessment data, provide education and counseling, and interact during nursing interventions. Sending and receiving messages occur through verbal and nonverbal communication techniques and can happen separately or simultaneously.
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
4.5K
Open Angle Glaucoma: Treatment
459
In open-angle glaucoma, the iridocorneal angle remains open, but the trabecular meshwork becomes stiff, slowing down the outflow of aqueous humor. This causes a buildup of aqueous humor in the anterior chamber, leading to a sudden increase in intraocular pressure. The treatment for open-angle glaucoma focuses on reducing the elevated intraocular pressure by either decreasing the secretion of aqueous humor or increasing its outflow.
Drugs such as carbonic anhydrase inhibitors, α2- and...
Drugs such as carbonic anhydrase inhibitors, α2- and...
459
