评估人工智能生成的临床总结的准确性,从门诊性玻璃眼子专业的临床遭遇
Yapei Zhang1, Min Shi2, In Young Chung1
1Department of Ophthalmology, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA.
Translational vision science & technology
|January 14, 2026
概括
像LLaMA 2这样的大型语言模型 (LLM) 显示了通过将复杂的玻璃眼病笔记总结成患者友好的语言来改善临床沟通的希望. 虽然尚未完全可靠,但LLMs可以提高患者的理解和健康素养.
科学领域:
- 人工智能在医学中的应用
- 临床信息学 临床信息学
- 眼科医生 眼科 眼科
背景情况:
- 有效的患者沟通对于管理长期疾病,如玻璃眼,至关重要.
- 将复杂的医学术语翻译成可理解的语言可以提高患者的坚持和健康素养.
- 大型语言模型 (LLM) 为标准化患者友好的医疗信息提供了潜在的解决方案.
研究的目的:
- 评估LLaMA 2-70B大语言模型 (LLM) 在总结青光眼临床笔记中的准确性.
- 评估LLM在从医疗记录中生成患者友好的教育材料的能力.
- 为了比较LLaMA 2与ChatGPT-4在类似的总结任务中的性能.
主要方法:
- 随机抽取的147张绿眼病诊所笔记被分析.
- LLaMA 2生成了段落和标题摘要,涵盖了诊断,进展,治疗和干预措施.
- 两位眼科医生审查了摘要的准确性,差异由一位绿眼瘤专家解决.
- 用相同提示与ChatGPT-4进行比较,对50个笔记的子集进行比较.
主要成果:
- 在LLaMA 2中,66%的段落摘要和70%的分字摘要是正确的.
- 具体临床问题的准确度在80% (诊断) 到91% (治疗变化) 之间.
- 与已诊断的患者相比,LLaMA 2对可疑的青光眼患者的准确性更高 (82%对53%).
- 在相同的任务中,ChatGPT-4实现了46%的正确段落摘要和50%的正确分类摘要.
结论:
- LLaMA 2显示了提高眼科临床沟通和患者教育的潜力.
- 虽然还不是一个独立的临床工具,但LLMs可以帮助改善患者对其病情的理解.
- 通过LLM标准化患者友好的语言可能会改善患者的体验和健康素养.
更多相关视频
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
1.3K
07:11Assessing Early Stage Open-Angle Glaucoma in Patients by Isolated-Check Visual Evoked Potential
Published on: May 25, 2020
6.8K
相关概念视频
01:25Glaucoma: Overview
1.2K
Glaucoma is an eye condition characterized by increased intraocular pressure that damages the retina and optic nerve, leading to irreversible blindness if left untreated. The human eye has various components, including the cornea, iris, pupil, lens, and optic nerve. Aqueous humor is secreted by the epithelium of the ciliary body in the posterior chamber and flows through the trabecular meshwork and canal of Schlemm, maintaining normal intraocular pressure. The trabecular meshwork and the canal...
1.2K
01:27Open Angle Glaucoma: Treatment
958
In open-angle glaucoma, the iridocorneal angle remains open, but the trabecular meshwork becomes stiff, slowing down the outflow of aqueous humor. This causes a buildup of aqueous humor in the anterior chamber, leading to a sudden increase in intraocular pressure. The treatment for open-angle glaucoma focuses on reducing the elevated intraocular pressure by either decreasing the secretion of aqueous humor or increasing its outflow.
Drugs such as carbonic anhydrase inhibitors, α2- and...
Drugs such as carbonic anhydrase inhibitors, α2- and...
958
01:28Angle Closure Glaucoma: Treatment
1.1K
Angle-closure glaucoma, or closed-angle glaucoma, is an eye condition where the iris bulges out and blocks the iridocorneal angle, resulting in a buildup of aqueous humor and increased intraocular pressure. Immediate medical attention is necessary due to the sudden onset of symptoms. The treatment for angle-closure glaucoma includes short-term and long-term approaches. Short-term treatment involves using eye drops like pilocarpine to lower intraocular pressure by increasing aqueous humor...
1.1K