VisionUnite:眼科视觉语言基础模型,增强了临床知识
IEEE transactions on pattern analysis and machine intelligence
|August 13, 2025
概括
新的人工智能模型VisionUnite使用临床知识和大型数据集来增强眼科诊断. 它显示了类似于初级医生的诊断能力,改善了眼科护理的准入.
科学领域:
- 眼科医生 眼科 眼科
- 人工智能的人工智能
- 医学诊断 医学诊断 医学诊断
背景情况:
- 在欠发达地区,眼科医生和先进设备的有限访问需要改进的诊断工具.
- 现有的诊断方法可能不足以在不同的临床环境中进行初始查和教育.
研究的目的:
- 介绍VisionUnite,这是眼科的新型视觉语言基础模型.
- 提高眼科护理的诊断能力和可访问性.
- 为初级眼科医生提供教育辅助.
主要方法:
- 在124万个图像-文本对上预训练VisionUnite.
- 与MMFundus数据集进行微调 (296,379个基金图像,889,137个对话).
- 对现有模型 (GPT4V,Gemini Pro) 和初级眼科医生进行性能评估.
主要成果:
- 在眼科任务中,VisionUnite的表现优于GPT4V和Gemini Pro.
- 证明了与初级眼科医生相比的诊断能力.
- 在多种疾病诊断,临床解释和患者互动方面有效.
结论:
- 视觉联结 (VisionUnite) 是用于初始眼科疾病查的多功能工具.
- 它是眼科医生的宝贵教育辅助工具.
- 代表了眼科诊断和医学教育的重大进步.
相关概念视频
Glaucoma: Overview
755
Glaucoma is an eye condition characterized by increased intraocular pressure that damages the retina and optic nerve, leading to irreversible blindness if left untreated. The human eye has various components, including the cornea, iris, pupil, lens, and optic nerve. Aqueous humor is secreted by the epithelium of the ciliary body in the posterior chamber and flows through the trabecular meshwork and canal of Schlemm, maintaining normal intraocular pressure. The trabecular meshwork and the canal...
755
Vision
55.3K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
55.3K
Accessory Structures of the Eye
1.9K
Optical perception, or vision, is an extraordinary sense dependent on converting light signals received via the ocular organs. These organs, known as eyes, are securely positioned within the bony cavities of the skull, called orbits. The orbits serve a dual purpose: a protective shield for the ocular globes and a stable attachment point for the soft ocular tissues. The eye's external protective mechanisms include the eyelids, which are edged with lashes that act as a barrier against foreign...
1.9K
Angle Closure Glaucoma: Treatment
681
Angle-closure glaucoma, or closed-angle glaucoma, is an eye condition where the iris bulges out and blocks the iridocorneal angle, resulting in a buildup of aqueous humor and increased intraocular pressure. Immediate medical attention is necessary due to the sudden onset of symptoms. The treatment for angle-closure glaucoma includes short-term and long-term approaches. Short-term treatment involves using eye drops like pilocarpine to lower intraocular pressure by increasing aqueous humor...
681
Open Angle Glaucoma: Treatment
568
In open-angle glaucoma, the iridocorneal angle remains open, but the trabecular meshwork becomes stiff, slowing down the outflow of aqueous humor. This causes a buildup of aqueous humor in the anterior chamber, leading to a sudden increase in intraocular pressure. The treatment for open-angle glaucoma focuses on reducing the elevated intraocular pressure by either decreasing the secretion of aqueous humor or increasing its outflow.
Drugs such as carbonic anhydrase inhibitors, α2- and...
Drugs such as carbonic anhydrase inhibitors, α2- and...
568
Focusing of Light in the Eye
3.2K
Light rays enter the eye through the cornea, a transparent dome-shaped tissue that is the eye's outermost layer. The cornea bends or refracts, light rays traveling to the pupil. The shape of the cornea determines how much of the light is bent and whether the image will be focused correctly on the retina at the back of the eye. Once the light has passed through both refraction layers, it converges into a single focal point onto a small area. This is where photoreceptors start transforming...
3.2K


