相关实验视频
Updated: Jun 8, 2025
05:07
Using Looming Visual Stimuli to Evaluate Mouse Vision
Published on: June 13, 2019
11.2K
OphGLM:一个眼科大语言和视觉助理.
Zhuo Deng1, Weihao Gao1, Chucheng Chen1
1Shenzhen International Graduate School, Tsinghua University, Shenzhen, China.
Artificial intelligence in medicine
|November 3, 2024
概括
眼科大型语言和视觉助理OphGLM通过整合视觉理解和医学知识来增强眼科诊断. 这种新的方法改善了人与计算机的交互,用于早期查眼病.
科学领域:
- 眼科医生 眼科 眼科
- 人工智能的人工智能
- 计算机视觉 计算机视觉
- 自然语言处理自然语言处理.
背景情况:
- 眼科的计算机辅助诊断方法在人机交互和临床适用性方面存在局限,原因是输出格式受限.
- 在大型语言模型 (LLM) 出现之前,现有的解决方案缺乏眼科视觉问题答案的实际方法.
研究的目的:
- 通过开发先进的交互式系统来解决当前眼科诊断工具的局限性.
- 调查和建立一种基于大型语言模型 (LLM) 的新方法,用于眼科视觉问题答案.
主要方法:
- 构建OphGLM,眼科大型语言和视觉助手,包括图像编码器,文本编码器,融合模块和LLM模块.
- 建立FundusTuning-CN,一个新的中国眼科微调数据集,包括基金指令和对话集.
- 使用FundusTuning-CN开发一种新的LLM调整策略,以有效地将视觉理解和眼科知识集成到LLMs中.
主要成果:
- 在 fundus 疾病分类任务中,OphGLM 展示了卓越的视觉理解,优于开源视觉语言模型.
- 利用FundusTuning-CN,OphGLM在眼科知识和交互能力方面都超过了开源医学LLM.
- 拟议的OphGLM显示了彻底改变眼科临床应用的巨大潜力.
结论:
- OphGLM代表了眼科诊断相互作用的重大进步,弥合了视觉数据和临床决策之间的差距.
- 开发的LLM调整策略和数据集提供了一种具有成本效益和高效的方法,用于增强医学LLM的专业知识.
- OphGLM有可能通过提高诊断准确性和提高临床适用性来改变眼科护理.
相关概念视频
01:24Vision
52.9K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
52.9K
01:25Glaucoma: Overview
516
Glaucoma is an eye condition characterized by increased intraocular pressure that damages the retina and optic nerve, leading to irreversible blindness if left untreated. The human eye has various components, including the cornea, iris, pupil, lens, and optic nerve. Aqueous humor is secreted by the epithelium of the ciliary body in the posterior chamber and flows through the trabecular meshwork and canal of Schlemm, maintaining normal intraocular pressure. The trabecular meshwork and the canal...
516
01:17Accessory Structures of the Eye
1.5K
Optical perception, or vision, is an extraordinary sense dependent on converting light signals received via the ocular organs. These organs, known as eyes, are securely positioned within the bony cavities of the skull, called orbits. The orbits serve a dual purpose: a protective shield for the ocular globes and a stable attachment point for the soft ocular tissues. The eye's external protective mechanisms include the eyelids, which are edged with lashes that act as a barrier against foreign...
1.5K