模拟受人类视觉系统障碍影响的感知图像的框架
概括
本研究介绍了一个使用PerceptNet和深度学习的计算框架,以模拟人类视觉系统障碍,如色盲和创伤性脑损伤 (TBI),如何改变图像感知. 该工具优化图像以建模这些视觉障碍,以便研究和可访问性.
科学领域:
- 计算神经科学是一种计算神经科学.
- 计算机视觉 计算机视觉 计算机视觉
- 人类视觉系统建模模型
背景情况:
- 人类视觉系统 (HVS) 障碍,包括色彩视觉缺陷和创伤性脑损伤 (TBI) 相关的损伤,显著改变视觉感知.
- 现有的模型往往缺乏灵活性来模拟各种HVS障碍及其感知后果.
研究的目的:
- 提出一个计算框架来模拟HVS障碍对感知图像的影响.
- 为了利用修改后的PerceptNet模型和深度学习优化 (JAX/Flax) 来进行特定疾病的模拟.
- 为了证明该框架在建模色盲和TBI诱导的神经可塑性方面的实用性.
主要方法:
- 开发了一个集成HVS模型PerceptNet与JAX/Flax深度学习的计算框架.
- 修改了PerceptNet,以纳入与HVS疾病相关的疾病特异性变化.
- 优化输入图像以匹配修改后的PerceptNet模型的特征图.
主要成果:
- 成功模拟了色盲患者的视觉感知变化.
- 演示了TBI后在初级视觉皮层 (V1) 中模型感知变化的潜力.
- 验证了框架在模拟各种HVS障碍影响方面的灵活性和稳定性.
结论:
- 开发的框架提供了一个多功能工具,用于通过计算来研究改变的视觉感知.
- 在可访问性设计,教育工具和神经科学研究中提供了潜在的应用.
- 促进了解疾病特异性的视觉感知变化,并有助于开发适应性视觉系统.
相关概念视频
01:26Visual System
1.6K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
1.6K
01:24Vision
59.2K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
59.2K
01:22Photoreceptors and Visual Pathways
8.6K
At the molecular level, visual signals trigger transformations in photopigment molecules, resulting in changes in the photoreceptor cell's membrane potential. The photon's energy level is denoted by its wavelength, with each specific wavelength of visible light associated with a distinct color. The spectral range of visible light, classified as electromagnetic radiation, spans from 380 to 720 nm. Electromagnetic radiation wavelengths exceeding 720 nm fall under the infrared category,...
8.6K