从人类大脑活动中重建视觉幻觉体验
Fan L Cheng1,2, Tomoyasu Horikawa2, Kei Majima1
1Graduate School of Informatics, Kyoto University, Sakyo-ku, Kyoto 606-8501, Japan.
Science advances
|November 15, 2023
概括
研究人员使用深度神经网络 (DNN) 来从大脑活动中重建视觉幻觉. 这种技术可视化主观经验,提供对大脑的洞察力.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 计算机视觉 计算机视觉
背景情况:
- 视觉错觉提供了对感官处理的洞察力.
- 主观视觉体验的神经基础尚未完全理解.
研究的目的:
- 通过使用深度神经网络 (DNN) 模型,重建脑活动中的虚幻感知.
- 研究大脑活动如何与主观视觉体验相关.
主要方法:
- 利用了与DNN表示相结合的大脑解码技术.
- 在自然图像上训练了一个重建模型,以将大脑活动与感知特征联系起来.
- 在虚幻线和虹色传播现象上测试了模型.
主要成果:
- 成功重建了从大脑活动中传播的虚幻线条和虹灯颜色的图像.
- 重建的感知与主观的虚幻体验保持一致.
- 在不同视觉皮层区域的重建中观察到的变化.
结论:
- 开发的框架可以实现主观的视觉体验.
- 这种方法可以揭示视觉处理过程中大脑的内部表征.
- 大脑解码与DNN结合,是研究视觉感知的一个有希望的方法.
相关概念视频
Vision
53.5K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.5K
Parallel Processing
157
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
157
Visual System
591
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
591


