我可以看看你看到的吗? 从神经元活动中预测视觉特征
Vikram Ravindra1, Chih-Hao Fang2, Ananth Grama2
1University of Cincinnati, Cincinnati, OH, USA.
iScience
|February 2, 2024
概括
研究人员从功能性MRI (fMRI) 数据中重建了视频,证明大脑活动可以预测视觉对象并重建图像,包括面孔.
科学领域:
- 神经科学是一个神经科学.
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 了解大脑对视听刺激的反应对于破译神经元过程至关重要.
- 功能磁共振成像 (fMRI) 通过检测血液流量的相关变化来测量大脑活动.
研究的目的:
- 从fMRI数据中重建视频.
- 为了证明模型能够从fMRI信号中预测视觉对象的能力.
- 为了研究大脑活动和视觉感知之间的关系.
主要方法:
- 在视频段上训练了一种自动编码模型,以创建视频流的潜在表示.
- 在fMRI反应和相应的潜视频表示之间学习了映射.
- fMRI数据被用来计算潜伏向量,然后通过解码器来重建预测的图像.
主要成果:
- 来自视频和相应的fMRI图像的表示显示了高集群.
- 该模型仅使用fMRI数据成功预测了视频中的物体.
- fMRI反应使得输入的重建成为可能,预测了面部的存在.
结论:
- 该研究成功地从fMRI数据中重建了视觉信息,弥合了神经科学和计算机视觉.
- 这种方法证明了从大脑活动中直接解码视觉内容的潜力.
- 这些发现为先进的脑计算机接口和理解视觉处理开辟了道路.
相关概念视频
01:26Visual System
584
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
584
01:24Vision
53.4K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.4K