视觉皮层的功能多样性改善了从人类大脑活动中无约束的自然图像重建
Lingxiao Yang1, Hui Zhen2, Le Li3
1School of Computer Science and Engineering, Sun Yat-sen University, Guangdong 510006, China.
Fundamental research
|December 30, 2025
概括
研究人员开发了一种新的生成网络 (FDGen) 用于大脑解码. 这种先进的功能磁共振成像 (fMRI) 方法可以直接从大脑活动中重建自然图像,没有额外的线索.
科学领域:
- 神经科学是一个神经科学.
- 计算机科学 计算机科学
- 人工智能的人工智能
背景情况:
- 功能磁共振成像 (fMRI) 研究已经推进了视觉编码和脑机界面.
- 现有的方法通常需要额外的信息,如语义类别或图像重建的文本.
- 从大脑活动中进行无约束的视觉重建仍然是一个重大挑战.
研究的目的:
- 提出一个新的生成网络,FDGen,用于从fMRI数据直接视觉重建.
- 仅从多变量大脑活动中实现对感知到的自然图像的无约束重建.
- 将神经科学原则纳入深度学习,以增强大脑解码.
主要方法:
- 开发了FDGen,一种利用人类视觉皮层功能多样性的生成网络.
- 整合了一个基于功能的输入模块 (FIM),将区域大脑反应投射到不同的特征空间中.
- 集成了一个引起注意的模块,用于导出注意的特征权重,以改进特征地图.
主要成果:
- 在没有额外的线索的情况下,FDGen成功地直接从fMRI数据中重建自然图像.
- 该网络在受欢迎的fMRI数据集上展示了非常强大的性能.
- 生物灵感模块 (FIM和注意力机制) 增强了多尺度视觉信息的动态选择.
结论:
- FDGen代表了基于fMRI的大脑解码算法的重大进步.
- 这项研究强调了将神经科学理论纳入深度学习模型设计的有效性.
- 这种方法为更复杂的非侵入性脑机接口铺平了道路.
相关概念视频
Vision
59.2K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
59.2K
Brain Imaging
623
Brain imaging technologies provide critical insights into both the structure and function of the human brain, enabling medical professionals and researchers to diagnose, study, and treat neurological disorders or psychiatric disorders more effectively.
These technologies include computerized axial tomography (CAT or CT scans), positron-emission tomography (PET scans), magnetic resonance imaging (MRI), functional magnetic resonance imaging (fMRI), and Transcranial Magnetic...
These technologies include computerized axial tomography (CAT or CT scans), positron-emission tomography (PET scans), magnetic resonance imaging (MRI), functional magnetic resonance imaging (fMRI), and Transcranial Magnetic...
623
Parallel Processing
593
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
593
Visual System
1.6K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
1.6K
Association Areas of the Cortex
8.7K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
8.7K
Motor and Sensory Areas of the Cortex
6.7K
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
6.7K


