从人脑内皮质学信号中重建高分辨率的视觉感知图像
Yongjie Deng1,2, Xiaolong Wu2, Xin Gao2
1Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, People's Republic of China.
Journal of neural engineering
|August 28, 2025
概括
研究人员使用新型管道从人体电皮质谱 (ECoG) 信号中重建感知图像. 这种无监督的方法优于现有的方法, 为脑电脑接口和理解视觉感知提供了一个新的框架.
科学领域:
- 神经科学
- 计算机视觉
- 机器学习
背景情况:
- 从大脑信号重建视觉感知是一个不断增长的研究领域.
- 电皮质谱 (ECoG) 为此提供高分辨率的内信号.
- 之前的研究还没有从人类心电图直接重建感知图像.
研究的目的:
- 开发一种用于从人类ECoG信号中重建感知图像的新型管道.
- 根据最先进的技术来评估拟议方法的性能.
- 探索无监督学习的潜力,
主要方法:
- 开发了一种新型管道,将塔拉拉赫坐标对齐掩盖自编码器 (TA-MAE) 与无声扩散概率模型集成在一起.
- 利用人类心电图信号的时空动态来恢复高分辨率图像.
- 使用无监督学习来重建信号,与标签指导的方法形成对比.
主要成果:
- 拟议的方法在图像外观,结构,信号噪声比率和语义一致性方面明显优于当前的最先进方法.
- 与监督方法相比,基于无监督学习的重建有效地捕获了低维的大脑信号表示.
- 这些发现表明无人监督解码对于探索视觉内在机制的优势.
结论:
- 开发的管道为基于人类ECoG的视觉重建提供了可通用的框架.
- 没有监督的解码显示出卓越的性能和大脑信号分析的潜力.
- 这项工作开创了人类ECoG信号的感知图像的重建.
相关概念视频
The Retina
The retina is a layer of nervous tissue at the back of the eye that transduces light into neural signals. This process, called phototransduction, is carried out by rod and cone photoreceptor cells in the back of the retina.
Vision
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
Anatomy of the Eyeball
The eye is a spherical, hollow structure composed of three tissue layers. The outer layer — the fibrous tunic, comprises the sclera — a white structure — and the cornea, which is transparent. The sclera encompasses some of the ocular surface, most of which is not visible. However, the 'white of the eye' is distinctively visible in humans compared to other species. The cornea, a clear covering at the front of the eye, enables light penetration. The eye's middle layer, the vascular tunic,...
Visual System
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
Parallel Processing
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...


