调整机器和思维:基于图像标题任务的高级视觉皮层的神经编码
Xu Yin1, Jiuchuan Jiang2, Sheng Ge1
1Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing 211189, Jiangsu, People's Republic of China.
Journal of neural engineering
|October 9, 2025
概括
这项研究引入了一种使用图像标题的新型神经编码模型,以改善高层视觉皮层中大脑活动的预测. 专注RF模块增强了对视觉信息处理的理解.
科学领域:
- 神经科学是一个神经科学.
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 神经编码模型预测大脑对视觉刺激的反应.
- 深度神经网络在早期的视觉领域表现出色,但在高层次的语义表示方面扎.
- 对于复杂的视觉信息,编码性能和可解释性有限.
研究的目的:
- 开发一种由图像标题为高级视觉皮层指导的新型神经编码模型.
- 提高神经对复杂视觉刺激反应的编码性能和解释性.
- 为了弥合视觉语言任务和语音智能大脑活动模式之间的领域差距.
主要方法:
- 提出了一个由图像标题指导的神经编码模型.
- 利用注意模块在图像标题时专注于关键视觉对象.
- 设计了一个灵活的受感场 (RF) 模块来模拟voxel级视觉场.
- 引入了注意力RF模块,以使注意力引导的表征与大脑活动保持一致.
主要成果:
- 在七个高级视觉皮层中实现了卓越的平均编码性能.
- 报告了0.765的平均平方误差,0.443的皮尔森相关系数和0.245.245的R平方.
- 使用大规模的自然场景数据集,证明了对voxel活动的增强预测.
结论:
- 利用视觉语言任务可以增强高层视觉皮层的神经编码.
- 专注RF模块为神经编码提供了一个新的视角.
- 视觉化技术为视觉处理的神经机制提供了洞察力.
相关概念视频
Encoding
744
Information enters the brain through encoding, which is the input of information into the memory system. Once sensory information is received from the environment, the brain labels or codes it. The information is then organized with similar information and connected to existing concepts. Encoding occurs through automatic processing and effortful processing.
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
744
Vision
59.3K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
59.3K
Motor and Sensory Areas of the Cortex
6.9K
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
6.9K
Visual System
1.7K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
1.7K
Neural Circuits
2.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.6K
Parallel Processing
632
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
632


