卷积网络可以在视觉文字识别过程中模拟与前流程相关的MEG反应的功能调制
Marijn van Vliet1, Oona Rinkinen1, Takao Shimizu1
1Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland.
eLife
|May 13, 2025
概括
这项研究引入了用于视觉词识别的新型卷积神经网络 (CNN) 模型,模拟了从像素级输入的早期大脑反应. 这些模型准确地复制了阅读任务期间的人类大脑活动.
科学领域:
- 认知神经科学 认知神经科学
- 计算神经科学是一种神经科学.
- 计算机视觉 计算机视觉
背景情况:
- 传统的阅读模型无法模拟早期的视觉处理阶段,限制了他们模拟大脑反应的能力.
- 现有的模型通常使用简化的输入,如字母库,而不是原始像素数据.
研究的目的:
- 从像素级输入开始,开发可视化词识别的现实计算模型.
- 创建能够在视觉词识别过程中模拟早期大脑反应的模型.
- 评估模型性能与人类磁脑电图 (MEG) 数据对比.
主要方法:
- 利用VGG-11卷积神经网络 (CNN) 的变体进行视觉文字识别.
- 训练模型对芬兰单词的像素级数据进行处理,处理形状,尺寸和旋转.
- 将CNN层活动与MEG进行比较,从人类研究中唤起了响应幅度.
主要成果:
- 开发了一个CNN架构,能够模拟从像素输入的视觉词识别.
- 成功模拟了三个关键的大脑反应:I型 (早期视觉),II型 (字母串) 和N400m.
- 证明了具有卷积和聚合步骤的CNN可以模仿生物可信性.
结论:
- 从卷积和聚合步骤开始的CNN为模拟视觉词识别提供了一个现实的方法.
- 这种像素级建模可以直接比较计算模型和大脑活动.
- 这些发现推动了我们对阅读背后的神经机制的理解.
相关概念视频
Vision
48.6K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
48.6K
Neural Circuits
3.0K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
3.0K
Motor and Sensory Areas of the Cortex
8.1K
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
8.1K
Convolution: Math, Graphics, and Discrete Signals
1.3K
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
1.3K
Visual System
2.3K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
2.3K
Parallel Processing
961
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
961


