听觉和视觉语音的声学表现在角和角皮层以及其他地方
Alice Van Audenhaege1, Stefania Mattioni1,2, Filippo Cerpelloni1,3
1Institute of Psychology (IPSY) & Institute of Neuroscience (IoNS), UCLouvain, Louvain-la-Neuve 1348, Belgium.
概括
单词选择性腹部角角皮质 (word-VOTC) 和左上角 (lSTS) 处理听觉和视觉语音信息. 然而,只有lSTS才能使这些表征在各个感官之间保持一致,这表明大脑中存在不同的多感官处理网络.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 听觉和视觉处理
背景情况:
- 语音是一种复杂的多感官信号,通过听觉和视觉通路进行处理.
- 以前的研究表明,听觉和视觉语音特征在部和部区域可能会重叠,但精确的定位和功能仍然不清楚.
- 了解大脑如何整合视听语音信息对于破译语音感知机制至关重要.
研究的目的:
- 以功能性和个性化地绘制与处理听觉和视觉语音特征相关的大脑区域.
- 研究声学表示的性质和位置在专门的皮质区域.
- 确定是否以及如何在这些区域内集成听觉和视觉语音信息.
主要方法:
- 功能磁共振成像 (fMRI) 用于研究男性和女性参与者的大脑活动.
- 应用了多变量模式分类来识别定义的大脑区域的语音 (声音) 和唇部 (唇部运动) 表现,包括词选择性腹部角-皮层 (word-VOTC) 和左上角 (lSTS).
- 进行了跨模式解码和全脑搜索灯分析,以评估跨感官模式的表示对齐.
主要成果:
- 发现-VOTC 和 lSTS 两个词都编码了听觉和视觉语音中的声学信息.
- 形面部区域 (FFA) 显示了视体,但没有语音表示,而副海马位置区域 (PPA) 显示没有语音编码.
- 交叉模式解码揭示了对齐的听觉和视觉声学表示在lSTS和双边后部上皮 (pSTS) 和左体运动皮层,但不是在word-VOTC.
结论:
- 单词-VOTC处理了听觉和视觉声学,将其已知的功能扩展到文字处理之外.
- 存在不同的多感官集成机制,在lSTS和体运动皮层中具有对齐的表示,但在word-VOTC中没有.
- 这些发现突出了大脑中多感官语音处理的分布式网络.
相关概念视频
Association Areas of the Cortex
4.5K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
4.5K
Motor and Sensory Areas of the Cortex
2.5K
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor...
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor...
2.5K
Auditory Pathway
4.5K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
4.5K
Hearing
51.1K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
51.1K
Somatosensory, Motor, and Association Cortex
296
The somatosensory cortex in the parietal lobes is crucial for interpreting sensory data such as touch, temperature, and proprioception. The somatosensory cortex, situated in the parietal lobes, plays a vital role in interpreting sensory information like touch, temperature, and proprioception—awareness of body position. This specialized brain region features an organized structure wherein neurons at the top primarily process sensations originating from the lower body. In contrast, those at...
296
Lobes of the Cerebrum
426
The cerebral cortex, a critical structure of the brain, is intricately divided into two hemispheres, each consisting of four distinct lobes: occipital, temporal, frontal, and parietal. These lobes function cooperatively to regulate various cognitive and sensory functions, forming the basis of our complex neural capabilities.
Frontal lobe
The frontal lobes, located behind the forehead, are the command center of our brain, controlling personality, intelligence, and voluntary muscle movements....
Frontal lobe
The frontal lobes, located behind the forehead, are the command center of our brain, controlling personality, intelligence, and voluntary muscle movements....
426


