神经语音跟踪突出了视觉语言在多语音情况下的重要性
Chandra L Haider1, Hyojin Park2, Anne Hauswald1
1Paris Lodron Universität Salzburg.
Journal of cognitive neuroscience
|November 17, 2023
概括
面罩阻碍了语音理解,主要是通过阻止视觉线索,而不是通过降低声音质量. 这大大影响了视听语言处理,影响了神经语音跟踪.
科学领域:
- 神经科学是一个神经科学.
- 语音处理 语音处理
- 听觉感知是一种听觉感知.
背景情况:
- 视觉语言显著帮助听觉语言处理.
- 在COVID-19大流行期间常见的面罩,模糊视觉语音线索.
- 以前的研究表明,当口腔区域被堵塞时,神经语音跟踪受损.
研究的目的:
- 为了确定面罩是否会在声学或视觉上降低语音处理.
- 调查面罩对视听 (AV) 和仅有音频 (A) 语音的神经跟踪的影响.
- 分析视觉信息 (光谱图,唇部运动,词汇单元) 在不同的语言条件下是如何处理的.
主要方法:
- 参与者听到AV和A的演讲,有和没有面罩.
- 在某些条件下引入了一个分心扬声器.
- 磁脑电图 (MEG) 用于测量神经语音跟踪.
主要成果:
- 面罩在AV条件下损害了神经语音跟踪,但在A条件下没有.
- 观察到对跟踪光谱图的视觉效益,特别是在多扬声器环境中.
- 唇部运动在清晰的演讲中提供了额外的视觉效益,而词汇单元显示没有视觉增强.
结论:
- 面罩主要通过阻碍视觉语音信息来影响语音处理.
- 观察到的效应表明,视觉输入可能会作为一般注意力指南,而不是在年轻的正常听力个体中提取特定特征.
- 神经语音跟踪对视觉语音提示敏感,特别是在具有挑战性的听力环境中.
相关概念视频
Higher Mental Functions of the Brain: Language
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Components of Language
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs. “eh”). Phonemes combine to...
Language Development
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
Language and Cognition
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.


