视觉系统中抽象语言类别的表现是成功读唇的基础
Aaron R Nidiffer1, Cody Zhewei Cao2, Aisling O'Sullivan3
1Department of Biomedical Engineering, Department of Neuroscience, Del Monte Institute for Neuroscience, University of Rochester, Rochester, NY, USA.
NeuroImage
|September 27, 2023
概括
读唇的神经活动发生在视觉大脑区域,而不是听觉区域. 这种视觉语音处理使用称为维塞姆的分类语言特征,与唇部运动不同,并预测唇读成功.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 语音感知 语音感知
背景情况:
- 视觉语音处理的神经基础,特别是唇读,仍然存在争议,特别是关于视觉与听觉大脑区域的参与.
- 现有的研究努力区分高水平的语言处理与低水平的视觉特征在静音语音感知.
研究的目的:
- 在没有声音的情况下调查潜在的视觉语音感知的神经机制.
- 要确定唇读是否依赖于专门的视觉表示或听觉区域.
- 模拟视觉特征和语言单元 (visemes) 在默话期间对大脑活动的贡献.
主要方法:
- 电脑电图 (EEG) 记录了参与者观看无声语音视频.
- 视频包括新的和以前排练的 (带有音频) 默话段.
- 用EEG数据建模来评估低级视觉特征和高级视觉特征的处理.
主要成果:
- 视觉处理在基本视觉运动和唇部运动之外的EEG反应中起到了显著的作用,特别是在练习的演讲中.
- 这种基于体的神经活动与参与者的唇读精度相关.
- 来源本地化表明,视觉处理主要涉及视觉皮层,在听觉区域没有显著的激活.
结论:
- 视觉系统产生了以分类语言特征 (visemes) 为特征的专门语音表示.
- 这些视觉表现可以与原始的唇部运动分离,并预测唇阅读能力.
- 研究结果支持以视觉为中心的语音感知模型,并提供了在静音语音任务中重新解释之前的听觉皮质激活.
相关概念视频
01:10Higher Mental Functions of the Brain: Language
903
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
903
01:24Components of Language
308
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
308
01:28Lateralization
353
Brain lateralization refers to the division of mental processes and functions between the two hemispheres of the brain, a phenomenon that optimizes neural efficiency and underpins complex abilities in humans. This specialization allows each hemisphere to perform tasks where it has a comparative advantage, facilitating more refined cognitive capabilities across different domains.
353
01:19Encoding
194
Information enters the brain through encoding, which is the input of information into the memory system. Once sensory information is received from the environment, the brain labels or codes it. The information is then organized with similar information and connected to existing concepts. Encoding occurs through automatic processing and effortful processing.
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
194
01:22Language Development
393
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
393
01:27Language and Cognition
367
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
367