视觉语言减少了认知力度,这是通过EEG太功率和瞳孔膨胀来衡量的
Brian Kai Loong Man1,2,3, Dorothea Wendt4,5, Elaine Hoi Ning Ng3
1Eriksholm Research Centre, Snekkersten 3070, Denmark bklm@dtu.dk.
eNeuro
|November 10, 2025
概括
视觉线索通过减少认知负载来帮助语音理解. 这项研究使用瞳孔测量和EEG来显示视觉语音增强了听力,改变了语音识别期间的认知资源分配.
科学领域:
- 认知神经科学 认知神经科学
- 听觉感知是一种听觉感知.
- 人与计算机的交互
背景情况:
- 倾听的努力对于语音理解至关重要,尤其是在杂的环境中.
- 视觉语音线索可以改善语音感知,但它们对认知努力的影响尚未完全理解.
- 努力的神经生理标志物,如瞳孔膨胀和正面中线西塔,是理解这些机制的关键.
研究的目的:
- 调查视觉语音线索如何调节语音识别期间的认知努力,使用瞳孔测量和EEG.
- 检查信号与噪声比 (SNR) 和与劳动力相关的神经生理反应在仅听觉和视听条件下的关系.
- 为了比较视觉线索对不同语音感知模式的认知努力的影响.
主要方法:
- 在22名参与者中,结合瞳孔测量和脑电图 (EEG).
- 参与者在只有听觉,只有视觉和只有视觉条件下执行了语音噪音任务.
- 在仅听和视听条件下使用信号噪声比 (SNR) 操纵任务难度.
主要成果:
- 在视听和听觉单独的语音中,观察到瞳孔膨胀,前额中线theta和SNR之间的反向U形关系.
- 神经生理学测量在视听条件下达到较低SNR的峰值,与仅听觉条件相比.
- 在视听条件下,瞳孔膨胀总体出乎意料地更大,而前额中间线theta在模式之间没有显著差异.
结论:
- 视觉线索似乎在语音处理过程中改变了时间动态或资源分配策略,使生理力度标记的解释变得复杂.
- 研究结果支持将基于听觉的听力模型扩展到视听环境.
- 整合多式神经生理学措施对于理解努力倾听的复杂机制是有价值的.
相关概念视频
01:10Higher Mental Functions of the Brain: Language
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
01:24Prosopagnosia
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
01:27Language and Cognition
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.