在语音修复过程中,我们在脸上的哪个地方看:一项眼睛跟踪研究
Alisa Baron1, Vanessa Harwood1, Daniel Kleinman2
1Department of Communicative Disorders, University of Rhode Island, Kingston, RI, United States.
Frontiers in psychology
|June 12, 2023
概括
当说话具有挑战性时,成年人会看着说话者的嘴里寻找视觉线索. 这项研究表明,视觉发音信息有助于语音感知,特别是在苛刻的听力环境中.
科学领域:
- 语音感知 语音感知
- 听觉视觉语音处理 听觉视觉语音处理
- 人与计算机的互动.
背景情况:
- 面对面的沟通整合了听觉和视觉语音线索.
- 了解任务需求如何影响语音处理期间的视觉注意力对于现实世界的场景至关重要.
研究的目的:
- 为了研究任务需求对对说话面孔的凝视模式的影响.
- 为了确定视觉发音信息如何影响在不同认知负载下语音感知.
主要方法:
- 使用视听和像素化视觉条件进行了两次眼睛跟踪实验.
- 参与者从事被动 (无响应) 或主动 (言语歧视) 任务.
- 语音刺激包括清晰的 /ba/ 和修改的 /a/ 样标记.
主要成果:
- 在视听主动状态下,对口腔的最大固定发生.
- 视觉关节信息促进了 /a/- 类似令牌的语音恢复效应.
- 在像素化条件下,参与者专注于眼睛;积极的歧视比视听条件更好.
结论:
- 成年人利用口腔的视觉发音线索,在可用和任务要求很高的情况下,阐明语音.
- 视线模式转向口腔或眼睛,这取决于视觉信息的可用性和任务要求.
- 视觉语音信息在支持听觉语音处理方面发挥着重要作用,特别是在具有挑战性的听力环境中.
更多相关视频
相关概念视频
Facial Feedback Hypothesis
196
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
196
Association Areas of the Cortex
5.6K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.6K
Prosopagnosia
212
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
212


