时间线索,点灯显示和面部对语音识别和听力努力的影响
Katrina Sewell1, Violet A Brown2, Grace Farwell1
1Department of Psychology, Carleton College, Northfield, MN, United States of America.
PloS one
|November 29, 2023
概括
看到一个说话的面孔显著改善了在噪音中的语音理解. 虽然自然面孔提供了实质性的好处,但数字显示提供了有限的优势,突出了详细的视觉语音线索对语音可理解性的重要性.
科学领域:
- 语音感知研究 语音感知研究
- 视听语言处理 视听语言处理
- 人与计算机的互动.
背景情况:
- 一个说话的面孔的存在可以提高口语的可理解性.
- 来自口音器和时间的视觉线索补充了听觉信息.
- 了解不同视觉信息对噪音语音感知的影响至关重要.
研究的目的:
- 调查不同级别的视觉信息如何影响语音理解和听力.
- 在不同噪音条件下比较自然说话面孔,点光显示器和时间线索调制器在不同噪音条件下的有效性.
主要方法:
- 参与者在能量或信息掩饰下识别了句子.
- 视觉条件包括仅有音频,调制圆,点光显示器和自然说话的脸.
- 测量了句子识别准确度和自我报告的听力.
主要成果:
- 一个自然的说话面孔显著提高了两种掩面类型的可理解性.
- 一个点灯显示器只在能量掩盖中提供了好处.
- 调制圈在音频条件下没有提供任何可理解性优势.
结论:
- 详细的视觉语音信息,就像在自然面部看到的那样,对于在噪音中强大的语音可理解性至关重要.
- 数字点灯显示器可能会带来一些好处,但需要足够的语音细节.
- 简单的时间线索不足以在具有挑战性的听力环境中增强语音感知.
更多相关视频
相关概念视频
Facial Feedback Hypothesis
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role of...
Non-Verbal Cues
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...


