词汇压力的视听感知:节拍手势和发音线索
Ronny Bujok1,2, Antje S Meyer, Hans Rutger Bosker1,3
1Max Planck Institute for Psycholinguistics, The Netherlands.
Language and speech
|June 15, 2024
概括
像面部运动和手势这样的视觉线索显著地影响了我们如何感知口语. 与语音同步的节拍手势可靠地影响词汇压力感知,与视听环境中的面部发音线索不同.
科学领域:
- 心理语言学 心理语言学
- 语音感知 语音感知
- 多式联运通信 多式联运通信
背景情况:
- 人类沟通依赖于多种感官输入,包括听觉和视觉线索.
- 之前关于视听语音感知的研究主要集中在语音段,忽视了词汇压力等超分段特征.
- 视觉信息在感知超分段语音方面的作用仍未得到充分研究.
研究的目的:
- 研究视觉线索对视听视觉对词汇压力的影响.
- 检查面部发音线索和节拍手势如何影响荷兰语不成语词语中词汇压力的感知.
主要方法:
- 通过使用荷兰压力对的听觉词汇应力连续体进行了两项实验.
- 刺激包括演讲者在不同音节上表达压力的视频和同步的节拍手势.
- 参与者在各种视觉和听觉条件下感知到词汇压力,包括沉默的视频和视听演示.
主要成果:
- 参与者可以在沉默的视频中单独使用视觉发音线索来识别词汇压力.
- 面部发音线索在视听条件下没有显著影响词汇压力感知.
- 节拍手势与语音的时间对齐强烈影响了参与者对词汇压力的感知.
结论:
- 与听觉信息相比,视觉发音线索在视听语言中对词汇压力感知的影响较小.
- 节拍手势,当与语音暂时对齐时,在对词汇压力等超分段特征的视听感知中起着至关重要的作用.
- 未来的研究应该考虑多式联络通信研究中的超分段方面.
相关概念视频
Perceiving Loudness, Pitch, and Location
205
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
205
Hearing
52.0K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.0K
Chunking and Rehearsal in Sensory Memory
198
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
198
Principal Stresses
193
The graphical depiction of normal and shearing stress equations is represented by a circle, demonstrating the interplay between these stresses under different angular conditions. The center of this circle C, located on the vertical axis, represents the average normal stress, while its radius shows the range of stress variations. At points A and B, where the circle intersects the horizontal axis, the maximum and minimum normal stresses are observed, occurring without shearing stress. These...
193
Beats
525
The study of music provides many examples of the superposition of waves and the constructive and destructive interference that occurs. Very few examples of music being performed consist of a single source playing a single frequency for an extended period of time. A single frequency of sound for an extended period might be monotonous to the point of irritation, similar to the unwanted drone of an aircraft engine or a loud fan. Music is pleasant and exciting due to mixing the changing frequencies...
525


