口对眼睛的优先权,以感知视听,普通话的词汇音调
Biao Zeng1, Guoxing Yu2, Nabil Hasshim3
1University of South Wales, Pontypridd, UK.
Journal of eye movement research
|April 8, 2024
概括
听众主要使用口腔动作来识别普通话的词汇音调,无论声音清晰度如何. 这一发现凸显了视觉发音线索在母语和非母语使用者的语音感知中的关键作用.
科学领域:
- 心理语言学 心理语言学
- 听觉和视觉语音感知
- 语音学 语音学 语音学
背景情况:
- 词汇音调识别依赖于听觉和视觉线索,视觉线索比辅音和母音的线索更难理解.
- 对于处理视听词汇音调至关重要的特定面部区域在很大程度上仍未确定.
- 中国普通话是一种音色语言,为研究音色感知提供了一个独特的模型.
研究的目的:
- 调查视觉面部线索在普通话词典音调的感知中的作用.
- 在识别视听词汇音调时,比较中文母语者和非英语母语者在识别视听词汇音调时的眼动模式.
- 为了确定在不同声条件下的视听词汇音调识别过程中,哪些面部区域 (如嘴巴,眼睛) 最受关注.
主要方法:
- 参与者 (讲汉语和英语) 观看了不同音调的普通话单音节的视听片段.
- 参与者被要求在清晰,杂和安静的音频条件下识别特定的音调 (入与下降).
- 用眼睛追踪器记录眼睛的运动,以分析不同面部区域的凝视模式和持续时间.
主要成果:
- 无论是中文还是英语,在识别词汇音调时,讲者都主要注视口腔区域,而不是眼睛.
- 在不利的声学条件下 (噪音和无声),参与者增加了他们对口腔的凝视时间.
- 眼睛运动模式在中文和英语发言者之间是相似的,这表明普遍依赖于发音线索.
结论:
- 嘴巴是面部的主要区域,用于感知视听词汇音色.
- 来自口腔的视觉信息为音调识别提供了必要的发音线索,不管声音的清晰度如何.
- 这些发现表明,音调的视觉语音处理依赖于普遍的发音信息,而不是特定于语言的社会或务实线索.
相关概念视频
01:31Hearing
52.1K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.1K
01:27Language and Cognition
343
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
343
01:22Language Development
358
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
358
01:01Perception of Sound Waves
4.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.4K
01:10Higher Mental Functions of the Brain: Language
804
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
804
01:21Perceiving Loudness, Pitch, and Location
211
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
211