听觉和视觉模式在中国普通话中对焦感知中的作用
Shanpeng Li1, Yihan Wu1, Sasha Calhoun2
1MIIT Key Lab for Language Information Processing and Applications, School of Foreign Studies, Nanjing University of Science and Technology, China.
概括
视觉线索比听觉线索更有效,用于理解普通话语中的焦点,特别是在杂的环境中. 这项研究强调了语言理解的多式联络性质.
科学领域:
- 心理语言学 心理语言学
- 听觉和视觉感知是听觉和视觉感知.
- 语音沟通 语音沟通
背景情况:
- 语音感知集成了多种感官模式,而不仅仅是听觉输入.
- 听觉和视觉线索有助于语音感知,但它们在普通话焦点解释中的作用尚不清楚.
- 在普通话语语音感知中不同感官线索的相对贡献需要研究.
研究的目的:
- 调查普通话听众如何整合听觉和视觉线索来解释退化语音中的焦点.
- 为了确定听觉与视觉模式在普通话焦点感知中的有效性和相对贡献.
- 探索普通话的多模式语音理解.
主要方法:
- 进行了一个问题答案适当性评级实验.
- 参与者在仅有音频,仅有视觉和视听条件下对对进行评分.
- 在音频和视听条件下使用降噪语音来模拟现实世界的听力挑战.
主要成果:
- 听觉线索 (prosodic突出) 有效地发出了关注的信号.
- 视觉线索被证明比听觉线索更有效,特别是在受损的音频.
- 这表明视觉信息在普通话焦点解释中起着重要作用.
结论:
- 视觉线索在理解普通话的重点中起着至关重要的作用,特别是在不利的听力条件下.
- 这项研究促进了对多式联络语言理解和感官信息集成的理解.
- 这些发现对研究跨多种语言背景和沟通环境的焦点处理有意义.
更多相关视频
08:32Examining Online Syntactic Processing of Spoken Complex Sentences in Chinese Using Dual-Modal Interference Tasks
Published on: September 5, 2019
5.7K
09:27Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
Published on: October 13, 2018
10.2K
相关概念视频
Auditory Perception
587
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
587
Factors Affecting Perception
1.9K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
1.9K
Language and Cognition
450
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
450
Depth Perception and Spatial Vision
944
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
944
Perceiving Loudness, Pitch, and Location
435
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
435
Auditory Pathway
5.8K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.8K
