在虚拟声环境中进行神经语音跟踪:对无脚本连续语音的视听效益
Mareike Daeglau1, Jürgen Otten2, Giso Grimm2
1Neuropsychology Lab, Department of Psychology, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany.
Frontiers in human neuroscience
|April 24, 2025
概括
视听效益增强了语音感知,特别是在杂的环境中. 自然的语音和唇部运动对于理解至关重要,突出了单个说话者在现实世界中听的差异.
科学领域:
- 神经科学是一个神经科学.
- 语音感知 语音感知
- 声学 听觉科学 声学 听觉科学
背景情况:
- 视听的好处是,视觉线索可以增强语音理解,这一点已经得到了很好的证实.
- 以前的研究经常使用受控实验室设置与脚本语音.
研究的目的:
- 通过在虚拟声环境中使用自然,无脚本的语音来调查视听效益.
- 评估神经反应,并孤立唇部运动在语音感知中的作用.
主要方法:
- 使用脑电图 (EEG) 来进行皮质语音跟踪.
- 视听,仅视听,仅视觉和口罩状况的比较.
- 分析了音响和视觉扬声器特征,如音调和嘴唇开放度.
主要成果:
- 在语音跟踪中证实了显著的视听增强,特别是在背景噪音下.
- 证明面具唇条件产生了与仅有音频的结果相似的结果,强调了唇部运动的重要性.
- 展示了皮层语音跟踪与自然主义刺激的可行性.
结论:
- 在具有挑战性的听力条件下,唇部运动对于语音感知至关重要.
- 每个演讲者的特点都会在现实场景中影响视听整合.
- 皮层语音跟踪与自然主义语音是可行的,为听觉视觉处理提供了洞察力.
相关概念视频
Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...


