音响场景的复杂性会影响在视听多人讲话者虚拟环境中语音感知过程中的运动行为
Valeska Slomianka1, Torsten Dau2, Axel Ahrens2
1Hearing Systems Section, Department of Health Technology, Technical University of Denmark, 2800, Kgs. Lyngby, Denmark. vaslo@dtu.dk.
Scientific reports
|August 16, 2024
概括
听众调整头部和眼睛的运动,以理解复杂的声音环境中的语音. 更多的说话者和反响延长了搜索时间,增加了目光转移,影响了语音理解和本地化.
科学领域:
- 听觉感知是一种听觉感知.
- 人类的运动行为 人类的运动行为
- 声学场景分析 声学场景分析
背景情况:
- 现实世界中的倾听包括头部和眼睛的运动,以增强感官信息.
- 在声学场景探索期间的特定运动模式尚未完全理解.
研究的目的:
- 研究声乐场景复杂性如何影响语音理解和定位期间的头部和眼睛运动行为.
- 根据不同反响和同时说话者的数量来表征运动模式.
主要方法:
- 13名听力正常的参与者在虚拟视听场景中执行了语音理解和本地化任务.
- 声乐场景通过改变反响和同时讲话者的数量来操纵复杂度.
- 在任务期间,追踪头部和眼睛的运动.
主要成果:
- 观察到延迟初始头部运动,同时增加了同时说话者的数量.
- 反响和更多的说话者延长了搜索时间,增加了固定位置,并导致了更多的目光跳跃.
- 响应时间随着说话人数的增加而增加,并且在反响场景中,决策时的头部位置不同.
结论:
- 声乐场景的复杂性显著影响听众在语音理解和本地化过程中的行为.
- 头部和眼睛运动策略适应环境的复杂性,以帮助收集听觉信息.
- 研究结果突出了听觉场景特征和感官运动行为之间的相互作用,以有效地倾听.
更多相关视频
相关概念视频
Perceiving Loudness, Pitch, and Location
203
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
203
Perception of Sound Waves
4.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.4K
Auditory Perception
326
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
326
Hearing
52.0K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.0K
Interference: Path Lengths
1.3K
Consider two sources of sound, that may or may not be in phase, emitting waves at a single frequency, and consider the frequencies to be the same.
Two special sources may be considered when they are in phase. This can be easily achieved by feeding the two sources from the same source. An example would be synchronizing the two speakers by feeding them with the same source, such as the sound waves produced by a tuning fork. This setup ensures that the two sources have the same frequency and are...
Two special sources may be considered when they are in phase. This can be easily achieved by feeding the two sources from the same source. An example would be synchronizing the two speakers by feeding them with the same source, such as the sound waves produced by a tuning fork. This setup ensures that the two sources have the same frequency and are...
1.3K
Auditory Pathway
5.3K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.3K


