用视觉世界范式和瞳孔测量评估与语音对语音掩饰相关的语音处理和倾听力度
Khaled H A Abdel-Latif1,2, Thomas Koelewijn3,4, Deniz Başkent3,4
1Faculty of Medicine and University Hospital Cologne, Department of Otorhinolaryngology, Head and Neck Surgery, University of Cologne, Cologne, Germany.
Trends in hearing
|January 13, 2025
概括
这项研究引入了一个新的视觉世界范式 (VWP),用于测量语音隔离和语音对语音掩盖期间的听力努力. 研究结果显示,眼动和瞳孔膨胀客观地评估了隔离效率和努力.
科学领域:
- 听觉神经科学 听觉神经科学
- 认知心理学 认知心理学
- 语音感知 语音感知
背景情况:
- 语音对语音掩盖对日常口语沟通构成重大挑战.
- 有效的听力流分离对于在竞争的声音中专注于目标语言至关重要.
- 视觉世界范式 (VWP) 追踪目光以推断语音处理,但其应用于句子级别隔离需要进一步开发.
研究的目的:
- 提出和验证一个新的VWP来检查与竞争的句子语音分离的时间动态.
- 为了利用瞳孔大小作为听力努力的生理测量语音分离期间.
- 评估眼动和瞳孔扩张在客观评估语音对语音分离中的有效性.
主要方法:
- 12名听力正常的参与者在不同的目标对面具比率 (TMRs) 上听到二元竞争矩阵句子.
- 一个修改后的VWP提供了来自目标和掩盖句子的关键词的视觉图标,参与者专注于目标词.
- 记录了眼睛运动 (凝视固定) 和瞳孔大小,以分析分离和倾听力度.
主要成果:
- 对目标词的凝视固定在较高的TMR时增加,这表明在有利的听力条件下语音分离的改善.
- 更的固定曲线斜率与增加的TMR相关,反映出更有效的隔离.
- 随着TMR的增加,瞳孔扩张的减少表明倾听力度下降.
结论:
- 开发的VWP有效地捕捉了反映语音分离能力的眼动.
- 瞳孔膨胀作为一个可靠的客观测量听力努力在语音对语音掩盖场景.
- 结合VWP和学生公里数的方法提供了一个强大的方法来评估基于句子的语音分离和听力.
相关概念视频
Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Non-Verbal Cues
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...


