重新评估视听整合到语音感知和可理解性的好处
Brandon O'Hanlon1, Christopher J Plack1,2, Helen E Nuttall1
1Department of Psychology, Lancaster University, United Kingdom.
Journal of speech, language, and hearing research : JSLHR
|December 2, 2024
概括
这项研究发现,视听唇读对语音感知的好处不如以前想象的,尤其是在考虑不同的视觉类别时. 刺激开始异步 (SOA) 增加了反应时间,但没有影响语音感知任务的准确性.
科学领域:
- 听觉和视觉神经科学 听觉和视觉神经科学
- 语音感知研究研究 语音感知研究
- 人与计算机的交互
背景情况:
- 唇读 (视觉语音感知) 在杂的环境中增强听觉语音理解.
- 刺激开始异步 (SOA) 对于理解视听语音集成至关重要.
- 关于视听效益和SOA整合期的先前研究显示了广泛的变化,部分原因是视觉上不同的语音 (visemes) 的不一致选择.
研究的目的:
- 用不同的视觉类别重新评估视听唇读对语音感知的好处.
- 为了研究各种SOA对语音感知的影响,在噪音中的不同维度.
主要方法:
- 60名参与者完成了一项在线研究,涉及仅有音频和视听语言刺激.
- 在6个SOA (0266.6 ms) 中,刺激与或没有噪音呈现.
- 参与者通过按下按来识别语音音节,区分刺激.
主要成果:
- 观察到的视听效益不如之前的研究那么明显.
- 通过SOA观察到反应时间的增加,但准确性没有受到影响.
- 探索性分析表明,viseme类别影响了识别难度",Ba"在噪音方面比"ka"更难.
结论:
- 视听整合对语音处理的贡献在精心选择视觉时较弱.
- 该研究没有根据测试的SOA确定视听语音感知的最终整合期.
更多相关视频
11:39Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022
2.1K
06:04Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
Published on: March 24, 2023
336
相关概念视频
Visual System
509
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
509
Auditory Perception
317
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
317
Perceiving Loudness, Pitch, and Location
192
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
192
Auditory Pathway
4.7K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
4.7K
Hearing
51.8K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
51.8K
Higher Mental Functions of the Brain: Language
735
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
735
