听觉和视觉沉浸在虚拟环境中的语言层面上的时间效应
Xinyi N Zhang1,2, Arian Shamei1,2, Florian Grond3
1Department of Electrical Engineering, École de Technologie Supérieure, Montréal, Québec H3C 1K3, Canada.
The Journal of the Acoustical Society of America
|January 13, 2026
概括
人们根据视觉房间线索调整语音水平,但听觉反更为占主导地位. 这项研究探讨了虚拟环境中的视觉和听觉信息如何影响语音的产生.
科学领域:
- 多感官集成的整合.
- 演讲制作 演讲制作
- 人与计算机的互动.
背景情况:
- 语音产生受到物理环境的影响,包括视觉和声学特性.
- 在语音制作中,房间的视觉线索与其实际声学之间的相互作用尚未得到充分理解.
- 以前的研究表明,回声会影响语音水平,但与视觉信息的相互作用是有限的.
研究的目的:
- 调查视听信息如何影响语言水平.
- 检查不同反响和房间视觉对语音产生的影响.
- 了解视觉和听觉影响语言的时间动态.
主要方法:
- 参与者在虚拟环境中完成了语音任务,控制了反响和视觉房间特征 (hemi-anechoic房间,教室,体育馆).
- 使用通用添加混合效应建模来分析语音水平,以评估时间变化.
- 在不同视听条件下比较语音水平.
主要成果:
- 视觉信息显著影响了语音水平,但并不总是根据感知到的声学或房间大小而预期的.
- 与视觉信息相比,听觉信息对语音水平的整体影响更强.
- 视觉对语音水平的影响最初很强,但随着时间的推移而减少,而听觉的影响则增长和稳定.
结论:
- 视觉线索在调节语音水平方面发挥着作用,补充了听觉反.
- 听觉信息对语音水平调节的影响比视觉信息更大.
- 这些发现有助于我们更好地理解多感官集成在语音控制中的应用,其中包括虚拟通信和语音表现增强的应用.
相关概念视频
01:17Auditory Perception
1.0K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.0K
01:21Perceiving Loudness, Pitch, and Location
925
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
925
01:01Perception of Sound Waves
5.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.4K