视觉虚拟场景和本地化任务对虚拟现实中的听觉距离感知的影响
IEEE transactions on visualization and computer graphics
|March 14, 2025
概括
虚拟现实 (VR) 研究表明,视觉场景显著影响听觉距离感知. 在VR中不一致的视觉环境降低了声音定位的准确性,影响了存在和现实性.
科学领域:
- 听觉感知和认知是一种听觉感知和认知.
- 虚拟现实 (VR) 研究研究
- 人与计算机的互动.
背景情况:
- 虚拟现实 (VR) 能够进行受控的听觉感知研究.
- 虚拟现实中的视觉信息通过多模式集成影响听觉本地化.
- 头戴式显示器 (HMD) 可以扭曲自我中心的距离感知.
研究的目的:
- 调查VR中的视觉场景如何影响听觉距离感知.
- 评估视觉场景一致性和可见性对存在和现实主义的影响.
- 检查不同VR视觉环境对声音本地化任务的影响.
主要方法:
- 使用两个实验范式,参与者在VR中定位真实声音.
- 范式1:虚拟房间模型与物理环境之间的操纵一致性.
- 范式2:多样化的房间可见性 (视听相对应与最小的空间信息) 和定位任务 (虚拟物体放置,行走,口头报告).
主要成果:
- 虚拟房间与实体空间之间的视听不一致会对听觉距离感知产生不利影响.
- 没有发现房间可见性的主要影响,但观察到与定位任务的相互作用.
- 在非空间场景中的虚拟物体放置任务中,听觉距离的高估更大.
结论:
- 在VR中呈现的视觉场景显著影响听觉感知,特别是距离定位.
- 虚拟声学研究必须考虑视觉场景特征在VR中的影响.
- 任务依赖的效果突出显示了视觉和听觉信息处理在沉浸式环境中的复杂相互作用.
相关概念视频
Depth Perception and Spatial Vision
501
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
501
Perceiving Loudness, Pitch, and Location
176
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
176
Auditory Perception
302
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
302


