扬声器故事映射作为一种评估视听场景分析在虚拟课堂场景中的方法
Stephan Fremerey1, Carolin Breuer2, Larissa Leist3
1Audiovisual Technology Group, Technische Universität Ilmenau, Ilmenau, Germany.
Frontiers in psychology
|June 25, 2025
概括
这项研究表明,沉浸式虚拟环境 (IVEs) 可以评估认知表现. 不同的视听设置在虚拟课堂场景中显著影响了任务性能和心理负载.
科学领域:
- 认知心理学 认知心理学
- 虚拟现实研究 虚拟现实研究
- 人与计算机的交互
背景情况:
- 在虚拟环境中评估认知表现的传统方法有局限性.
- 视听场景分析 (AV-SA) 是一种评估个人如何同时处理听觉和视觉信息的范式.
- 沉浸式虚拟环境 (IVEs) 为更现实的认知评估提供了潜力.
研究的目的:
- 评估视听场景分析 (AV-SA) 在沉浸式虚拟环境 (IVE) 中的有效性,以评估认知表现.
- 研究不同声学和视觉表现对视听场景分析在虚拟课堂环境中的影响.
- 确定音频 (二声与双声) 和视觉 (360°视频与CGI) 刺激的变化如何影响认知任务性能和用户体验.
主要方法:
- 在虚拟课堂中,使用不同组合的二声/双耳音频和360度视频/CGI视觉进行了三项实验.
- 参与者 (n=36,24,34) 执行了一个扬声器故事映射任务,其中20个同时活跃的扬声器中有2-10个.
- 依赖变量包括正确的分配,心理负载,模拟器疾病,噪音敏感性和存在.
主要成果:
- 实验条件显著影响了任务执行和心理负载.
- 当将360度视频与双声音频与二声音频或CGI视觉图像进行比较时,认知性能下降.
- 模拟器的疾病和存在没有受到实验条件的显著影响.
结论:
- 沉浸式虚拟环境 (IVEs) 中的视听场景分析 (AV-SA) 是评估认知表现的可行方法.
- 视听场景的声音和视觉场景表现的质量对视听场景分析产生了重大影响.
- 这种方法可以有效地揭示不同的感官输入如何影响虚拟环境中的认知处理.
相关概念视频
Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...


