相关实验视频
Updated: May 20, 2025

07:14
A Method to Study Adaptation to Left-Right Reversed Audition
Published on: October 29, 2018
6.4K
多模式神经声学场用于沉浸式混合现实
IEEE transactions on visualization and computer graphics
|March 26, 2025
概括
我们开发了神经声学场,为沉浸式虚拟和真实环境创建现实的空间声音. 这种方法从视觉和几何数据中合成音频,增强混合现实应用中的存在.
科学领域:
- 计算机视觉 计算机视觉
- 声学 声学 在声学方面
- 机器学习 机器学习
背景情况:
- 神经辐射场 (NeRFs) 擅长从图像中合成新的场景视图.
- 合成现实的空间音频,特别是在新环境中,仍然是一个挑战.
研究的目的:
- 引入多式神经声学场来合成空间声音.
- 从新的观点和未见过的环境中实现沉浸式的听觉体验.
- 加强在增强现实和虚拟现实应用中的存在.
主要方法:
- 开发了一个神经网络模型,将环境几何和视觉特征映射到音频特征.
- 引入了一种混合变压器-卷积神经网络,用于捕捉反响和产生空间声音.
- 利用来自稀疏位置的视听数据来表示空间声学.
主要成果:
- 该方法成功地产生了像反响这样的非线性声学效应.
- 与合成和现实数据的现有方法相比,证明了空间音频质量的改进.
- 通过用户研究,通过沉浸式混合现实应用程序验证了增强的音频感知.
结论:
- 多模式神经声学场为合成现实的空间音频提供了一种新的方法.
- 提出的方法有效地学习和产生空间声学,以获得沉浸式体验.
- 这项技术在推进增强现实和虚拟现实应用方面具有重大潜力.
相关概念视频
Perception of Sound Waves
4.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.4K
Hearing
51.7K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
51.7K
Auditory Pathway
4.5K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
4.5K

