Related Experiment Video
Updated: Jun 23, 2025
07:14
A Method to Study Adaptation to Left-Right Reversed Audition
Published on: October 29, 2018
6.5K
The Effect of Training on Localizing HoloLens-Generated 3D Sound Sources
Wonyeol Ryu1, Sukhan Lee2, Eunil Park3
1Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon 16419, Republic of Korea.
Sensors (Basel, Switzerland)
|June 19, 2024
Summary
Virtual reality (VR) audio simulations can be improved through training. Combining kinesthetic/postural guidance with visual and sound cues significantly enhances users' sound localization abilities in VR.
Area of Science:
- Auditory Perception and Virtual Reality
- Human-Computer Interaction
- Acoustics and Signal Processing
Background:
- Sound localization is vital for auditory perception and immersive virtual reality (VR) experiences.
- Current VR audio simulations often lack accuracy due to individual differences in head-related transfer functions (HRTFs).
- Discrepancies exist between user-perceived sound locations and VR platform-generated audio.
Purpose of the Study:
- To investigate the accuracy of sound source localization in VR environments.
- To determine if users can adapt to VR-generated sound through training.
- To evaluate the effectiveness of different training modes on improving sound localization in VR.
Main Methods:
- Utilized Microsoft HoloLens 2 for VR audio simulation.
- Collected data from 12 subjects over six training sessions within 2 weeks.
- Employed and compared three training modes: multimodal error, visual, and sound guidance with kinesthetic/postural guidance.
Main Results:
- A statistically significant improvement in sound localization was observed between pre- and post-training sessions.
- Training combining kinesthetic/postural guidance with visual and sound cues proved most effective.
- Visual error guidance alone showed minimal effectiveness in improving sound localization.
- No significant statistical retention effect was found across all training modes after the 2-week period.
Conclusions:
- Multimodal training, especially incorporating kinesthetic/postural guidance, can significantly enhance user sound localization in VR.
- Visual error guidance alone is insufficient for effective training.
- Further research is needed to understand long-term retention of learned sound localization skills in VR environments.
- Findings can inform the design of more accurate and personalized VR audio systems.
More Related Videos
Related Concept Videos
01:21Perceiving Loudness, Pitch, and Location
205
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
205
01:31Hearing
52.0K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.0K
01:13The Cochlea
44.7K
The cochlea is a coiled structure in the inner ear that contains hair cells—the sensory receptors of the auditory system. Sound waves are transmitted to the cochlea by small bones attached to the eardrum called the ossicles, which vibrate the oval window that leads to the inner ear. This causes fluid in the chambers of the cochlea to move, vibrating the basilar membrane.
44.7K