Related Experiment Video
Updated: Apr 3, 2026
06:54
Photorealistic Learned Landscapes for Augmented Reality
Published on: June 27, 2025
870
Tuning Immersion and Performance with Adaptive Generative Music in VR
IEEE Transactions on Visualization and Computer Graphics
|April 1, 2026
Summary
AI-generated adaptive music in virtual reality (VR) enhances immersion and emotional impact. Moderate musical tension improved archery performance, while excessive tension impaired accuracy and speed.
Area of Science:
- Human-computer interaction
- Virtual reality (VR)
- Artificial intelligence (AI)
Background:
- Music in virtual environments is typically static, rarely adapting to player actions.
- Advances in AI and procedural audio enable real-time adaptive music generation.
- The behavioral impact of adaptive generative soundtracks in VR is under-explored.
Purpose of the Study:
- To investigate the behavioral impact of AI-generated adaptive music in a VR archery system.
- To explore how adaptive music influences immersion, focus, stress, and performance.
Main Methods:
- Developed a VR archery system integrating Google MusicFXDJ and Ubiq-Genie for AI-generated adaptive music.
- Conducted a within-subjects experiment (N=22) comparing fixed vs. adaptive soundtracks.
- Collected self-reported data on presence, focus, stress, and emotional impact, alongside performance metrics (accuracy, aiming time).
Main Results:
- Adaptive generative music significantly heightened immersion and emotional salience.
- Music-driven arousal modulated motor precision in an inverted-U pattern.
- Moderate musical tension improved accuracy and speed; excessive tension led to performance degradation.
Conclusions:
- AI-generated adaptive music serves as a potent behavioral feedback modality in VR.
- Adaptive music can optimize performance by modulating arousal levels.
- This technology offers potential for training, rehabilitation, and immersive entertainment.
Related Concept Videos
01:17Sound as Pressure Waves
4.8K
Sound waves, which are longitudinal waves, can be modeled as the displacement amplitude varying as a function of the spatial and temporal coordinates. As a column of the medium is displaced, its successive columns are also displaced. As the successive displacements differ relatively, a pressure difference with the surrounding pressure is created. The gauge pressure varies across the medium.
The pressure fluctuation depends on the difference in displacements between the successive points in the...
The pressure fluctuation depends on the difference in displacements between the successive points in the...
4.8K
01:01Perception of Sound Waves
6.0K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
6.0K
01:06Virtual Work for a System of Connected Rigid Bodies
850
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
Next,...
850
01:17Auditory Perception
1.5K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.5K
01:21Perceiving Loudness, Pitch, and Location
1.3K
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
1.3K
01:19Vibrating Concrete
1.3K
Mechanical vibrators are instrumental in compacting newly poured concrete within formwork and around reinforcements. This process is essential to eliminate trapped air pockets and establish a dense concrete mass. One widely used method is vibrating by internal vibrators, often referred to as a poker vibrator or immersion vibrator. It is rapidly inserted through the full depth of the freshly laid concrete and slightly extends into the layer below it (which remains in a plastic state). Consistent...
1.3K