Related Experiment Video
Updated: May 23, 2025
04:40
Tactile Semiautomatic Passive-Finger Angle Stimulator TSPAS
Published on: July 30, 2020
2.8K
Perceptual Alignment of Spatial Auditory and Tactile Stimuli for Effective Directional Cueing
IEEE Transactions on Visualization and Computer Graphics
|March 7, 2025
Summary
This study found that slight misalignments in spatial audio and tactile cues, within the just noticeable difference (JND) range, do not hinder hazard avoidance in virtual reality. Perceptual alignment is key for effective spatial audio-tactile systems.
Area of Science:
- Human-Computer Interaction
- Multisensory Perception
- Virtual Reality
Background:
- Spatial audio and directional tactile cues enhance target localization and collision avoidance.
- Effective multisensory integration relies on accurate spatial alignment of auditory and tactile stimuli.
- Challenges exist in achieving precise spatial alignment for multisensory cues.
Purpose of the Study:
- Determine the just noticeable differences (JNDs) for directional auditory and tactile stimuli.
- Assess hazard avoidance performance using misaligned multisensory cues within JNDs.
- Inform the design of spatial audio-tactile rendering systems for extended reality (XR).
Main Methods:
- Investigated just noticeable differences (JNDs) of directional cues in the horizontal plane.
- Evaluated hazard avoidance performance with auditory and tactile stimuli misaligned within JNDs.
- Measured performance and usability of spatial audio-tactile systems.
Main Results:
- Just noticeable differences (JNDs) for directional cues increased from 26° to 84° from the body's center to its side.
- Perceptual alignment within JND ranges provided hazard avoidance performance comparable to exact physical alignment.
- Usability of systems with cues aligned within JNDs was similar to precisely aligned systems.
Conclusions:
- Spatial audio and tactile cue alignment within just noticeable difference ranges is sufficient for effective hazard avoidance.
- Findings support the development of more tolerant and efficient spatial audio-tactile rendering for extended reality (XR).
- This research contributes to designing intuitive and effective multisensory feedback systems.
Related Concept Videos
01:15Depth Perception and Spatial Vision
503
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
503
01:17Auditory Perception
305
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
305
01:15Auditory Pathway
4.6K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
4.6K
01:13The Cochlea
44.4K
The cochlea is a coiled structure in the inner ear that contains hair cells—the sensory receptors of the auditory system. Sound waves are transmitted to the cochlea by small bones attached to the eardrum called the ossicles, which vibrate the oval window that leads to the inner ear. This causes fluid in the chambers of the cochlea to move, vibrating the basilar membrane.
44.4K
01:21Perceiving Loudness, Pitch, and Location
177
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
177
01:31Hearing
51.7K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
51.7K