Temporal Detection Threshold of Audio-Tactile Delays With Virtual Button

Area of Science:

• Human-Computer Interaction
• Multisensory Perception
• Virtual Reality Interfaces

Background:

• Synchronization of audio-tactile stimuli is crucial for effective multisensory interactions.
• Limited research exists on audio-tactile synchronization, particularly for virtual interfaces like buttons.

Purpose of the Study:

• To investigate the temporal synchronization perception of audio-tactile stimuli for virtual buttons.
• To determine how the order of audio and tactile stimuli affects perceived synchrony.
• To inform the design of multimodal virtual buttons.

Main Methods:

• A psychological experiment was conducted using virtual buttons with traveling wave-induced tactile feedback and bip-like auditory stimuli.
• Participants judged the synchrony of stimuli with delays introduced to either the audio or tactile feedback.
• Weighted and transformed 3-up/1-down staircase procedures were employed to measure perceptual thresholds.

Main Results:

• The just-noticeable difference (JND) for synchrony was 179 ms when audio preceded haptics, and 451 ms when haptics preceded audio.
• A significant effect of stimulus order on the synchronization threshold was observed.
• Participants tolerated less asynchrony when the tactile stimulus was delayed compared to the auditory stimulus.

Conclusions:

• The order of audio-tactile stimuli significantly impacts perceived synchrony, with a tactile-first presentation being more sensitive to delays.
• This difference may stem from natural sensory experiences where tactile sensations often precede auditory ones.
• Findings provide essential guidance for optimizing temporal synchronization in virtual multimodal interfaces.