Temporal Detection Threshold of Audio-Tactile Delays With Virtual Button

Synchronization of audio-tactile stimuli represents a key feature of multisensory interactions. However, information on stimuli synchronization remains scarce, especially with virtual buttons. This work used a click sensation produced with traveling waves and auditory stimulus (a bip-like sound) related to a virtual click for a psychological experiment. Participants accomplish a click gesture and judge if the two stimuli were synchronous or asynchronous. Delay injection was performed on the audio (haptic first) or the click (audio first). In both sessions, one stimulus follows the other with a delay ranging from 0-700 ms. We use weighted and transformed 3-up/1-down staircase procedures to estimate people's sensitivity. We found a threshold of 179 ms and 451 ms for the auditory first and haptic first conditions, respectively. Statistical analysis revealed a significant effect between the two stimuli' order for threshold. Participants' acceptable asynchrony decreased when the delay was on the haptic rather than on the audio. This effect could be due to the natural experience in which the stimuli tend to be first tactile and then sonorous rather than the other way around. Our findings will help designers to create multimodal virtual buttons by managing audio-tactile temporal synchronization.