Perceived synchrony for realistic and dynamic audiovisual events

Area of Science:

• Psychology
• Neuroscience
• Human-Computer Interaction

Background:

• Human temporal sensitivity to audiovisual stimuli varies widely in experiments.
• Factors like stimulus type, duration, and individual differences influence audiovisual synchrony perception.
• Bridging the gap between lab settings and real-world audiovisual perception is crucial.

Purpose of the Study:

• To investigate how audiovisual synchrony perception differs between short, single-event stimuli and long, eventful sequences.
• To compare temporal integration windows across different content types (action, music, speech).
• To inform theories of multisensory perception with more naturalistic stimuli.

Main Methods:

• Comparison of perceived synchrony for short vs. long audiovisual sequences.
• Utilized three content types: action, music, and speech.
• Analyzed temporal integration windows and points of subjective simultaneity.

Main Results:

• Participants detected asynchrony more effectively in longer, eventful audiovisual sequences.
• Temporal integration windows were wider for longer stimuli, likely due to multiple timing cues.
• Points of subjective simultaneity varied significantly across different content types.

Conclusions:

• Real-world audiovisual temporal perception is influenced by stimulus duration and content complexity.
• Existing multisensory perception theories can be tested using more naturalistic audiovisual stimuli.
• Future studies require larger participant numbers due to high inter-individual variability.