Considerations in Audio-Visual Interaction Models: An ERP Study of Music Perception by Musicians and Non-musicians

Area of Science:

• Neuroscience
• Auditory Perception
• Audiovisual Integration

Background:

• Previous research indicates visual cues predict upcoming sounds, influencing audiovisual (AV) interaction and early auditory event-related potentials (ERPs) like N1 and P2.
• Four AV interaction models exist to analyze these effects, comparing AV stimuli with auditory-only (AO) and video-only (VO) stimuli.

Purpose of the Study:

• To investigate how different AV interaction models affect N1 and P2 suppression in music perception.
• To examine if musical experience influences AV interaction and ERP suppression in musicians versus non-musicians.

Main Methods:

• Participants (musicians and non-musicians) were presented with audio-only (AO), audiovisual (AV), video-only (VO), and control (CO) stimuli of a keyboard note.
• N1 and P2 amplitudes and latencies were analyzed across four AV interaction models.

Main Results:

• Different AV interaction models exhibited distinct patterns of N1 and P2 amplitude and latency suppression.
• The choice of AV interaction model significantly impacted the resulting N1 and P2 difference waves.
• Despite musicians showing higher N1 amplitudes in AO perception, N1 and P2 suppression was similar between musicians and non-musicians across AV models.

Conclusions:

• AV interaction models are not interchangeable and yield different results for N1 and P2 suppression.
• Visual cues predicting upcoming sounds in AV music perception lead to similar early ERP suppression in both musicians and non-musicians.
• The findings highlight the complexity of analyzing AV interactions and suggest consistent predictive processing regardless of musical expertise.