The audio-visual integration effect on music emotion: Behavioral and physiological evidence

Area of Science:

• Neuroscience
• Psychology
• Music Cognition

Background:

• Audio-visual congruent presentations enhance emotional responses compared to audio-only.
• Understanding audio-visual integration in music-induced emotions is crucial.

Purpose of the Study:

• Investigate audio-visual integration effects on emotions elicited by positive and negative music.
• Examine the role of visual information presentation durations in this integration.

Main Methods:

• Participants experienced audio-only, audio-visual congruent, and audio-visual incongruent conditions.
• Emotional intensity was measured via self-ratings and physiological responses (heart rate, skin temperature, EMG, EEG).

Main Results:

• Audio-visual congruent presentation led to more intense emotional responses than audio-only.
• Audio-visual integration occurred for both positive and negative music.
• The integration effect was larger for positive music; for negative music, it was strongest with visual information presented within 80 seconds.

Conclusions:

• Audio-visual integration significantly modulates music-induced emotions.
• The magnitude of audio-visual integration differs between positive and negative music.
• Visual presentation duration plays a significant role in modulating negative music-induced emotions.