Related Experiment Video
Updated: Jul 8, 2025

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
The impact of crossmodal predictions on the neural processing of aesthetic stimuli
Marianne Tiihonen1,2, Niels Trusbak Haumann1, Yury Shtyrov3
1Center for Music in the Brain (MIB), Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus, Midtjylland, 8200, Denmark.
Abstract:
Neuroaesthetic research has focused on neural predictive processes involved in the encounter with art stimuli or the related evaluative judgements, and it has been mainly conducted unimodally. Here, with electroencephalography, magnetoencephalography and an affective priming protocol, we investigated whether and how the neural responses to non-representational aesthetic stimuli are top-down modulated by affective representational (i.e. semantically meaningful) predictions between audition and vision. Also, the neural chronometry of affect processing of these aesthetic stimuli was investigated. We hypothesized that the early affective components of crossmodal aesthetic responses are dependent on the affective and representational predictions formed in another sensory modality resulting in differentiated brain responses, and that audition and vision indicate different processing latencies for affect. The target stimuli were aesthetic visual patterns and musical chords, and they were preceded by a prime from the opposing sensory modality. We found that early auditory-cortex responses to chords were more affected by valence than the corresponding visual-cortex ones. Furthermore, the assessments of visual targets were more facilitated by affective congruency of crossmodal primes than the acoustic targets. These results indicate, first, that the brain uses early affective information for predictively guiding aesthetic responses; second, that an affective transfer of information takes place crossmodally, mainly from audition to vision, impacting the aesthetic assessment. This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectives'.
Related Concept Videos
Factors Affecting Perception
An illustrative example of a perceptual set is the scenario where an airline pilot told...
Parallel Processing
Synesthesia
Motor and Sensory Areas of the Cortex
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
Vision
Color Vision

