Related Experiment Video
Updated: Oct 26, 2026

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
A hierarchical framework of representational emergence: From feature binding to supramodal emergence
Evangelos Paraskevopoulos1, Panagiotis Bamidis2
1Department of Psychology, University of Cyprus, Nicosia 2109, Cyprus.
Abstract:
Multisensory integration is traditionally conceptualized as transient, stimulus-driven feature binding. Here, we propose a hierarchical framework that reconceptualizes multisensory processing as a continuum of representational emergence across three distinct levels: level I (multimodal binding), where features are integrated via probabilistic causal inference; level II (supramodal representation), where recurrent co-activation and value-guided selection establish consolidated, perceptual-semantic engrams that act as emergent modalities; and level III (amodal concepts), where meaning becomes increasingly detached from sensory form and is represented within transmodal semantic networks. Drawing on recent mammalian evidence for cross-modal associative memory neurons and experience-dependent network reorganization, this framework proposes how local synaptic selection may scale into increasingly autonomous cognitive modules. Finally, we delineate an empirical roadmap and outline implications for supramodal AI, toward architectures capable of more autonomous semantic representation and generation.
Related Concept Videos
Symbolic Understanding I: Pictorial Competence
Hierarchy of Motor Control
Preoperational Thought I: The Symbolic Function
Preoperational Thought II: Object Space and Causality
Gestalt Principles of Perception
Preoperational Thought III: Identities and Categorization