Related Experiment Video
Updated: Mar 27, 2026

13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
20.6K
Spatiotemporal Processing in Crossmodal Interactions for Perception of the External World: A Review
Souta Hidaka1, Wataru Teramoto2, Yoichi Sugita3
1Department of Psychology, Rikkyo University Saitama, Japan.
Frontiers in Integrative Neuroscience
|January 7, 2016
Summary
Multisensory information from different senses interact in spatiotemporal processing. Recent research shows sound and other senses can drive visual motion perception, challenging older views.
Area of Science:
- Neuroscience
- Cognitive Science
- Psychology
Background:
- Crossmodal interactions, where sensory information influences perception, are extensively studied.
- Traditionally, vision dominates spatial processing, while audition excels in temporal processing.
- Visual capture suggests vision often dominates spatiotemporal perception.
Purpose of the Study:
- To review past and recent findings on spatiotemporal processing in crossmodal interactions.
- To explore how different sensory modalities influence motion perception.
- To investigate the underlying neural mechanisms of multisensory spatiotemporal integration.
Main Methods:
- Literature review of perceptual and neuroimaging studies.
- Analysis of findings on crossmodal influences in motion perception.
- Examination of studies on associative learning and sensory-driven perception.
Main Results:
- Recent studies show auditory and other sensory inputs can drive visual motion perception.
- Perceptual associative learning can link non-spatial sounds to visual motion.
- Brain imaging reveals overlapping neural activation patterns for spatiotemporal processing across senses.
Conclusions:
- Multimodal information mutually interacts in spatiotemporal perception.
- Common perceptual and neural mechanisms underlie spatiotemporal processing across senses.
- Challenging traditional views, audition and other senses can actively influence visual motion perception.
Related Concept Videos
Perception
1.7K
Perception is a fundamental psychological process that enables individuals to organize, interpret, and consciously experience sensory information. This process is crucial for understanding and interacting with the world around us. It includes both bottom-up and top-down processing, each playing a distinct role in how we perceive our environment.
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
1.7K
Parallel Processing
877
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
877
Factors Affecting Perception
3.1K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
3.1K
Depth Perception and Spatial Vision
2.6K
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
2.6K
Sensory Perception: Organization of the Somatosensory System
12.3K
The somatosensory system is the central and peripheral nervous system component that senses and processes touch, pressure, pain, temperature, and body position or proprioception. The process of sensation takes place at three levels:
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the...
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the...
12.3K
Vision
61.4K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
61.4K

