Related Experiment Video
Updated: Aug 1, 2025

13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
20.0K
Variance aftereffect within and between sensory modalities for visual and auditory domains.
Sachiyo Ueda1, Reiko Yakushijin2, Akira Ishiguchi3
1Department of Computer Science and Engineering, Toyohashi University of Technology, 1-1 Hibarigaoka, Tempaku-cho, Toyohashi, Aichi, 441-8580, Japan. ueda.sachiyo.ms@tut.jp.
Attention, Perception & Psychophysics
|April 26, 2023
Summary
This study explored variance perception in visual size and auditory pitch over time. Findings suggest that variance information is processed independently within visual and auditory sensory domains.
Area of Science:
- Cognitive psychology
- Sensory perception
- Cross-modal processing
Background:
- Variance is a key summary statistic for understanding information reliability.
- Previous research established variance aftereffects in spatial integration and visual perception.
- The role of variance perception in temporal integration and across different sensory modalities remains less understood.
Purpose of the Study:
- To investigate variance aftereffects in visual size and auditory pitch perception during temporal integration.
- To examine the mechanisms of cross-modal variance perception by testing for aftereffects between visual and auditory stimuli.
- To determine if variance information is processed independently or interactively across sensory domains.
Main Methods:
- Participants performed variance classification tasks on visual size and auditory pitch stimuli.
- Variance aftereffects were measured within-modality (visual-to-visual, auditory-to-auditory) and cross-modally (visual-to-auditory, auditory-to-visual) after adaptation phases.
- Four experimental conditions were used to systematically assess adaptation effects.
Main Results:
- Within-modality adaptation to variance in visual size and small variance in auditory pitch induced significant variance aftereffects.
- Cross-modal adaptation from visual to auditory stimuli showed a weak variance aftereffect.
- Other cross-modal conditions did not yield significant variance aftereffects, suggesting domain-specific processing.
Conclusions:
- Variance perception in visual and auditory domains appears to be largely independent.
- Temporal integration of variance information is subject to modality-specific processing.
- Cross-modal interactions in variance perception are limited, particularly for auditory-to-visual and visual-to-auditory pathways.
Related Concept Videos
Sensory Modalities
1.4K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
1.4K
Auditory Perception
395
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
395
Perceiving Loudness, Pitch, and Location
285
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
285
Factors Affecting Perception
1.7K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
1.7K
Variance
10.0K
The deviations show how spread out the data are about the mean. A positive deviation occurs when the data value exceeds the mean, whereas a negative deviation occurs when the data value is less than the mean. If the deviations are added, the sum is always zero. So one cannot simply add the deviations to get the data spread. By squaring the deviations, the numbers are made positive; thus, their sum will also be positive.
The standard deviation measures the spread in the same units as the...
The standard deviation measures the spread in the same units as the...
10.0K
Perceptual Constancy
473
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
473

