Related Experiment Video
Updated: Jul 8, 2026
07:36
Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
Semantic congruence impacts audiovisual processing in the Colavita effect
Keira Dyck1, Abigail Mitchell1, Jonathan Wilbiks2
1Department of Psychology, Mount Allison University, Sackville, New Brunswick, Canada.
Plos One
|July 6, 2026
Summary
The Colavita effect shows visual dominance in multisensory perception. Semantic congruence between auditory and visual stimuli reduces this effect, suggesting it aids in perceiving stimuli as a unified whole.
Area of Science:
- Psychology
- Cognitive Science
- Neuroscience
Background:
- The Colavita effect demonstrates visual dominance in multisensory integration.
- Previous research indicated this effect is resistant to semantic manipulations.
- Brief auditory stimuli may limit semantic processing in standard Colavita tasks.
Purpose of the Study:
- To investigate if semantic correspondence influences the Colavita effect.
- To explore how semantic congruence impacts visual dominance in audiovisual perception.
- To determine if stimulus category congruence further modulates the Colavita effect.
Main Methods:
- Replicated the Colavita effect using words and sounds as auditory stimuli.
- Manipulated semantic correspondence between auditory (words/sounds) and visual (pictures) stimuli.
- Varied stimulus categories (e.g., same vs. different categories) to assess congruence effects.
Main Results:
- Semantic correspondence significantly influenced the Colavita effect magnitude.
- Incongruent semantic stimuli reduced the Colavita effect compared to congruent stimuli.
- Using stimuli from different categories further decreased the Colavita effect.
Conclusions:
- Semantic congruence plays a role in multisensory integration and the Colavita effect.
- Congruent stimuli are perceived as a unified entity, enhancing integration.
- Incongruent stimuli are less likely to be perceived as a single unit, reducing visual dominance.
Related Concept Videos
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:12Perceptual Constancy
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
01:21Gestalt Principles of Perception
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
01:26Causes of Similarity-Dissimilarity Effect
The similarity-dissimilarity effect, a fundamental concept in social psychology, explains how interpersonal similarities and differences influence attraction and social interactions. This effect is supported by three key psychological perspectives: balance theory, social comparison theory, and consensual validation.Balance Theory and Cognitive ConsistencyBalance theory, developed by Fritz Heider, posits that individuals seek cognitive consistency in their relationships. When two people share...
01:25Factors Affecting Perception
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
01:12Visual Agnosia
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round end"...