Related Experiment Video
Updated: Nov 19, 2025
09:13
Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
Published on: April 22, 2015
16.8K
Optimality and Limitations of Audio-Visual Integration for Cognitive Systems.
William Paul Boyce1, Anthony Lindsay1, Arkady Zgonnikov2,3
1Intelligent Systems Research Centre, Ulster University, Magee Campus, Derry Londonderry, Northern Ireland, United Kingdom.
Frontiers in Robotics and AI
|January 27, 2021
Summary
Multimodal integration combines sensory information for optimal perception. However, this process can lead to illusions, highlighting the need for careful design in artificial cognitive systems.
Area of Science:
- Cognitive Science
- Neuroscience
- Artificial Intelligence
Background:
- Multimodal integration is key to human perceptual decision-making, often achieving statistical optimality.
- Sensory information combination aims to minimize perceptual errors but can result in illusory percepts.
- Audio-visual facilitations and illusions arise from multisensory integration.
Purpose of the Study:
- To review audio-visual facilitations and illusions resulting from multisensory integration.
- To examine computational models explaining these phenomena.
- To provide considerations for designing artificial cognitive systems to avoid integration-induced illusions.
Main Methods:
- Review of existing literature on multisensory integration and audio-visual illusions.
- Analysis of computational models explaining perceptual phenomena.
- Discussion of implications for artificial cognitive systems.
Main Results:
- Optimal computational models for multisensory integration can paradoxically lead to illusory percepts.
- Audio-visual illusions are a consequence of the same integration processes that enable optimal perception.
- Understanding these illusions is crucial for mitigating artifacts in artificial systems.
Conclusions:
- Detailed understanding of multisensory integration and audio-visual illusions is essential for developing robust artificial cognitive systems.
- Further research is needed to detect and mitigate illusions as artifacts in AI.
- Considerations for system design should focus on avoiding pitfalls in multisensory integration.
Related Concept Videos
01:26Visual System
1.4K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
1.4K
01:14Motor and Sensory Areas of the Cortex
5.8K
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
5.8K
01:20Introduction to Cognitive Psychology
1.9K
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
1.9K
01:05Cerebral Hemispheres
1.5K
The human brain, a complex organ, is functionally divided into two cerebral hemispheres—left and right. These hemispheres are interconnected by a structure of paramount importance, the corpus callosum. This substantial bundle of neural fibers is not just a bridge between the hemispheres but a crucial element for the brain's comprehensive functioning. It enables efficient communication between the two hemispheres, allowing each side of the brain to control and receive sensory and motor...
1.5K
01:20Parallel Processing
441
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
441
01:17Cognitivism
2.5K
Cognitive psychology emerged as a significant field in the mid-20th century. It focused on understanding humans' internal mental processes. This approach emphasizes how people perceive, remember, think, and solve problems—elements critical to human cognition.
Previously dominated by behaviorism, which prioritized observable behaviors and largely ignored mental processes, psychology transformed in the 1950s. Cognitive psychologists argue that understanding how we think and process...
Previously dominated by behaviorism, which prioritized observable behaviors and largely ignored mental processes, psychology transformed in the 1950s. Cognitive psychologists argue that understanding how we think and process...
2.5K