Related Experiment Video
Updated: Jul 29, 2025
03:31
Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
Published on: December 15, 2023
591
A brain-inspired object-based attention network for multiobject recognition and visual reasoning
Hossein Adeli1,2, Seoyoung Ahn1,3, Gregory J Zelinsky1,4,5
1Department of Psychology, Stony Brook University, Stony Brook, NY, USA.
Journal of Vision
|May 22, 2023
Summary
This study introduces a novel attention model for visual systems, enhancing object recognition and reasoning by learning to control sequential glimpses. The model improves accuracy in complex tasks like digit classification and object comparison.
Area of Science:
- Computational neuroscience
- Computer vision
- Artificial intelligence
Background:
- The human visual system employs sequential glimpses for object recognition and goal-directed behavior.
- Understanding the learning mechanisms behind visual attention control is crucial for artificial systems.
Purpose of the Study:
- To develop an encoder-decoder model simulating brain's visual pathways for attention control.
- To investigate how object-based attention mechanisms improve visual task performance.
Main Methods:
- Implemented an encoder-decoder architecture with "what" (object-centric) and "where" (attentional) pathways.
- Utilized feedforward, recurrent, and capsule layers for visual processing and attention modulation.
- Modeled sequential glimpse selection and top-down attentional feedback.
Main Results:
- Achieved significant accuracy improvement in classifying highly overlapping digits.
- Demonstrated near-perfect accuracy in a visual reasoning task involving object comparison.
- Showcased superior generalization to unseen stimuli compared to larger models.
Conclusions:
- Object-based attention mechanisms, utilizing sequential glimpses, offer substantial benefits for visual recognition and reasoning.
- The proposed model provides insights into learning attention control within biological and artificial visual systems.
Related Concept Videos
01:21Association Areas of the Cortex
5.6K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.6K
01:26Visual System
628
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
628
01:24Vision
53.7K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.7K
01:20Parallel Processing
187
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
187
01:12Visual Agnosia
247
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round...
247
01:14Motor and Sensory Areas of the Cortex
4.1K
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
4.1K