Spatio-Temporally Efficient Coding Assigns Functions to Hierarchical Structures of the Visual System
1Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, Ulsan, South Korea.
Frontiers in Computational Neuroscience
|June 13, 2022
Summary
We propose spatio-temporally efficient coding to explain how the brain processes visual information. This principle optimizes bidirectional pathways in hierarchical structures, improving neural representations and processing efficiency.
Area of Science:
- Computational neuroscience
- Systems neuroscience
- Visual processing
Background:
- Hierarchical brain structures, including the visual system, process external world information.
- Existing computational principles like predictive coding do not fully account for bidirectional pathways (bottom-up and top-down).
Purpose of the Study:
- To propose a novel computational principle for visual hierarchical structures.
- To address the limitations of existing principles in explaining bidirectional information flow.
Main Methods:
- Introduction of spatio-temporally efficient coding as a new computational principle.
- Simulations using natural visual scenes to test the coding principle.
Main Results:
- Spatio-temporally efficient coding successfully assigned functions to visual hierarchical structures.
- The principle predicted neural response deviations to unlearned inputs and orientation biases.
- Optimized bidirectional information transmission by minimizing temporal differences and maximizing representational entropy.
Conclusions:
- Spatio-temporally efficient coding offers a unified principle for understanding hierarchical visual processing.
- This principle enhances the mechanistic understanding of neural computations in hierarchical brain structures.
Related Concept Videos
01:26Visual System
681
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
681
01:24Vision
55.2K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
55.2K
01:20Anatomy of the Eyeball
7.5K
The eye is a spherical, hollow structure composed of three tissue layers. The outer layer — the fibrous tunic, comprises the sclera — a white structure — and the cornea, which is transparent. The sclera encompasses some of the ocular surface, most of which is not visible. However, the 'white of the eye' is distinctively visible in humans compared to other species. The cornea, a clear covering at the front of the eye, enables light penetration. The eye's middle...
7.5K
01:20Parallel Processing
220
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
220
01:32The Retina
70.4K
The retina is a layer of nervous tissue at the back of the eye that transduces light into neural signals. This process, called phototransduction, is carried out by rod and cone photoreceptor cells in the back of the retina.
70.4K
01:15Depth Perception and Spatial Vision
888
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
888