低分辨率表示的自上而下的生成可以改善视觉感知和想象力
Zedong Bi1, Haoran Li2, Liang Tian3
1Lingang Laboratory, Shanghai 200031, China.
概括
低分辨率的自上而下的信号通过更好地重建稀疏的神经活动来帮助视觉感知和想象力. 这一原则也启发了人工智能技术,用于生成高质量的细线素描.
科学领域:
- 神经科学是一个神经科学.
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 视觉感知和想象力依赖于从大脑上层区域到主要视觉皮层 (V1) 的上下信号.
- 在V1中,自上而下的信号与自下而上的视觉输入相比,空间分辨率较低.
- 使用低分辨率信号用于高分辨率表示重建的功能优势尚不清楚.
研究的目的:
- 研究低分辨率上下信号在视觉感知和想象中的作用.
- 探索低分辨率信号促进表示重建的潜在机制.
- 将这些发现应用于改进基于AI的草图生成技术.
主要方法:
- 利用变化自编码器 (VAE) 的解码器来模拟上下视觉路径.
- 使用低分辨率信号分析了稀疏V1简单细胞活动的重建.
- 研究了人工智能生成的草图,重点是线条厚度,并提出了一种使用模糊草图和VAE或GAN的新型生成技术.
主要成果:
- 低分辨率的上下信号有效地从稀疏的V1简单细胞活动中重建信息,增强感知和想象力.
- 这种低分辨率生成有助于在更高的皮层区域形成符合几何形状的表示.
- 草图生成质量对线条厚度敏感;细线草图具有挑战性. 使用模糊素描的技术可以改善细线素描生成.
结论:
- 低分辨率的自上而下的信号处理是一种神经战略,用于高效的视觉感知和想象.
- 这一策略使大脑能够处理稀疏的表示,并形成连贯的视觉感知.
- 研究结果提供了对人工智能素描生成的见解,特别是在生产高质量的薄线图像方面.
相关概念视频
01:24Vision
53.4K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.4K
01:15Depth Perception and Spatial Vision
661
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
661
01:26Visual System
585
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
585
01:21Gestalt Principles of Perception
311
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
311
01:28Perception
465
Perception is a fundamental psychological process that enables individuals to organize, interpret, and consciously experience sensory information. This process is crucial for understanding and interacting with the world around us. It includes both bottom-up and top-down processing, each playing a distinct role in how we perceive our environment.
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
465
01:20Parallel Processing
152
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
152