教导深度网络看到形状:从简化视觉世界的教训
Christian Jarvers1, Heiko Neumann1
1Institute for Neural Information Processing, Ulm University, Ulm, Germany.
PLoS computational biology
|November 11, 2024
概括
深度神经网络难以模拟灵长类视觉,因为它们过度依赖颜色和纹理而不是形状. 新的研究表明,特定的学习算法可以改善深度网络.
科学领域:
- 计算神经科学是一种计算神经科学.
- 人工智能的人工智能是人工智能.
- 计算机视觉 计算机视觉 计算机视觉
背景情况:
- 深度神经网络 (DNN) 是灵长类动物视觉系统的成功模型.
- 与目前的模型不同,DNN在人类视觉中表现出强烈的形状依赖性.
- 人类优先考虑类别判断的形状,而DNN更喜欢颜色和纹理.
研究的目的:
- 调查为什么DNN无法捕捉灵长类视觉的形状依赖.
- 确定DNN偏向非形状特征的根本原因.
- 提出解决方案,以提高DNN对形状的敏感性.
主要方法:
- 设计的人工图像数据集,具有孤立的形状,颜色和纹理特征.
- 在这些数据集上从头开始训练DNN,使用单个特征和组合.
- 分析了网络架构和学习算法,特别是迷你批量梯度下降.
主要成果:
- 一些DNN架构无法有效地学习形状特征.
- 其他建筑表现出对颜色和纹理的偏见,尽管能够学习形状.
- 这种偏差与小型批量梯度下降期间的重量更新相互作用有关.
结论:
- 目前的DNN和学习算法没有针对基于形状的视觉处理进行优化.
- 迷你批量梯度下降有助于对形状特征的偏差.
- 开发具有较少,更局部重量变化的学习算法对于改善DNN的形状灵敏度和建模人类视觉至关重要.
相关概念视频
Depth Perception and Spatial Vision
593
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
593
Gestalt Principles of Perception
279
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
279
Visual System
551
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
551
Visual Agnosia
176
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round...
176
Vision
52.9K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
52.9K
Role of Shaping in Operant Conditioning
267
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
267


