层层复杂性匹配学习产生了皮质区域V2的改进模型.
Nikhil Parthasarathy1,2, Olivier J Hénaff3, Eero P Simoncelli1,2
1Center for Neural Science, New York University.
ArXiv
|July 29, 2024
概括
我们为人工神经网络开发了一种新的自我监督学习方法,可以更好地模仿早期人类的视觉处理. 与标准培训方法相比,这种方法可以提高模型性能和生物调整.
科学领域:
- 计算神经科学是一种计算神经科学.
- 计算机视觉 计算机视觉 计算机视觉
- 机器学习是机器学习.
背景情况:
- 人类视觉模式识别涉及腹部视觉皮层的层次变化.
- 深度神经网络在视觉处理的后期阶段表现出色,但在早期阶段和生物可信性方面扎.
- 在深度学习中常见的梯度反向传播被认为是生物学上不可信的.
研究的目的:
- 为神经网络开发一种生物可信的自下自上自主监督的训练方法.
- 改进早期视觉处理阶段的建模.
- 在人工视觉模型中增强概括和生物对齐.
主要方法:
- 引入层次复杂性匹配学习 (LCL),使用连续层次的自我监督培训.
- 为局部变形的图像补丁和不同图像中的脱相关特征最大化特征相似性.
- 调整变形幅度与每个层的受体场大小成比例,以匹配任务的复杂性.
主要成果:
- 该LCL配方产生了一种两阶段模型 (LCL-V2),与灵长类动物区域V2选择性和神经活动的改进对齐.
- 复杂性匹配学习被确定为增强生物对齐的关键因素.
- 该LCL-V2前端改进了对象识别模型 (LCL-V2Net) 在分布之外的概括和人类行为对齐方面.
结论:
- 层层复杂性匹配学习为训练人工视觉系统提供了更具生物学可信性和有效的方法.
- 这种方法弥合了深度学习模型和人类早期视觉处理之间的差距.
- 开发的模型表现出卓越的性能,更好地模仿人类的视觉能力.
相关概念视频
01:21Association Areas of the Cortex
5.2K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.2K
01:14Motor and Sensory Areas of the Cortex
3.6K
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
3.6K
01:27Associative Learning
324
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
324
01:25Neural Circuits
1.1K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.1K
01:21Cognitive Learning
237
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
237
01:24Somatosensory, Motor, and Association Cortex
459
The somatosensory cortex in the parietal lobes is crucial for interpreting sensory data such as touch, temperature, and proprioception. The somatosensory cortex, situated in the parietal lobes, plays a vital role in interpreting sensory information like touch, temperature, and proprioception—awareness of body position. This specialized brain region features an organized structure wherein neurons at the top primarily process sensations originating from the lower body. In contrast, those at...
459