在视觉界限的层次学习过程中,神经网络中出现了一个不变的模式
James R Elder1,2,3, Jie Zheng4,5, Lydia B Shimelis6
1Green Center for Systems Biology, University of Texas Southwestern Medical Center, Dallas, TX, USA.
bioRxiv : the preprint server for biology
|February 20, 2025
概括
这项研究介绍了神经网络的等级学习算法,增强了持续的学习并防止了灾难性的遗忘. 这种新方法显示了类似大脑的发射模式和稳定的学习,与传统的反向传播不同.
科学领域:
- 神经科学是一个神经科学.
- 人工智能的人工智能
- 认知科学 认知科学
背景情况:
- 神经回路需要在可塑性和稳定性之间保持平衡,以实现持续学习.
- 灾难性遗忘是人工神经网络中使用端到端训练 (如反向传播) 的常见问题.
研究的目的:
- 调查一个等级学习算法作为反向传播的替代方案.
- 评估算法在视频片段中边界检测的认知任务上的表现.
- 将网络的发射统计数据与人类单个神经元记录进行比较.
主要方法:
- 在边界检测任务中应用层次学习算法.
- 使用层次方法训练神经网络.
- 分析网络图形稳定性和启动统计数据.
- 与经过反向传播训练的网络的结果进行比较.
主要成果:
- 层次训练导致一个网络执行一个固定的方案.
- 该网络的发射统计数据与人类受试者的单个神经元记录相匹配.
- 即使使用稀疏的数据,该方案电路仍然不变.
- 上游表现得到了额外数据的完善.
结论:
- 层次学习为持续学习提供了一种稳定且与大脑一致的方法.
- 这种方法克服了传统人工神经网络中观察到的灾难性遗忘.
- 这些发现表明,对于更强大的人工智能系统来说,有一个潜在的框架.
更多相关视频
07:11Author Spotlight: Insights into Visual Cortex Research Through Wide-View fMRI Mapping
Published on: December 8, 2023
1.4K
12:27Large-scale Reconstructions and Independent, Unbiased Clustering Based on Morphological Metrics to Classify Neurons in Selective Populations
Published on: February 15, 2017
6.9K
相关概念视频
Schemas
11.5K
A schema is a mental construct consisting of a cluster or collection of related concepts (Bartlett, 1932). There are many different types of schemata, and they all have one thing in common: schemata are a method of organizing information that allows the brain to work more efficiently. When a schema is activated, the brain makes immediate assumptions about the person or object being observed.
11.5K
Storage
66
A schema is a mental framework that helps individuals organize and interpret information. Schemata, formed from previous experiences, influence how we process new information: how we encode it, the inferences we make, and how we retrieve it. For instance, a schema for what a typical classroom looks like might include desks, a teacher's desk, a whiteboard, and students in such an environment. This expectation helps us quickly understand and navigate new classrooms without needing to analyze...
66
Visual System
483
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
483
Perceptual Constancy
326
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
326
Gestalt Principles of Perception
273
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
273
Depth Perception and Spatial Vision
522
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
522
