相关实验视频
Updated: Jun 13, 2025

07:13
3D Modeling of Dendritic Spines with Synaptic Plasticity
Published on: May 18, 2020
6.8K
一个像Hebbian这样的学习规则可以避免稀疏分布式数据中的维度的诅咒吗?
Maria Osório1, Luis Sa-Couto2, Andreas Wichert2
1Department of Computer Science and Engineering, INESC-ID & Instituto Superior Técnico - University of Lisbon, Av. Prof. Dr. Aníbal Cavaco Silva, Porto Salvo, 2744-016, Lisbon, Portugal. maria.osorio@tecnico.ulisboa.pt.
Biological cybernetics
|September 9, 2024
概括
在受限制的博尔兹曼机器 (RBMs) 中的Hebbian学习有效地解决了稀疏数据中维度的诅咒. 在这些数据集上,RBM表现出强烈的概括性,在这些数据集上表现优于传统的反向传播神经网络.
科学领域:
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 大脑的稀疏分布式表示是高维的,由于维度的诅咒,对传统的机器学习模型构成挑战.
- 具有许多层和反向传播的深度网络在数据丰富的场景中解决了这一问题,但大脑在更少的层中实现了类似的壮举.
研究的目的:
- 为了研究赫比学习的假设,特别是在受限制的博尔兹曼机器 (RBMs) 中实现的,使高维稀疏数据的高效处理成为可能.
- 将RBM的分类性能与合成稀疏数据集上的反向传播训练的神经网络进行比较.
主要方法:
- 为测试生成了几个稀疏的数据集.
- 训练受限制的博尔兹曼机器 (RBMs) 使用它们的赫比亚式学习规则,该规则侧重于非零值之间的相关性.
- 训练有素的常规神经网络使用反向传播算法进行比较.
主要成果:
- 受到限制的博尔茨曼机器在稀疏的数据集上展示了强大的泛化性能.
- 经过反向传播训练的神经网络表现出对训练数据的过度匹配,这表明概括性较差.
- RBM的不对称学习规则,忽视零值,有效地绕过了维度的诅咒.
结论:
- 由RBMs利用的Hebbian学习提供了一个可行的机制,可以有效地处理高维稀疏数据.
- 在涉及稀疏表示的任务中,RBMs为传统反向传播网络提供了有希望的替代方案,特别是在生物启发的AI中.
- 这些发现支持这样一个想法,即大脑可能利用赫布斯原则来克服维度的诅咒.
相关概念视频
Associative Learning
313
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
313
Collisions in Multiple Dimensions: Problem Solving
3.7K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
3.7K
Collisions in Multiple Dimensions: Introduction
4.9K
It is far more common for collisions to occur in two dimensions; that is, the initial velocity vectors are neither parallel nor antiparallel to each other. Let's see what complications arise from this. The first idea is that momentum is a vector. Like all vectors, it can be expressed as a sum of perpendicular components (usually, though not always, an x-component and a y-component, and a z-component if necessary). Thus, when the statement of conservation of momentum is written for a...
4.9K
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models
64
Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
64
Dimensional Analysis
856
Dimensional analysis is a powerful tool that is used in physics and engineering to understand and predict the behavior of physical systems. The basic idea behind dimensional analysis is to express physical quantities in terms of fundamental dimensions such as the mass, length, and time. Derived dimensions like the velocity, acceleration, and force are derived from the combinations of these fundamental dimensions.
Dimensional analysis allows us to analyze and compare physical quantities on a...
Dimensional analysis allows us to analyze and compare physical quantities on a...
856
Storage
81
A schema is a mental framework that helps individuals organize and interpret information. Schemata, formed from previous experiences, influence how we process new information: how we encode it, the inferences we make, and how we retrieve it. For instance, a schema for what a typical classroom looks like might include desks, a teacher's desk, a whiteboard, and students in such an environment. This expectation helps us quickly understand and navigate new classrooms without needing to analyze...
81

