代表性偏移是隐含规范化的结果
Aviv Ratzon1,2, Dori Derdikman1, Omri Barak1,2
1Rappaport Faculty of Medicine, Technion - Israel Institute of Technology, Haifa, Israel.
eLife
|May 2, 2024
概括
神经网络活动随着时间的推移因持续学习而分散,即使在稳定的环境中. 在像CA1这样的大脑区域中观察到的这个过程,揭示了不同的学习阶段和从表示漂移推断算法的潜力.
科学领域:
- 神经科学是一个神经科学.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 神经元调随着时间的推移在恒定环境中发生变化,这种现象被称为代表性漂移.
- 假设这种偏移是由于在噪音条件下持续学习而产生的,但其机制需要进一步研究.
研究的目的:
- 研究神经网络中表示漂移的潜在机制.
- 分析在稳定的环境中长期学习期间神经元活动的时间动态.
主要方法:
- 在简化导航任务上训练了一个人工神经网络.
- 分析了来自不同实验室的CA1神经元活动的四个独立数据集.
- 随着时间的推移,检查了神经元活动稀疏度和空间信息的变化.
主要成果:
- 人工网络很快实现了高性能,单位显示空间调.
- 持续培训导致活动散散化,比最初的学习要慢得多.
- 真实大脑中的CA1神经元也表现出随着长时间的环境暴露而增加的稀疏性和空间信息性.
结论:
- 学习的特点是三个重叠的阶段:快速熟悉,缓慢的隐性规范化,和一个稳定的状态的零漂移.
- 代表性漂移动态为潜在的学习算法提供了洞察力.
- 这些发现表明,在人工和生物神经网络中代表性漂移的统一机制.
相关概念视频
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
Genetic Drift
39.7K
Natural selection—probably the most well-known evolutionary mechanism—increases the prevalence of traits that enhance survival and reproduction. However, evolution does not merely propagate favorable traits, nor does it always benefit populations.
39.7K
The Representativeness Heuristic
15.8K
The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
15.8K
Instinctive Drift
208
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
208
Residuals and Least-Squares Property
7.4K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.4K
The Anchoring-and-Adjustment Heuristic
7.2K
In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the...
7.2K


