在存在虚假相关性时揭示记忆效应
Chenyu You1,2,3, Haocheng Dai4, Yifei Min5
1Department of Electrical & Computer Engineering, Yale University, New Haven, CT, USA. chenyu.you@yale.edu.
Nature communications
|July 2, 2025
概括
机器学习模型由于虚假特征而表现出不平衡的性能. 这项研究表明,特定神经元的记忆有助于解决这个问题,影响少数群体的准确性.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 机器学习模型经常利用虚假的特征,导致多数和少数群体之间的性能差异.
- 这些虚假特征与目标相关,但缺乏因果关系,损害了模型的概括性.
研究的目的:
- 调查记忆在虚假特征依赖中的作用及其对机器学习中的不平衡群体表现的贡献.
- 为神经网络中虚假记忆的存在提供经验证据.
主要方法:
- 对神经网络组件进行系统分析,以识别虚假特征及其与群体表现的相关性.
- 关于少数群体数据的神经元子集及其记忆特性的实验调查.
- 开发和应用一种新的培训框架,以减轻虚假的记忆模式.
主要成果:
- 证明了神经元的一小部分中存在无处不在的虚假特征.
- 提供了特定神经元记住少数群体信息的证据,导致不平衡的表现.
- 展示了消除虚假记忆可以显著改善少数群体的表现.
结论:
- 假记忆,集中在一个小的神经元子集,是机器学习中不平衡群体表现的关键驱动因素.
- 这些发现为神经网络如何编码虚假知识提供了新的见解,指导了未来关于强度的研究.
- 这项工作为开发更公平,更可靠的机器学习模型奠定了基础.
更多相关视频
08:53Using a Classroom-Based Deese Roediger McDermott Paradigm to Assess the Effects of Imagery on False Memories
Published on: November 14, 2018
9.8K
07:59Using Practice Testing, Public Speaking, and Source Monitoring to Examine the Influences of Learning Strategies and Stress on Episodic Memory
Published on: June 14, 2019
8.1K
相关概念视频
Cause and Effect
11.4K
While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a confounding variable, is actually causing the systematic movement in our variables of interest. For instance, as sales in ice cream increase, so does the overall rate of crime. Is it possible that indulging in your favorite flavor of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone?
11.4K
Interference and Decay
212
Forgetting is a complex cognitive phenomenon influenced by several factors, among which interference and decay are particularly prominent. These processes explain why individuals often struggle to retrieve specific information from memory, leading to lapses in recall that can be observed in everyday situations.
Interference occurs when competing memories hinder the retrieval of particular information. It can be classified into two types: proactive and retroactive interference. Proactive...
Interference occurs when competing memories hinder the retrieval of particular information. It can be classified into two types: proactive and retroactive interference. Proactive...
212
Correlations
33.9K
Correlation means that there is a relationship between two or more variables (such as ice cream consumption and crime), but this relationship does not necessarily imply cause and effect. When two variables are correlated, it simply means that as one variable changes, so does the other. We can measure correlation by calculating a statistic known as a correlation coefficient. A correlation coefficient is a number from -1 to +1 that indicates the strength and direction of the relationship between...
33.9K
False Memories
148
False memories represent a cognitive distortion in which individuals recall events that did not happen, or remember them in an altered form. This phenomenon highlights the brain's constructive nature in processing and recalling memories, emphasizing that memory is not a perfect representation of past events but rather a dynamic reconstruction influenced by various factors.
One primary source of false memories is misattribution, where individuals incorrectly associate external information...
One primary source of false memories is misattribution, where individuals incorrectly associate external information...
148
Serial Position Effect
249
The serial position effect is a cognitive phenomenon where individuals are more likely to recall the first and last items in a list compared to those in the middle. This effect is divided into the primacy effect and the recency effect. The primacy effect is observed when the initial items in a list are remembered better. This occurs because these items are rehearsed more frequently or receive more elaborative processing, allowing them to be encoded into long-term memory more effectively. For...
249
Forgetting
135
Forgetting is an intrinsic aspect of human memory, characterized by the gradual loss or inaccessibility of information over time. Hermann Ebbinghaus, a pioneering psychologist, extensively studied this phenomenon and formulated the forgetting curve. This curve illustrates that memory loss occurs rapidly immediately after learning and then decelerates over time. Several mechanisms contribute to forgetting, including encoding failure, storage decay, retrieval failure, and interference.
Encoding...
Encoding...
135
