关于记忆吸引器的强有力的学习与杂的深度关联记忆网络
Xuan Rao1, Bo Zhao1, Derong Liu2
1School of Systems Science, Beijing Normal University, Beijing 100875, China.
概括
噪音过度参数化的自动编码器 (NOAE) 通过在训练过程中注入噪音来提高记忆系统中的吸引器稳定性. 这种方法提高了机器学习模型的吸引器稳定性和学习成功率.
科学领域:
- 机器学习 机器学习
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
背景情况:
- 过度参数化的自动编码器 (OAE) 通过从训练数据中创建吸引器来模拟关联记忆 (AM).
- 在OAE中学习稳定吸引子需要在雅可比矩阵上设置特定的固有值约束.
- 吸引力强度与雅各比亚矩阵最大的奇数值相反相关.
研究的目的:
- 开发一种新的方法来提高基于自编码器的记忆系统中的吸引器的稳定性.
- 解决现有的过度参数化的自动编码器在形成稳定的内存吸引器方面的局限性.
- 提高机器学习模型中吸引器学习的可靠性和成功率.
主要方法:
- 通过将随机噪声纳入训练输入,引入了噪音过度参数化的自动编码器 (NOAE).
- 开发了一个理论框架,证明NOAEs最小化了重建错误的综合上限和最大单数值的平方.
- 使用数值和图像数据集进行了广泛的实验,以验证NOAE性能.
主要成果:
- NOAEs显著提高了汇聚到吸引者的培训样本的成功率.
- 拟议的方法明显提高了学习吸引器的稳定性.
- 理论分析支持了关于增强吸引力稳定的经验研究结果.
结论:
- 噪音过度参数化的自动编码器为构建更强大的计算记忆系统提供了有希望的方法.
- 噪音注入策略有效地克服了传统的OAE对吸引器学习的局限性.
- 这项研究有助于推进协会记忆应用的机器学习模型.
更多相关视频
07:17Aversive Associative Learning and Memory Formation by Pairing Two Chemicals in Caenorhabditis elegans
Published on: June 23, 2022
2.3K
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
7.4K
相关概念视频
Higher Mental Functions of Brain: Learning and Memory
520
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
520
Associative Learning
236
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
236
Real-World Application of Classical Conditioning
458
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
458
Implicit Memories
42
Implicit memories, also known as non-declarative memories, are long-term memories that function outside of conscious awareness. These memories influence behavior and skills without explicit knowledge. This type of memory is evident in tasks like playing tennis, snowboarding, and texting. Implicit memory has three subsystems: procedural memory, conditioning, and priming. This type of memory is essential in various activities, from everyday tasks to specialized skills.
One key aspect of implicit...
One key aspect of implicit...
42
Long-term Potentiation
54.4K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
54.4K
Mnemonic Devices
42
Mnemonic devices are cognitive tools that facilitate memory retention by linking new information to familiar patterns or organizational strategies. These techniques are beneficial for remembering complex or lengthy sets of information by simplifying and structuring them in easily retrievable ways.
Acronyms
Acronyms are created by using the initial letters of a series of words to form a new word or phrase. This approach condenses complex information into a single, memorable entity. For example,...
Acronyms
Acronyms are created by using the initial letters of a series of words to form a new word or phrase. This approach condenses complex information into a single, memorable entity. For example,...
42
