Related Experiment Video
Updated: Jun 21, 2025
09:34
A Virtual Machine Platform for Non-Computer Professionals for Using Deep Learning to Classify Biological Sequences of Metagenomic Data
Published on: September 25, 2021
3.9K
Learning sequence attractors in recurrent networks with hidden neurons.
1School of Psychological and Cognitive Sciences, IDG/McGovern Institute for Brain Research, Beijing Key Laboratory of Behavior and Mental Health, Peking-Tsinghua Center for Life Sciences, Center of Quantitative Biology, Academy for Advanced Interdisciplinary Studies, Peking University, China.
Summary
This study reveals how recurrent neural networks with hidden neurons can learn to store and retrieve temporal sequence memories. A novel local learning algorithm enables robust sequence storage and retrieval, offering insights into brain function.
Area of Science:
- Neuroscience
- Computational Neuroscience
- Machine Learning
Background:
- The brain's mechanisms for learning and recalling temporal sequences are not fully understood.
- Sequence memory and temporal information processing are critical brain functions.
Purpose of the Study:
- To investigate how recurrent neural networks can learn to store arbitrary pattern sequences.
- To develop and validate a local learning algorithm for sequence memory in neural networks.
Main Methods:
- Utilizing recurrent networks of binary neurons with hidden units.
- Developing a local learning algorithm to establish sequence attractors.
- Testing the model's ability to store and retrieve sequences on diverse datasets.
Main Results:
- Hidden neurons are essential for storing arbitrary pattern sequences.
- The developed local learning algorithm converges and successfully creates sequence attractors.
- The network model demonstrates robust storage and retrieval of sequences.
Conclusions:
- The study provides a computational model for understanding sequence memory in the brain.
- The findings offer new insights into temporal information processing and neural network learning.
Related Concept Videos
01:25Neural Circuits
1.1K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.1K
01:24Sequence Networks of Rotating Machines
99
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
99
01:16Basic Discrete Time Signals
202
The unit step sequence is defined as 1 for zero and positive values of the integer n. This sequence can be graphically displayed using a set of eight sample points, showing a step function starting from n=0 and remaining constant thereafter.
The unit impulse or sample sequence is mathematically expressed as zero for all n values except at n=0, where it is one. The unit impulse sequence, denoted by δ(n), is the first difference of the unit step sequence, while the unit step sequence u(n) is...
The unit impulse or sample sequence is mathematically expressed as zero for all n values except at n=0, where it is one. The unit impulse sequence, denoted by δ(n), is the first difference of the unit step sequence, while the unit step sequence u(n) is...
202
01:15Real-World Application of Classical Conditioning
545
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
545
01:22Purposive Learning
110
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
110
01:27Associative Learning
333
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
333