Reinforcement learning in populations of spiking neurons

Robert Urbanczik1, Walter Senn

  • 1Department of Physiology, University of Bern, Bühlplatz 5, CH-3012 Bern, Switzerland.

Nature Neuroscience
|February 17, 2009
PubMed

Related Concept Videos

Neural Circuits01:25

Neural Circuits

Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Reinforcement01:23

Reinforcement

Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Observational Learning01:12

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
Reinforcement Schedules01:24

Reinforcement Schedules

Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
The Role of Ion Channels in Neuronal Computation01:19

The Role of Ion Channels in Neuronal Computation

A postsynaptic neuron usually receives numerous impulses from several other presynaptic neurons. The axon hillock of the postsynaptic neuron integrates all these signals and determines the likelihood of firing an action potential.
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential.
Neurons: The Axon01:21

Neurons: The Axon

Axons are long, cytoplasmic processes of nerve cells capable of propagating electrical impulses known as action potentials. The cytoplasm or axoplasm of an axon contains neurofibrils, neurotubules, small vesicles, lysosomes, mitochondria, and various enzymes, all encased within the axolemma, the plasma membrane of the axon.
The axon attaches to the cell body at a cone-shaped elevation called the axon hillock. The initial part of the axon, closest to the hillock, is known as the initial segment.