Related Experiment Video
Updated: Feb 1, 2026

11:18
Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task
Published on: June 1, 2015
11.1K
How pupil responses track value-based decision-making during and after reinforcement learning.
Joanne C Van Slooten1, Sara Jahfari2,3, Tomas Knapen1,2
1Department of Experimental and Applied Psychology, Vrije Universiteit, Amsterdam, Noord-Holland, The Netherlands.
Plos Computational Biology
|December 1, 2018
Summary
Pupil size changes reflect cognitive processes in value-based decision-making and reinforcement learning. This research shows pupillometry can non-invasively track learning and decision computations in clinical settings.
Area of Science:
- Cognitive Neuroscience
- Computational Psychiatry
- Neuroeconomics
Background:
- Pupil responses are linked to cognitive processes like decision-making.
- Understanding pupil responses in value-based decisions is crucial for real-world applications.
- Little is known about how pupil size relates to decisions driven by learned stimulus value.
Purpose of the Study:
- To investigate the cognitive processes reflected by pupil responses during value-based decision-making.
- To explore how pupil size changes relate to reinforcement learning and value updating.
Main Methods:
- Utilized a reinforcement learning task.
- Employed computational modeling to analyze pupil responses.
- Studied pupil dilation and constriction patterns during decision and feedback phases.
Main Results:
- Pupil responses tracked reinforcement learning processes across participants and trials.
- Pre-choice pupil dilation correlated with value beliefs and exploitation tendency.
- Post-feedback pupil responses reflected learning rates, value uncertainty, and reward prediction errors.
Conclusions:
- Pupil size fluctuations provide detailed insights into value-based decision computations and belief updating.
- Pupillometry offers a non-invasive tool for studying reinforcement learning in clinical populations.
- Findings highlight the potential of pupillometry in psychiatric research and diagnostics.
Related Concept Videos
Reinforcement
919
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
919
Corrosion of Reinforcement
577
The corrosion of steel reinforcement within concrete is a process influenced by the material's inherent properties and external factors. The high pH level of around 13, provided by calcium hydroxide present in concrete, initially protects the steel reinforcement by promoting the formation of a passive iron oxide layer on its surface.
However, over time and under certain conditions like carbonation, chloride ingress, and cracking this protective state can be compromised. Steel has areas with...
However, over time and under certain conditions like carbonation, chloride ingress, and cracking this protective state can be compromised. Steel has areas with...
577
Reinforcement Schedules
503
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
503
Reinforcements in Concrete
470
Reinforced concrete is a composite material used extensively in construction, combining the compressive strength of concrete with the tensile strength of steel. This synergy is essential as concrete, while excellent at resisting compression, is weak under tension. Steel bars, or rebars, are embedded in the concrete to handle these tensile forces. The choice of steel is strategic; it shares a similar coefficient of thermal expansion with concrete, which ensures uniformity in response to...
470
Decision Making
970
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
970
Fiber Reinforced Concrete
397
Fiber-reinforced concrete significantly enhances the structural and nonstructural properties of traditional concrete by incorporating fibers like steel, glass, and polymers. These fibers, varying from natural ones such as sisal and cellulose to manufactured ones like polypropylene and Kevlar, are mixed into hydraulic cement with aggregates. Steel fibers, often preferred for their robustness, contribute to improved ductility, toughness, and post-cracking performance. The concrete is classified...
397

