How pupil responses track value-based decision-making during and after reinforcement learning.

Joanne C Van Slooten1, Sara Jahfari2,3, Tomas Knapen1,2

  • 1Department of Experimental and Applied Psychology, Vrije Universiteit, Amsterdam, Noord-Holland, The Netherlands.

Summary

Pupil size changes reflect cognitive processes in value-based decision-making and reinforcement learning. This research shows pupillometry can non-invasively track learning and decision computations in clinical settings.

Related Concept Videos

Reinforcement01:23

Reinforcement

Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
919
Corrosion of Reinforcement01:27

Corrosion of Reinforcement

The corrosion of steel reinforcement within concrete is a process influenced by the material's inherent properties and external factors. The high pH level of around 13, provided by calcium hydroxide present in concrete, initially protects the steel reinforcement by promoting the formation of a passive iron oxide layer on its surface.
However, over time and under certain conditions like carbonation, chloride ingress, and cracking this protective state can be compromised. Steel has areas with...
577
Reinforcement Schedules01:24

Reinforcement Schedules

Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
503
Reinforcements in Concrete01:25

Reinforcements in Concrete

Reinforced concrete is a composite material used extensively in construction, combining the compressive strength of concrete with the tensile strength of steel. This synergy is essential as concrete, while excellent at resisting compression, is weak under tension. Steel bars, or rebars, are embedded in the concrete to handle these tensile forces. The choice of steel is strategic; it shares a similar coefficient of thermal expansion with concrete, which ensures uniformity in response to...
470
Decision Making01:20

Decision Making

Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
970
Fiber Reinforced Concrete01:22

Fiber Reinforced Concrete

Fiber-reinforced concrete significantly enhances the structural and nonstructural properties of traditional concrete by incorporating fibers like steel, glass, and polymers. These fibers, varying from natural ones such as sisal and cellulose to manufactured ones like polypropylene and Kevlar, are mixed into hydraulic cement with aggregates. Steel fibers, often preferred for their robustness, contribute to improved ductility, toughness, and post-cracking performance. The concrete is classified...
397