Flexible shaping: how learning in small steps helps

Kai A Krueger1, Peter Dayan

  • 1Gatsby Computational Neuroscience Unit, UCL, 17 Queen Square, London WC1N 3AR, United Kingdom. kai.krueger@ucl.ac.uk

Cognition
|January 6, 2009
PubMed

Related Concept Videos

Role of Shaping in Operant Conditioning01:19

Role of Shaping in Operant Conditioning

Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
Steps in the Modeling Process01:14

Steps in the Modeling Process

Albert Bandura's theory of observational learning identifies four critical processes: attention, retention, motor reproduction, and reinforcement or motivation.
Attention is the first necessary component for observational learning. It involves focusing on what the model is doing and saying. For example, if you decide to take a drawing class to enhance your skills, you need to pay close attention to the instructor's words and hand movements. The characteristics of the model significantly...
Purposive Learning01:22

Purposive Learning

E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a bonus...
Cognitive Learning01:21

Cognitive Learning

Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
Neuroplasticity01:01

Neuroplasticity

Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
Piaget's Theory of Cognitive Development from Childhood into Adulthood01:25

Piaget's Theory of Cognitive Development from Childhood into Adulthood

Jean Piaget's theory of cognitive development emphasizes the role of thinking in a child's learning process, suggesting that children are naturally curious about their environment. His approach to development is discontinuous, proposing that cognitive abilities progress through distinct stages, each with unique characteristics. Central to Piaget's theory is schemata—mental structures that allow individuals to understand and interpret the world.
Schemata: Building Blocks of Knowledge
Schemata...