Related Experiment Video
Updated: Jul 7, 2026
09:43
A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments
Published on: April 15, 2014
Learning reactive and planning rules in a motivationally autonomous animat
1Animat Lab., Ecole Normale Superieure, Paris.
Summary
This study introduces a novel control architecture for autonomous agents, enabling adaptive decision-making based on internal states and environmental factors. The system demonstrates effective navigation in both simulated and real-world robotic applications.
Area of Science:
- Robotics
- Artificial Intelligence
- Control Systems
Background:
- Autonomous agents require sophisticated control architectures for effective environmental interaction.
- Existing systems often lack the ability to integrate internal states with external perceptions for decision-making.
Purpose of the Study:
- To present a novel hierarchical classifier system for motivationally autonomous agents.
- To enable agents to learn reactive and planning rules for adaptive behavior.
- To demonstrate the architecture's capabilities in robotic navigation tasks.
Main Methods:
- Development of a hierarchical classifier control architecture.
- Implementation of learning mechanisms for reactive and planning rules.
- Testing with simulated and real robots in navigation scenarios.
Main Results:
- The proposed architecture allows agents to autonomously choose actions based on perception, internal state, and behavioral consequences.
- Successful adaptation and navigation were observed in experimental setups.
- The system demonstrated robust performance in both simulated and physical robotic environments.
Conclusions:
- The hierarchical classifier system provides a viable framework for creating motivationally autonomous and adaptive robots.
- This architecture enhances robotic navigation capabilities through integrated learning and decision-making.
- The approach shows promise for complex autonomous systems operating in dynamic environments.
Related Concept Videos
01:21Cognitive Learning
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
01:05Instinctive Drift
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
01:28Behaviorism
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
01:08Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
01:22Purposive Learning
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a bonus...
01:06Law of Effect
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...