Related Experiment Video
Updated: Aug 3, 2025
11:18
Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task
Published on: June 1, 2015
10.7K
How a Minimal Learning Agent can Infer the Existence of Unobserved Variables in a Complex Environment
Benjamin Eva1, Katja Ried2, Thomas Müller3
1Department of Philosophy, Duke University, 1364 Campus Dr., Durham, NC 27705 USA.
Minds and Machines
|April 12, 2023
Summary
This study demonstrates how learning agents can develop abstract conceptual structures, crucial for meaningful thought. This research links abstraction and generalization, showing their operational usefulness in applying knowledge to new situations.
Area of Science:
- Cognitive Science
- Philosophy of Mind
- Artificial Intelligence
Background:
- Abstract conceptual structures are considered key indicators of deliberative thought in cognitive science.
- Understanding the mechanisms for developing these structures in agents is an ongoing challenge.
Purpose of the Study:
- To define and operationalize the concept of abstract concepts in learning agents.
- To present a minimal architecture enabling abstract conceptual capabilities.
- To demonstrate the functional utility of abstract structures in generalization.
Main Methods:
- Developed a concrete operational definition for abstract concepts in agents.
- Proposed a minimal computational architecture supporting abstract concept formation.
- Empirically demonstrated the use of abstract structures in knowledge application.
Main Results:
- Successfully defined and operationalized abstract concepts for learning agents.
- Presented a viable minimal architecture for achieving abstraction.
- Showcased how abstract conceptual structures facilitate generalization and knowledge transfer.
Conclusions:
- Learning agents can indeed develop and utilize abstract conceptual structures.
- The cognitive functions of abstraction and generalization are intrinsically linked.
- Operationalizing abstract concepts provides a framework for understanding agent cognition.
Keywords:
Concept formationExplainable artificial intelligence (XAI)Projective simulationReinforcement learningTheory formationTransparent artificial intelligenceMore Related Videos
Related Concept Videos
01:22Purposive Learning
174
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
174
01:12Observational Learning
250
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
250
01:21Cognitive Learning
461
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
461
01:27Associative Learning
474
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
474
01:22Multi-input and Multi-variable systems
134
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
134
01:14Avoidance Learning and Learned Helplessness
1.8K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.8K