Related Experiment Video
Updated: Jun 7, 2025

07:51
A Protocol for Measuring Cue Reactivity in a Rat Model of Cocaine Use Disorder
Published on: June 18, 2018
10.5K
Modeling the dynamics of contextual cueing effect by reinforcement learning.
Yasuhiro Hatori1,2,3, Zheng-Xiong Yuan1,4, Chia-Huei Tseng1,5
1Research Institute of Electrical Communication, Tohoku University, Sendai, Japan.
Journal of Vision
|November 19, 2024
Summary
This study models how humans learn to use environmental context for faster object searches. The model shows that scene context significantly improves visual search efficiency, mimicking human learning patterns.
Area of Science:
- Cognitive Psychology
- Computational Neuroscience
- Computer Vision
Background:
- Humans leverage environmental context to improve object search efficiency.
- Understanding the learning mechanisms behind contextual cueing is crucial for visual cognition.
- Previous models have not fully captured the nuances of contextual learning in visual search.
Purpose of the Study:
- To propose and validate a computational model of the contextual cueing effect in visual search.
- To investigate how scene context influences the learning process for target localization.
- To compare model performance against human behavior in controlled visual search experiments.
Main Methods:
- Developed a computational model extracting global scene features to learn target-location associations.
- Implemented a learning mechanism that strengthens the relationship between scene features and target locations over repeated exposures.
- Conducted two visual search experiments using uniform (letter arrangements) and natural scene backgrounds.
Main Results:
- The model successfully simulated the observed reduction in saccades for target detection in natural scenes compared to uniform backgrounds.
- Model performance replicated key characteristics of human contextual cueing, including local learning and the impact of stimulus novelty.
- Natural scenes demonstrated superior contextual cueing effects compared to uniform backgrounds, aligning with experimental findings.
Conclusions:
- The proposed model provides a viable framework for understanding the computational basis of contextual cueing.
- Scene context plays a significant role in efficient visual search by facilitating learned associations.
- This research contributes to a deeper understanding of visual attention and learning in complex environments.
Related Concept Videos
Reinforcement Schedules
132
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
132
Timing and Consequences on Behavior
82
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
82
Cognitive Learning
220
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
220
Generalization, Discrimination, and Extinction
450
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
450
Reinforcement
180
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
180
Real-World Application of Classical Conditioning
527
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
527

