Related Experiment Videos
Adaptive generalization and efficient learning under uncertainty
1Department of Biomedical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan, South Korea.
Abstract:
People often use recognizable features to infer the value of novel consumables. This "generalization" strategy is known to be beneficial in stable environments, such that individuals can use previously learned rules and values in efficiently exploring new situations. However, it remains unclear whether and how individuals adjust their generalization strategy in volatile environments where previously learned information becomes obsolete. We hypothesized that individuals adaptively use generalization by continuously updating their beliefs about the credibility of the feature-based reward generalization model at each state. Our data showed that participants used generalization more when the novel environment remained consistent with the previously learned monotonic association between feature and reward, suggesting efficient utilization of previously acquired knowledge. Against other accounts, we found that individuals incorporated an arbitration mechanism between feature-based value generalization and model-based learning, accounting for volatility of the environment. Notably, our suggested model captured differential impacts of generalization dependent on the context-volatility, such that individuals who were biased the most toward generalization showed the smallest learning errors when the value of stimuli are generalized along the recognizable feature, but showed the largest errors in a volatile environment. This work provides novel insights into the adaptive usage of generalization, orchestrating two distinctive learning mechanisms through monitoring their credibility, and highlights the potential adverse effects of overgeneralization in volatile contexts.
Related Concept Videos
Generalization, Discrimination, and Extinction
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Avoidance Learning and Learned Helplessness
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Survival Tree
Building a Survival Tree
Constructing a survival tree begins...
Purposive Learning
Cognitive Learning
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
Propagation of Uncertainty from Systematic Error