Confirmation bias in human reinforcement learning: Evidence from counterfactual feedback processing.
Stefano Palminteri1,2,3,4, Germain Lefebvre2,3,5, Emma J Kilford1
1Institute of Cognitive Neuroscience, University College London, London, United Kingdom.
Plos Computational Biology
|August 12, 2017
Summary
People learn differently from positive and negative prediction errors in factual versus counterfactual learning. This study reveals a bias towards information confirming current choices in both learning types.
Area of Science:
- Cognitive Science
- Neuroscience
- Decision Making
Background:
- Factual learning, or learning from outcomes, shows a bias towards positive prediction errors.
- The influence of prediction error valence on counterfactual learning (learning from forgone outcomes) remains unexplored.
Purpose of the Study:
- To investigate whether prediction error valence affects counterfactual learning.
- To compare valence-induced biases in factual versus counterfactual learning.
Main Methods:
- Two experiments were conducted using reinforcement learning tasks.
- A computational model analyzed participant performance to assess the impact of prediction error valence.
- Factual learning involved partial feedback; counterfactual learning involved complete feedback.
Main Results:
- Replicated previous findings: factual learning showed a bias for positive prediction errors.
- Counterfactual learning exhibited an opposite bias, favoring negative prediction errors.
- A general tendency to prioritize information confirming current choices was observed.
Conclusions:
- Prediction error valence significantly influences both factual and counterfactual learning, but in opposing directions.
- Individuals exhibit a bias towards information that validates their existing choices, regardless of learning context.
Related Concept Videos
Confirmation Biases
8.3K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
8.3K
Cause and Effect
12.6K
While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a confounding variable, is actually causing the systematic movement in our variables of interest. For instance, as sales in ice cream increase, so does the overall rate of crime. Is it possible that indulging in your favorite flavor of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone?
12.6K
Hindsight Biases
4.3K
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
4.3K
Counterfactual Thinking
297
Counterfactual thinking is a cognitive process wherein individuals mentally reconstruct alternative versions of past events, often beginning with “what if” or “if only.” This reflective mechanism plays a significant role in shaping emotional experiences and guiding future behavior. Though typically triggered by unfavorable or unexpected outcomes, counterfactual thinking can also emerge in mundane, everyday decisions and experiences, revealing its deep entrenchment in...
297
Motivational Bias
424
Cognitive bias results from limitations in thinking and information processing, leading to systematic errors in judgment. Conversely, motivational bias stems from personal desires or emotions, causing distortions in perception to align with self-interest. Motivational bias influences how individuals perceive and attribute causes to events, often shaped by personal needs, goals, and self-esteem preservation. This bias can distort judgment, leading to inaccurate assessments of success, failure,...
424
Bias
7.5K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
7.5K


