Within-subject consistency and between-subject variability in Bayesian reasoning strategies

Area of Science:

• Cognitive Psychology
• Decision Science
• Behavioral Economics

Background:

• Individuals commonly exhibit poor performance in calculating posterior probabilities using base rates, true positive rates, and false positive rates.
• The phenomenon of base rate neglect is a known challenge in probabilistic reasoning.

Purpose of the Study:

• To investigate the consistency and nature of strategies employed by individuals when solving Bayesian reasoning problems.
• To determine the extent to which participants utilize available probabilistic information.

Main Methods:

• Two experiments were conducted: one in a laboratory setting and one online.
• Participants completed 36 Bayesian reasoning problems with manipulated probabilities.
• Eye-tracking technology was used in the laboratory experiment to monitor information attention.

Main Results:

• Many participants consistently used simplified strategies, such as focusing on a single probability or combining two.
• Significant individual variability was observed in which probabilities participants attended to.
• Eye-tracking data indicated a correlation between information use and visual attention to problem elements.

Conclusions:

• The findings suggest that base rate neglect may understate the difficulties individuals face with Bayesian reasoning.
• Participants demonstrated awareness of their uncertainty regarding the correctness of their reasoning strategies.
• Consistent but often incomplete strategy use characterizes human Bayesian reasoning.