Instruction on the Scientific Method Provides (Some) Protection Against Illusions of Causality

Area of Science:

• Cognitive Psychology
• Decision Science
• Behavioral Economics

Background:

• People often overestimate treatment efficacy due to the outcome density effect, where frequent co-occurrence of treatment and outcome inflates perceived causality.
• This cognitive bias leads to illusory beliefs about the effectiveness of interventions, even when they are scientifically unsupported.

Purpose of the Study:

• To investigate if instructing participants on scientific base-rate comparison can improve accuracy in assessing ineffective treatments.
• To explore how base-rate information influences causal judgments in sequential and summary data formats.

Main Methods:

• Participants received instructions on comparing treatment effects against a no-treatment base rate.
• Causal judgments were assessed using trial-by-trial contingency learning tasks (participant-controlled and experimenter-determined cue administration) and summary data presentation.

Main Results:

• Base-rate instructions reduced illusory beliefs by decreasing the sampling of cue-present trials in sequential tasks.
• In summary format, base-rate instructions directly reduced causal illusions.
• The effectiveness of base-rate instructions was partial, with participants still overestimating efficacy when outcome probability was high.

Conclusions:

• Simple instructions on scientific reasoning, specifically base-rate comparison, can partially debias cognitive errors in judging treatment efficacy.
• These findings highlight the potential of scientific literacy in mitigating common cognitive biases related to causality and decision-making.
• Further research may be needed to fully overcome illusory causal judgments, especially in high-probability outcome scenarios.