Ecological validity of common behavioral decision making tasks: evidence across two samples

Area of Science:

• Cognitive Psychology
• Behavioral Economics
• Risk Assessment

Background:

• Behavioral decision tasks are widely used by clinicians and researchers to evaluate decision-making abilities.
• A significant gap exists in understanding the predictive validity of these tasks for real-world risky behaviors.

Purpose of the Study:

• To assess the predictive power of common behavioral decision tasks for real-world risky decision-making.
• To investigate the relationship between task performance and actual risky behaviors across different contexts.

Main Methods:

• Two pre-registered studies were conducted with two assessment timepoints.
• Participants (N=918 in Study 1, N=221 in Study 2) completed various decision-making tasks.
• Real-world risk behaviors assessed included preventive health actions, vaccination status, and social distancing.

Main Results:

• Behavioral decision tasks demonstrated minimal predictive ability for real-world behaviors.
• When prediction was observed, the relationships were consistently weak.
• Task specificity appeared to play a role, with closer alignment to the behavior yielding slightly better predictions.

Conclusions:

• Current behavioral decision tasks may not reliably predict real-world risky behaviors.
• Further research is needed to enhance the ecological validity of these tasks.
• Future studies should explore a wider array of tasks and consider behavior-specific assessments.