Related Experiment Video
Updated: Nov 16, 2025

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants
Published on: August 26, 2018
Understanding Human Decision Making in an Interactive Landslide Simulator Tool via Reinforcement Learning.
Pratik Chaturvedi1,2, Varun Dutt1
1Applied Cognitive Science Laboratory, Indian Institute of Technology Mandi, Mandi, India.
Reinforcement learning models explain human decisions in a landslide simulator. The Prospect-Valence-Learning-2 (PVL-2) model best predicted choices, improving risk management strategies.
Area of Science:
- Cognitive Psychology
- Computational Neuroscience
- Risk Management
Background:
- Human decision-making in landslide risk scenarios has been studied using the Interactive Landslide Simulator (ILS).
- Previous research indicates that feedback on landslide damages improves human decision-making.
- The application of learning theories, specifically reinforcement learning (RL), to understand these decisions remains underexplored.
Purpose of the Study:
- To model human decisions within the ILS tool using computational reinforcement learning approaches.
- To investigate the underlying mechanisms of human decision-making when faced with landslide risks.
- To evaluate the efficacy of different RL models in capturing observed human behavior.
Main Methods:
- Four distinct RL models were developed: Expectancy-Valence (EV), Prospect-Valence-Learning (PVL), PVL-2, and an EV-PU combination model.
- Model parameters were calibrated using human decision data from experiments with two distinct conditions in the ILS.
- The best-performing models were then generalized to data from a new experimental condition.
Main Results:
- The Prospect-Valence-Learning-2 (PVL-2) model demonstrated superior performance in generalizing to the new ILS condition compared to other RL models and a random model.
- Calibrated parameters from damage-feedback conditions in PVL-2 showed the most accurate predictions.
- The study provides evidence for the utility of specific RL models in explaining human choices under risk.
Conclusions:
- Reinforcement learning, particularly the PVL-2 model, offers a robust framework for understanding human decision-making in landslide risk contexts.
- Findings have implications for designing more effective risk communication and mitigation strategies.
- Computational modeling can enhance our understanding of cognitive processes in natural hazard management.
More Related Videos
07:05Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
Published on: September 10, 2018
07:42An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents
Published on: August 2, 2018
Related Concept Videos
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Decision Making
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Avoidance Learning and Learned Helplessness
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
Cognitive Learning
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
Reason and Intuition