Learning to allocate limited time to decisions with different expected outcomes
Arash Khodadadi1, Pegah Fakhari1, Jerome R Busemeyer1
1Indiana University, Department of Psychological and Brain Sciences, Bloomington, IN, United States.
Cognitive Psychology
|April 26, 2017
Summary
Human participants struggle to optimize decision-making under time constraints. A reinforcement learning model best explains how they adjust their decision threshold based on feedback, though participants often fail to learn optimal strategies.
Area of Science:
- Cognitive psychology
- Decision science
- Computational neuroscience
Background:
- Human decision-making involves allocating limited time to gather information.
- Accuracy and speed trade-offs are crucial in decision tasks.
- Participants' decision thresholds influence overall outcomes.
Purpose of the Study:
- Investigate how humans allocate time for decisions with varying properties.
- Examine the learning and adjustment of decision thresholds.
- Compare computational models of decision threshold adjustment.
Main Methods:
- Two behavioral experiments involving information accumulation and decision-making.
- Manipulation of trial difficulty and reward structures.
- Development and Bayesian comparison of 10 computational models.
Main Results:
- Participants often failed to adopt optimal, simple strategies for decision threshold adjustment.
- A reinforcement learning model with time-varying parameters best explained participants' behavior.
- In the absence of cues, participants attempted to infer trial difficulty rather than use a time-decreasing threshold.
Conclusions:
- Human decision-making under time pressure is suboptimal.
- Reinforcement learning mechanisms play a role in adjusting decision thresholds.
- Participants' strategies deviate from optimal solutions, particularly in complex or uncertain environments.
Related Concept Videos
Decision Making
1.1K
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
1.1K
Decision Making: Traditional Method
5.6K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
5.6K
Timing and Consequences on Behavior
528
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
528
Decision Making: P-value Method
7.1K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
7.1K
Hindsight Biases
4.5K
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
4.5K
Reason and Intuition
7.6K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
7.6K


