Confluence of Timing and Reward Biases in Perceptual Decision-Making Dynamics

Maxwell Shinn1,2, Daniel B Ehrlich1,2, Daeyeol Lee3,4,5,6,7

  • 1Department of Psychiatry, Yale University, New Haven, Connecticut 06511.

Summary

Decision-making strategies are shaped by both reward and timing contexts. Monkeys used dynamic urgency and leaky integration, influenced by temporal structure, to adapt their choices under asymmetric rewards.

Related Concept Videos

Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
264
First Impression01:09

First Impression

First impressions play a crucial role in social perception, shaping how individuals assess others in professional, academic, and interpersonal contexts. Psychological research highlights the significance of cognitive biases, such as the primacy and recency effects, which influence how people interpret and recall information.The Primacy Effect and Cognitive AnchoringThe primacy effect describes the tendency for initial information to impact judgment disproportionately. When individuals encounter...
107
Reason and Intuition01:37

Reason and Intuition

The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
7.3K
Factors Affecting Perception01:25

Factors Affecting Perception

Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
2.4K
Hindsight Biases01:12

Hindsight Biases

Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now? 
4.2K
Decision Making01:20

Decision Making

Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
643