A hyperbolic decay of subjective probability of obtaining delayed rewards

Taiki Takahashi1, Koki Ikeda, Toshikazu Hasegawa

  • 1Department of Life Sciences, Unit of Cognitive and Behavioral Sciences, School of Arts and Sciences, The University of Tokyo, 21 COE office, 3-8-1 Komaba, Meguro-ku, Tokyo, 153-8902, Japan. taiki@ecs.c.u-tokyo.ac.jp.

Abstract

Related Concept Videos

Interference and Decay01:16

Interference and Decay

Forgetting is a complex cognitive phenomenon influenced by several factors, among which interference and decay are particularly prominent. These processes explain why individuals often struggle to retrieve specific information from memory, leading to lapses in recall that can be observed in everyday situations.
Interference occurs when competing memories hinder the retrieval of particular information. It can be classified into two types: proactive and retroactive interference. Proactive...
Hazard Rate01:11

Hazard Rate

The hazard rate, also known as the hazard function or failure rate, is a statistical measure used to describe the instantaneous rate at which an event occurs, given that the event has not yet happened. From a probabilistic perspective, it represents the likelihood that a subject will experience the event in a very small time interval, conditional on surviving up to the beginning of that interval. In terms of frequency, the hazard rate can be viewed as the ratio of the number of events to the...
Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Hindsight Biases01:12

Hindsight Biases

Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
Improper Integrals: Infinite Intervals01:29

Improper Integrals: Infinite Intervals

An integral is classified as improper due to an infinite interval when at least one of its limits of integration extends to positive or negative infinity. In such cases, the region under the curve is unbounded, and standard techniques for evaluating definite integrals are not directly applicable. Instead, the improper integral is defined through a limiting process that allows one to determine whether the accumulated area remains finite despite the infinite domain.Application to Exponential...
Geometric Sequences01:30

Geometric Sequences

In systems where values diminish by a constant proportion at each stage, the resulting sequence follows a geometric structure. Each new value in the sequence is obtained by applying a fixed multiplier to the preceding term. This regular, proportional decline type is often used to represent processes involving gradual loss, such as energy dissipation or reduction in amplitude over time.When analyzing the total effect of such a process across unlimited iterations, the series of values is referred...