Related Experiment Video
Updated: Aug 28, 2026

The Collective Trust Game: An Online Group Adaptation of the Trust Game Based on the HoneyComb Paradigm
Published on: October 20, 2022
The Gittins Index for a Transparent One-Armed Bandit with a Continuous Payoff Spectrum in Equilibrium States
Marcin Makowski1, Edward W Piotrowski2, Jan L Cieśliński1
1Faculty of Physics, Department of Mathematical Methods in Physics, University of Białystok, ul. Ciołkowskiego 1L, 15-245 Białystok, Poland.
Abstract:
We present an analogue of the classical Gittins index for a one-armed decision problem with a continuous spectrum of payoffs. The model assumes that the decision-maker observes independent realizations of a random variable and, at each step, decides whether to accept the current opportunity or continue observing. We show that the optimal strategy takes the form of a threshold rule, while the corresponding reservation index is determined by a one-dimensional fixed-point equation with a direct decision-theoretic interpretation. The model is illustrated with an example of bookmaker betting related to horse racing and the Kelly criterion. This perspective allows the proposed index to be viewed as a threshold of informational advantage. This, in turn, points to potential applications in optimal stopping problems and decision-making under uncertainty.
Related Concept Videos
BIBO stability of continuous and discrete -time systems
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system.
Law of Rational Indices
Alternative Sets of Equilibrium Equations
One example of such a situation can be observed in a...
Equity Theory
Basic Continuous Time Signals
The unit step function, denoted u(t), is zero for negative time values and one for positive time values, exhibiting a discontinuity at t=0. This function often represents abrupt changes, such as the step voltage introduced when turning a car's...
Graphical Representation of Inequalities