Related Experiment Video
Updated: Jun 2, 2026

Barnes Maze Testing Strategies with Small and Large Rodent Models
Published on: February 26, 2014
No good Markov strategies for Büchi objectives in countable MDPs
Stefan Kiefer1, Richard Mayr2, Mahsa Shirmohammadi3
1University of Oxford, Oxford, United Kingdom.
None:
We study countably infinite Markov decision processes with Büchi objectives, which ask to visit a given subset of states infinitely often. A question left open by T.P. Hill (1979) is whether there always exist -optimal Markov strategies, i.e., strategies that base decisions only on the current state and on the clock (the number of steps taken so far). We provide a negative answer to this question by constructing a non-trivial counterexample.
Related Concept Videos
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Mechanistic Models: Overview of Compartment Models
Mathematical Modeling: Problem Solving
Alternative Sets of Equilibrium Equations
One example of such a situation can be observed in a...
BIBO stability of continuous and discrete -time systems
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system.
Stability of Equilibrium Configuration: Problem Solving
Problem-solving in the context of the stability of equilibrium configuration...
