Displaying similar documents to “A criterion of asymptotic stability for Markov-Feller e-chains on Polish spaces”

Estimates for perturbations of discounted Markov chains on general spaces

Raúl Montes-de-Oca, Alexander Sakhanenko, Francisco Salem-Silva (2003)

Applicationes Mathematicae

Similarity:

We analyse a Markov chain and perturbations of the transition probability and the one-step cost function (possibly unbounded) defined on it. Under certain conditions, of Lyapunov and Harris type, we obtain new estimates of the effects of such perturbations via an index of perturbations, defined as the difference of the total expected discounted costs between the original Markov chain and the perturbed one. We provide an example which illustrates our analysis.

Conditional Markov chains - construction and properties

Tomasz R. Bielecki, Jacek Jakubowski, Mariusz Niewęgłowski (2015)

Banach Center Publications

Similarity:

In this paper we study finite state conditional Markov chains (CMCs). We give two examples of CMCs, one which admits intensity, and another one, which does not admit an intensity. We also give a sufficient condition under which a doubly stochastic Markov chain is a CMC. In addition we provide a method for construction of conditional Markov chains via change of measure.

Markov operators acting on Polish spaces

Tomasz Szarek (1997)

Annales Polonici Mathematici

Similarity:

We prove a new sufficient condition for the asymptotic stability of Markov operators acting on measures. This criterion is applied to iterated function systems.

Asymptotic stability of a linear Boltzmann-type equation

Roksana Brodnicka, Henryk Gacki (2014)

Applicationes Mathematicae

Similarity:

We present a new necessary and sufficient condition for the asymptotic stability of Markov operators acting on the space of signed measures. The proof is based on some special properties of the total variation norm. Our method allows us to consider the Tjon-Wu equation in a linear form. More precisely a new proof of the asymptotic stability of a stationary solution of the Tjon-Wu equation is given.

The Kendall theorem and its application to the geometric ergodicity of Markov chains

Witold Bednorz (2013)

Applicationes Mathematicae

Similarity:

We give an improved quantitative version of the Kendall theorem. The Kendall theorem states that under mild conditions imposed on a probability distribution on the positive integers (i.e. a probability sequence) one can prove convergence of its renewal sequence. Due to the well-known property (the first entrance last exit decomposition) such results are of interest in the stability theory of time-homogeneous Markov chains. In particular this approach may be used to measure rates of convergence...

Simple Markov chains

O. Adelman (1976)

Annales scientifiques de l'Université de Clermont. Mathématiques

Similarity:

Why the Kemeny Time is a constant

Karl Gustafson, Jeffrey J. Hunter (2016)

Special Matrices

Similarity:

We present a new fundamental intuition forwhy the Kemeny feature of a Markov chain is a constant. This new perspective has interesting further implications.

On the exchanges between Wolfgang Doeblin and Bohuslav Hostinský

Laurent Mazliak (2007)

Revue d'histoire des mathématiques

Similarity:

We present the letters sent by Wolfgang Doeblin to Bohuslav Hostinský between 1936 and 1938. They concern some aspects of the general theory of Markov chains and the solutions of the Chapman-Kolmogorov equation that Doeblin was then establishing for his PhD thesis.

Reduction of absorbing Markov chain

Mariusz Górajski (2009)

Annales UMCS, Mathematica

Similarity:

In this paper we consider an absorbing Markov chain with finite number of states. We focus especially on random walk on transient states. We present a graph reduction method and prove its validity. Using this method we build algorithms which allow us to determine the distribution of time to absorption, in particular we compute its moments and the probability of absorption. The main idea used in the proofs consists in observing a nondecreasing sequence of stopping times. Random walk on...

Randomly connected dynamical systems - asymptotic stability

Katarzyna Horbacz (1998)

Annales Polonici Mathematici

Similarity:

We give sufficient conditions for asymptotic stability of a Markov operator governing the evolution of measures due to the action of randomly chosen dynamical systems. We show that the existence of an invariant measure for the transition operator implies the existence of an invariant measure for the semigroup generated by the system.