Displaying similar documents to “Random walk centrality and a partition of Kemeny's constant”

Reduction of absorbing Markov chain

Mariusz Górajski (2009)

Annales UMCS, Mathematica

Similarity:

In this paper we consider an absorbing Markov chain with finite number of states. We focus especially on random walk on transient states. We present a graph reduction method and prove its validity. Using this method we build algorithms which allow us to determine the distribution of time to absorption, in particular we compute its moments and the probability of absorption. The main idea used in the proofs consists in observing a nondecreasing sequence of stopping times. Random walk on...

Loop-free Markov chains as determinantal point processes

Alexei Borodin (2008)

Annales de l'I.H.P. Probabilités et statistiques

Similarity:

We show that any loop-free Markov chain on a discrete space can be viewed as a determinantal point process. As an application, we prove central limit theorems for the number of particles in a window for renewal processes and Markov renewal processes with Bernoulli noise.

A linear programming approach to error bounds for random walks in the quarter-plane

Jasper Goseling, Richard J. Boucherie, Jan-Kees van Ommeren (2016)

Kybernetika

Similarity:

We consider the steady-state behavior of random walks in the quarter-plane, in particular, the expected value of performance measures that are component-wise linear over the state space. Since the stationary distribution of a random walk is in general not readily available we establish upper and lower bounds on performance in terms of another random walk with perturbed transition probabilities, for which the stationary distribution is a geometric product-form. The Markov reward approach...