Displaying similar documents to “Random evolutions processes induced by discrete time Markov chains.”

Random walk centrality and a partition of Kemeny's constant

Stephen J. Kirkland (2016)

Czechoslovak Mathematical Journal

Similarity:

We consider an accessibility index for the states of a discrete-time, ergodic, homogeneous Markov chain on a finite state space; this index is naturally associated with the random walk centrality introduced by Noh and Reiger (2004) for a random walk on a connected graph. We observe that the vector of accessibility indices provides a partition of Kemeny's constant for the Markov chain. We provide three characterizations of this accessibility index: one in terms of the first return time...

Discrete random processes with memory: Models and applications

Tomáš Kouřim, Petr Volf (2020)

Applications of Mathematics

Similarity:

The contribution focuses on Bernoulli-like random walks, where the past events significantly affect the walk's future development. The main concern of the paper is therefore the formulation of models describing the dependence of transition probabilities on the process history. Such an impact can be incorporated explicitly and transition probabilities modulated using a few parameters reflecting the current state of the walk as well as the information about the past path. The behavior...