On the classification of Markov chains via occupation measures
Onésimo Hernández-Lerma, Jean Lasserre (2000)
Applicationes Mathematicae
Similarity:
We consider a Markov chain on a locally compact separable metric space and with a unique invariant probability. We show that such a chain can be classified into two categories according to the type of convergence of the expected occupation measures. Several properties in each category are investigated.