On the classification of Markov chains via occupation measures
We consider a Markov chain on a locally compact separable metric space and with a unique invariant probability. We show that such a chain can be classified into two categories according to the type of convergence of the expected occupation measures. Several properties in each category are investigated.