Displaying similar documents to “On the core property of the cylinder functions class in the construction of interacting particle systems”

The first exit of almost strongly recurrent semi-Markov processes

Joachim Domsta, Franciszek Grabski (1995)

Applicationes Mathematicae

Similarity:

Let ( · ) , n ∈ N, be a sequence of homogeneous semi-Markov processes (HSMP) on a countable set K, all with the same initial p.d. concentrated on a non-empty proper subset J. The subrenewal kernels which are restrictions of the corresponding renewal kernels on K×K to J×J are assumed to be suitably convergent to a renewal kernel P (on J×J). The HSMP on J corresponding to P is assumed to be strongly recurrent. Let [ π j ; j ∈ J] be the stationary p.d. of the embedded Markov chain. In terms of...

Average cost Markov control processes with weighted norms: value iteration

Evgueni Gordienko, Onésimo Hernández-Lerma (1995)

Applicationes Mathematicae

Similarity:

This paper shows the convergence of the value iteration (or successive approximations) algorithm for average cost (AC) Markov control processes on Borel spaces, with possibly unbounded cost, under appropriate hypotheses on weighted norms for the cost function and the transition law. It is also shown that the aforementioned convergence implies strong forms of AC-optimality and the existence of forecast horizons.

Robust mixing.

Ganapathy, Murali (2007)

Electronic Journal of Probability [electronic only]

Similarity: