Displaying similar documents to “Iterated function systems with continuous place dependent probabilities.”

On the core property of the cylinder functions class in the construction of interacting particle systems

Anja Voss-Böhme (2011)

Kybernetika

Similarity:

For general interacting particle systems in the sense of Liggett, it is proven that the class of cylinder functions forms a core for the associated Markov generator. It is argued that this result cannot be concluded by straightforwardly generalizing the standard proof technique that is applied when constructing interacting particle systems from their Markov pregenerators.

The first exit of almost strongly recurrent semi-Markov processes

Joachim Domsta, Franciszek Grabski (1995)

Applicationes Mathematicae

Similarity:

Let ( · ) , n ∈ N, be a sequence of homogeneous semi-Markov processes (HSMP) on a countable set K, all with the same initial p.d. concentrated on a non-empty proper subset J. The subrenewal kernels which are restrictions of the corresponding renewal kernels on K×K to J×J are assumed to be suitably convergent to a renewal kernel P (on J×J). The HSMP on J corresponding to P is assumed to be strongly recurrent. Let [ π j ; j ∈ J] be the stationary p.d. of the embedded Markov chain. In terms of...

Average cost Markov control processes with weighted norms: value iteration

Evgueni Gordienko, Onésimo Hernández-Lerma (1995)

Applicationes Mathematicae

Similarity:

This paper shows the convergence of the value iteration (or successive approximations) algorithm for average cost (AC) Markov control processes on Borel spaces, with possibly unbounded cost, under appropriate hypotheses on weighted norms for the cost function and the transition law. It is also shown that the aforementioned convergence implies strong forms of AC-optimality and the existence of forecast horizons.