A coupling technique for stochastic comparison of functions of Markov processes.
Doisy, M. (2000)
Journal of Applied Mathematics and Decision Sciences
Similarity:
Doisy, M. (2000)
Journal of Applied Mathematics and Decision Sciences
Similarity:
Anja Voss-Böhme (2011)
Kybernetika
Similarity:
For general interacting particle systems in the sense of Liggett, it is proven that the class of cylinder functions forms a core for the associated Markov generator. It is argued that this result cannot be concluded by straightforwardly generalizing the standard proof technique that is applied when constructing interacting particle systems from their Markov pregenerators.
Fleischmann, Klaus, Swart, Jan M. (2006)
Electronic Journal of Probability [electronic only]
Similarity:
M. González, M. Molina, M. Mota (2001)
Extracta Mathematicae
Similarity:
Berestycki, Julien (2004)
Electronic Journal of Probability [electronic only]
Similarity:
Nagahata, Yukio, Yoshida, Nobuo (2010)
Electronic Communications in Probability [electronic only]
Similarity:
Evgueni Gordienko, Onésimo Hernández-Lerma (1995)
Applicationes Mathematicae
Similarity:
This paper shows the convergence of the value iteration (or successive approximations) algorithm for average cost (AC) Markov control processes on Borel spaces, with possibly unbounded cost, under appropriate hypotheses on weighted norms for the cost function and the transition law. It is also shown that the aforementioned convergence implies strong forms of AC-optimality and the existence of forecast horizons.
Joachim Domsta, Franciszek Grabski (1995)
Applicationes Mathematicae
Similarity:
Let , n ∈ N, be a sequence of homogeneous semi-Markov processes (HSMP) on a countable set K, all with the same initial p.d. concentrated on a non-empty proper subset J. The subrenewal kernels which are restrictions of the corresponding renewal kernels on K×K to J×J are assumed to be suitably convergent to a renewal kernel P (on J×J). The HSMP on J corresponding to P is assumed to be strongly recurrent. Let [; j ∈ J] be the stationary p.d. of the embedded Markov chain. In terms of...
Ryszard Rudnicki (1993)
Annales Polonici Mathematici
Similarity:
Let X(t) be a diffusion process satisfying the stochastic differential equation dX(t) = a(X(t))dW(t) + b(X(t))dt. We analyse the asymptotic behaviour of p(t) = ProbX(t) ≥ 0 as t → ∞ and construct an equation such that and .
Toronjadze, T. (2002)
Georgian Mathematical Journal
Similarity: