The search session has expired. Please query the service again.

The search session has expired. Please query the service again.

Displaying similar documents to “A diffusion approximation in the ruin problem for a controlled Markov chain”

A generalization of Ueno's inequality for n-step transition probabilities

Andrzej Nowak (1998)

Applicationes Mathematicae

Similarity:

We provide a generalization of Ueno's inequality for n-step transition probabilities of Markov chains in a general state space. Our result is relevant to the study of adaptive control problems and approximation problems in the theory of discrete-time Markov decision processes and stochastic games.