A connection between controlled Markov chains and martingales

 Access to full text

 Full (PDF)

1. R. Bellman, A Markovian decision process, J. of Math. and Mech. 6 (1957), 679-684. (1957) Zbl0078.34101MR0091859
2. P. Billingsley, The Lindeberg-Lévy theorem for martingales, Proc. Amer. Math. Soc. 12 (1961), 788-792. (1961) Zbl0129.10701MR0126871
3. B. M. Brown G. K. Eagleson, Martingale convergence to infinitely divisible laws with finite variances, Trans. Amer. Math. Soc. 162 (1971), 449-453. (1971) MR0288806
4. M. Loéve, Probability theory, Princeton 1960. (1960) MR0123342
5. P. Mandl, On the variance in controlled Markov chains, Kybernetika 7 (1971), 1-12. (1971) Zbl0215.25902MR0286178
6. P. Mandl, On the asymptotic normality of the reward in a controlled Markov chain, (To appear in Trans. of European Meeting of Statisticians held in Budapest, 1972.) (1972) MR0381808

1. Pham Kieu, A diffusion approximation in the ruin problem for a controlled Markov chain
2. Daniela Kuklíková, Approximation of bivariate Markov chains by one-dimensional diffusion processes
3. Onésimo Hernández-Lerma, Myriam Muñoz de Ozak, Discrete-time Markov control processes with discounted unbounded costs: Optimality criteria