Martingale methods in discrete state random processes

 Access to full text

 Full (PDF)

1. J. A. Bather, On the sequential construction of an optimal age replacement policy, Proc. 41st Session ISI, New Delhi 1977. (1977) MR0617579
2. B. M. Brown, Martingale central limit theorems, Ann. Math. Statist. 42 (1971), 1, 59 -66. (1971) Zbl0218.60048MR0290428
3. J. L. Doob, Stochastic Processes, John Wiley, New York-London 1953. (1953) Zbl0053.26802MR0058896
4. R. S. Liptser A. N. Shiryayev, Statistics of Random Processes II - Applications, Springer - Verlag, New York-Heidelberg-Berlin 1978. (1978) MR0488267
5. P. Mandl, On self-optimizing control of Markov processes, To appear in Mathematical Control Theory, Banach Center Publications, Warsaw 1983. (1983) MR0851236
6. J. H. van Schuppen, Stochastic filtering theory: A discussion of concepts, methods, and results, In: Stochastic Control Theory and Stochastic Differential Systems (M. Kohlmann, W. Vogel, eds.), 209-226. Springer - Verlag, Berlin-Heidelberg-New York 1979. (1979) Zbl0411.93033MR0547473

1. Petr Mandl, Ma.Rosario Romera Ayllón, On controlled Markov processes with average cost criterion
2. Petr Mandl, Ma.Rosario Romera Ayllón, On adaptive control of Markov processes
3. Monika Laušmanová, A vanishing discount limit theorem for controlled Markov chains