Asymptotic properties and optimization of some non-Markovian stochastic processes
Evgueni I. Gordienko; Antonio Garcia; Juan Ruiz de Chavez
Kybernetika (2009)
- Volume: 45, Issue: 3, page 475-490
- ISSN: 0023-5954
Access Full Article
top
Abstract
topHow to cite
topGordienko, Evgueni I., Garcia, Antonio, and Chavez, Juan Ruiz de. "Asymptotic properties and optimization of some non-Markovian stochastic processes." Kybernetika 45.3 (2009): 475-490. <http://eudml.org/doc/37677>.
@article{Gordienko2009,
abstract = {We study the limit behavior of certain classes of dependent random sequences (processes) which do not possess the Markov property. Assuming these processes depend on a control parameter we show that the optimization of the control can be reduced to a problem of nonlinear optimization. Under certain hypotheses we establish the stability of such optimization problems.},
author = {Gordienko, Evgueni I., Garcia, Antonio, Chavez, Juan Ruiz de},
journal = {Kybernetika},
keywords = {nonmarkovian control sequence; average cost; attracting point; nonlinear optimitation; stability; non-Markovian control sequence; average cost; attracting point; nonlinear optimisation; stability},
language = {eng},
number = {3},
pages = {475-490},
publisher = {Institute of Information Theory and Automation AS CR},
title = {Asymptotic properties and optimization of some non-Markovian stochastic processes},
url = {http://eudml.org/doc/37677},
volume = {45},
year = {2009},
}
TY - JOUR
AU - Gordienko, Evgueni I.
AU - Garcia, Antonio
AU - Chavez, Juan Ruiz de
TI - Asymptotic properties and optimization of some non-Markovian stochastic processes
JO - Kybernetika
PY - 2009
PB - Institute of Information Theory and Automation AS CR
VL - 45
IS - 3
SP - 475
EP - 490
AB - We study the limit behavior of certain classes of dependent random sequences (processes) which do not possess the Markov property. Assuming these processes depend on a control parameter we show that the optimization of the control can be reduced to a problem of nonlinear optimization. Under certain hypotheses we establish the stability of such optimization problems.
LA - eng
KW - nonmarkovian control sequence; average cost; attracting point; nonlinear optimitation; stability; non-Markovian control sequence; average cost; attracting point; nonlinear optimisation; stability
UR - http://eudml.org/doc/37677
ER -
References
top- Random Iterative Models, Springer-Verlag, Berlin 1997. Zbl0868.62069MR1485774
- Controlled Markov Processes, Springer-Verlag, New York 1979. MR0554083
- An estimate of the stability of optimal control of certain stochastic and deterministic systems, J. Soviet Math. 50 (1992), 891–899. (Translated from the Russian publication of 1989). MR1163393
- Stability estimates in the problem of average optimal switching of a Markov chain, Math. Methods Oper. Res. 57 (2003), 345–365. MR1990916
- Average optimality for Markov decision processes in Borel spaces: a new condition and approach, J. Appl. Probab. 43 (2006), 318–334. MR2248567
- Discrete-Time Markov Control Processes, Springer-Verlag, New York 1996. MR1363487
- Estimates for perturbations and average Markov decision processes with a minimal state and upper bounded by stochastically ordered Markov chains, Kybernetika 41 (2005), 757–772. MR2193864
- Foundations of Stochastic Inventory Theory, Stanford University Press, Stanford 2002.
- Mass Transportation Problems, Vol. II. Springer-Verlag, New York 1998. MR1619171
- Fundamentals of Telecomunication Networks, Wiley, New York 1994.
- Mathematical Theory of Adaptive Control, World Scientific, New Jersey 2006. MR2206045
NotesEmbed ?
topYou must be logged in to post comments.
To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.