# Dynamic programming principle for stochastic recursive optimal control problem with delayed systems

ESAIM: Control, Optimisation and Calculus of Variations (2012)

- Volume: 18, Issue: 4, page 1005-1026
- ISSN: 1292-8119

## Access Full Article

top## Abstract

top## How to cite

topChen, Li, and Wu, Zhen. "Dynamic programming principle for stochastic recursive optimal control problem with delayed systems." ESAIM: Control, Optimisation and Calculus of Variations 18.4 (2012): 1005-1026. <http://eudml.org/doc/272946>.

@article{Chen2012,

abstract = {In this paper, we study one kind of stochastic recursive optimal control problem for the systems described by stochastic differential equations with delay (SDDE). In our framework, not only the dynamics of the systems but also the recursive utility depend on the past path segment of the state process in a general form. We give the dynamic programming principle for this kind of optimal control problems and show that the value function is the viscosity solution of the corresponding infinite dimensional Hamilton-Jacobi-Bellman partial differential equation.},

author = {Chen, Li, Wu, Zhen},

journal = {ESAIM: Control, Optimisation and Calculus of Variations},

keywords = {stochastic differential equation with delay; recursive optimal control problem; dynamic programming principle; Hamilton-Jacobi-Bellman equation},

language = {eng},

number = {4},

pages = {1005-1026},

publisher = {EDP-Sciences},

title = {Dynamic programming principle for stochastic recursive optimal control problem with delayed systems},

url = {http://eudml.org/doc/272946},

volume = {18},

year = {2012},

}

TY - JOUR

AU - Chen, Li

AU - Wu, Zhen

TI - Dynamic programming principle for stochastic recursive optimal control problem with delayed systems

JO - ESAIM: Control, Optimisation and Calculus of Variations

PY - 2012

PB - EDP-Sciences

VL - 18

IS - 4

SP - 1005

EP - 1026

AB - In this paper, we study one kind of stochastic recursive optimal control problem for the systems described by stochastic differential equations with delay (SDDE). In our framework, not only the dynamics of the systems but also the recursive utility depend on the past path segment of the state process in a general form. We give the dynamic programming principle for this kind of optimal control problems and show that the value function is the viscosity solution of the corresponding infinite dimensional Hamilton-Jacobi-Bellman partial differential equation.

LA - eng

KW - stochastic differential equation with delay; recursive optimal control problem; dynamic programming principle; Hamilton-Jacobi-Bellman equation

UR - http://eudml.org/doc/272946

ER -

## References

top- [1] M. Chang, T. Pang and M. Pemy, Optimal control of stochastic functional differential equations with a bounded memory. Stochastic An International J. Probability & Stochastic Process 80 (2008) 69–96. Zbl1138.93065MR2384822
- [2] D. Duffie and L.G. Epstein, Stochastic differential utility. Economicrica60 (1992) 353–394. Zbl0763.90005MR1162620
- [3] N. El Karoui, S. Peng and M.C. Quenez, Backward stochastic differential equation in finance. Math. Finance7 (1997) 1–71. Zbl0884.90035MR1434407
- [4] M. Fuhrman and G. Tessitore, Nonlinear Kolmogorov equation in infinite dimensional spaces : the backward stochastic differential equations approach and applications to optimal control. Ann. Probab.30 (2002) 1397–1465. Zbl1017.60076MR1920272
- [5] M. Fuhrman, F. Masiero and G. Tessitore, Stochastic equations with delay : optimal control via BSDEs and regular solutions of Hamilton-Jacobi-Bellman equations. SIAM J. Control Optim.48 (2010) 4624–4651. Zbl1213.60109MR2683901
- [6] B. Larssen, Dynamic programming in stochastic control of systems with delay. Stoch. Stoch. Rep.74 (2002) 651–673. Zbl1022.34075MR1943584
- [7] B. Larssen and N.H. Risebro, When are HJB equations for control problems with stochastic delay equations finite dimensional? Dr. Scient. thesis, University of Oslo (2003). Zbl1052.60051
- [8] S.E.A. Mohammed, Stochastic Functional Differential Equations, Pitman (1984). Zbl0584.60066
- [9] S.E.A. Mohammed, Stochastic Differential Equations with Memory : Theory, Examples and Applications, Stochastic Analysis and Related Topics 6. The Geido Workshop (1996); Progress in Probability. Birkhauser (1998). Zbl0901.60030MR1652338
- [10] S. Peng, A generalized dynamic programming principle and Hamilton-Jacobi-Bellmen equation. Stoch. Stoch. Rep.38 (1992) 119–134. Zbl0756.49015MR1274898
- [11] S. Peng, Backward stochastic differential equations-stochastic optimization theory and viscosity solution of HJB equations. Topics on Stochastic Analysis (in Chinese), edited by J. Yan, S. Peng, S. Fang and L. Wu. Science Press, Beijing (1997) 85–138.
- [12] Z. Wu and Z. Yu, Dynamic programming principle for one kind of stochastic recursive optimal control problem and Hamilton-Jacobi-Bellman equation. SIAM J. Control Optim.47 (2008) 2616–2641. Zbl1171.49022MR2452889
- [13] J. Yong and X.Y. Zhou, Stochastic Controls. Springer-Verlag (1999). Zbl0943.93002MR1696772