Partially observed optimal controls of forward-backward doubly stochastic systems
ESAIM: Control, Optimisation and Calculus of Variations (2013)
- Volume: 19, Issue: 3, page 828-843
- ISSN: 1292-8119
Access Full Article
topAbstract
topHow to cite
topShi, Yufeng, and Zhu, Qingfeng. "Partially observed optimal controls of forward-backward doubly stochastic systems." ESAIM: Control, Optimisation and Calculus of Variations 19.3 (2013): 828-843. <http://eudml.org/doc/272923>.
@article{Shi2013,
abstract = {The partially observed optimal control problem is considered for forward-backward doubly stochastic systems with controls entering into the diffusion and the observation. The maximum principle is proven for the partially observable optimal control problems. A probabilistic approach is used, and the adjoint processes are characterized as solutions of related forward-backward doubly stochastic differential equations in finite-dimensional spaces. Then, our theoretical result is applied to study a partially-observed linear-quadratic optimal control problem for a fully coupled forward-backward doubly stochastic system.},
author = {Shi, Yufeng, Zhu, Qingfeng},
journal = {ESAIM: Control, Optimisation and Calculus of Variations},
keywords = {forward-backward doubly stochastic system; partially observed optimal control; maximum principle; adjoint equation; finite-dimensional spaces},
language = {eng},
number = {3},
pages = {828-843},
publisher = {EDP-Sciences},
title = {Partially observed optimal controls of forward-backward doubly stochastic systems},
url = {http://eudml.org/doc/272923},
volume = {19},
year = {2013},
}
TY - JOUR
AU - Shi, Yufeng
AU - Zhu, Qingfeng
TI - Partially observed optimal controls of forward-backward doubly stochastic systems
JO - ESAIM: Control, Optimisation and Calculus of Variations
PY - 2013
PB - EDP-Sciences
VL - 19
IS - 3
SP - 828
EP - 843
AB - The partially observed optimal control problem is considered for forward-backward doubly stochastic systems with controls entering into the diffusion and the observation. The maximum principle is proven for the partially observable optimal control problems. A probabilistic approach is used, and the adjoint processes are characterized as solutions of related forward-backward doubly stochastic differential equations in finite-dimensional spaces. Then, our theoretical result is applied to study a partially-observed linear-quadratic optimal control problem for a fully coupled forward-backward doubly stochastic system.
LA - eng
KW - forward-backward doubly stochastic system; partially observed optimal control; maximum principle; adjoint equation; finite-dimensional spaces
UR - http://eudml.org/doc/272923
ER -
References
top- [1] F. Baghery and B. Øksendal, A maximum principle for stochastic control with partial information. Stoch. Anal. Appl.25 (2007) 705–717. Zbl1140.93046MR2321904
- [2] S. Bahlali and B. Gherbal, Optimality conditions of controlled backward doubly stochastic differential equations. Random Oper. Stoch. Equ.18 (2010) 247–265. Zbl1226.93136MR2718124
- [3] A. Bally and A. Matoussi, Weak solutions of stochastic PDEs and backward doubly stochastic differential equations. J. Theoret. Probab.14 (2001) 125–164. Zbl0982.60057MR1822898
- [4] J.S. Baras, R.J. Elliott and M. Kohlmann, The partially-observed stochastic minimum principle. SIAM J. Control Optim.27 (1989) 1279–1292. Zbl0681.93068MR1022428
- [5] A. Bensoussan, Maximum principle and dynamic programming approaches of the optimal control of partially observed diffusions. Stochastics9 (1983) 169–222. Zbl0516.60072MR705471
- [6] J.M. Bismut, An introductory approach to duality in optimal stochastic control. SIAM J. Control Optim.20 (1978) 62–78. Zbl0378.93049MR469466
- [7] Y. Han, S. Peng and Z. Wu, Maximum principle for backward doubly stochastic control systems with applications. SIAM J. Control Optim.48 (2010) 4224–4241. Zbl1222.49040MR2665464
- [8] U.G. Haussmann, The maximum principle for optimal control of diffusions with partial information. SIAM J. Control Optim.25 (1987) 341–361. Zbl0617.93077MR877067
- [9] L. Hu and Y. Ren, Stochastic PDIEs with nonlinear Neumann boundary conditions and generalized backward doubly stochastic differential equations driven by Lévy processes. J. Comput. Appl. Math.229 (2009) 230–239. Zbl1173.60023MR2522516
- [10] J. Huang, G. Wang and J. Xiong, A maximum principle for partial information backward stochastic control problems with applications. SIAM J. Control Optim.48 (2009) 2106–2117. Zbl1203.49037MR2520321
- [11] H.J. Kushner, Necessary conditions for continuous parameter stochastic optimization problems. SIAM J. Control Optim.10 (1972) 550–565. Zbl0242.93063MR314535
- [12] X. Li and S. Tang, General necessary conditions for partially-observed optimal stochastic controls. J. Appl. Probab.32 (1995) 1118–1137. Zbl0844.93076MR1363354
- [13] Q. Meng, A maximum principle for optimal control problem of fully coupled forward-backward stochastic systems with partial information. Sci. China Ser. A52 (2009) 1579–1588. Zbl1176.93083MR2520595
- [14] Q. Meng and M. Tang, Necessary and sufficient conditions for optimal control of stochastic systems associated with Lévy processes. Sci. China Ser. F52 (2009) 1982–1992. Zbl1182.49023MR2566626
- [15] E. Pardoux and S. Peng, Backward doubly stochastic differential equations and systems of quasilinear parabolic SPDE’s. Probab. Theory Related Fields98 (1994) 209–227. Zbl0792.60050MR1258986
- [16] S. Peng, A general stochastic maximum principle for optimal control problems. SIAM J. Control Optim.28 (1990) 966–979. Zbl0712.93067MR1051633
- [17] S. Peng and Y. Shi, A type of time-symmetric forward-backward stochastic differential equations. C. R. Acad. Sci. Paris, Ser. I 336 (2003) 773–778. Zbl1031.60055MR1989279
- [18] L.S. Pontryagin, V.G. Boltyanskti, R.V. Gamkrelidze and E.F. Mischenko, The Mathematical Theory of Optimal Control Processe. Interscience, John Wiley, New York (1962).
- [19] Y. Ren, A. Lin and L. Hu, Stochastic PDIEs and backward doubly stochastic differential equations driven by Lévy processes. J. Comput. Appl. Math.223 (2009) 901–907. Zbl1154.60336MR2478888
- [20] Y. Shi, Y. Gu and K. Liu, Comparison theorems of backward doubly stochastic differential equations and applications. Stoch. Anal. Appl.23 (2005) 97–110. Zbl1067.60046MR2123946
- [21] J. Shi and Z. Wu, The maximum principle for fully coupled forward backward stochastic control system. Acta Automat. Sinica32 (2006) 161–169. MR2230926
- [22] J. Shi and Z. Wu, Maximum principle for partially-observed optimal control of fully-coupled forward-backward stochastic systems. J. Optim. Theory Appl.145 (2010) 543–578. Zbl1209.49034MR2645802
- [23] S. Tang, The maximum principle for partially observed optimal control of stochastic differential equations. SIAM J. Control Optim.36 (1998) 1596–1617. Zbl0915.93068MR1626880
- [24] G. Wang and Z. Wu, The maximum principle for stochastic recursive optimal control problems under partial information. IEEE Trans. Autom. Control54 (2009) 1230–1242. MR2532612
- [25] Z. Wu, Maximum principle for optimal control problem of fully coupled forward-backward stochastic systems. Syst. Sci. Math. Sci.11 (1998) 249–259. Zbl0938.93066MR1651258
- [26] Z. Wu, A maximum principle for partially observed optimal control of forward-backward stochastic control systems. Sci. China Ser. F53 (2010) 2205–2214. Zbl1227.93116MR2734814
- [27] W. Xu, Stochastic maximum principle for optimal control problem of forward and backward system. J. Aust. Math. Soc.37 (1995) 172–185. Zbl0862.93067MR1359179
- [28] L. Zhang and Y. Shi, Maximum principle for forward-backward doubly stochastic control systems and applications. ESAIM: COCV 17 (2011) 1174–1197. Zbl1236.93155MR2859871
- [29] L. Zhang and Y. Shi, Optimal Control of Stochastic Partial Differential Equations (2010) arXiv:1009.6061v2.
- [30] Q. Zhang and H. Zhao, Pathwise stationary solutions of stochastic partial differential equations and backward doubly stochastic differential equations on infinite horizon. J. Funct. Anal.252 (2007) 171–219. Zbl1127.60059MR2357354
- [31] Q. Zhang and H. Zhao, Stationary solutions of SPDEs and infinite horizon BDSDEs under non-Lipschitz coefficients. J. Differ. Equations248 (2010) 953–991. Zbl1196.60120MR2592878
- [32] Q. Zhu, T. Wang and Y. Shi, Maximum principle for partially observed optimal control of backward doubly stochastic systems, in Proc. of the 30th Chinese Control Conference (2011) 1383–1388.
NotesEmbed ?
topTo embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.