Separation principle in the fractional Gaussian linear-quadratic regulator problem with partial observation

Marina L. Kleptsyna; Alain Le Breton; Michel Viot

ESAIM: Probability and Statistics (2008)

  • Volume: 12, page 94-126
  • ISSN: 1292-8100

Abstract

top
In this paper we solve the basic fractional analogue of the classical linear-quadratic Gaussian regulator problem in continuous-time with partial observation. For a controlled linear system where both the state and observation processes are driven by fractional Brownian motions, we describe explicitly the optimal control policy which minimizes a quadratic performance criterion. Actually, we show that a separation principle holds, i.e., the optimal control separates into two stages based on optimal filtering of the unobservable state and optimal control of the filtered state. Both finite and infinite time horizon problems are investigated.

How to cite

top

Kleptsyna, Marina L., Le Breton, Alain, and Viot, Michel. "Separation principle in the fractional Gaussian linear-quadratic regulator problem with partial observation." ESAIM: Probability and Statistics 12 (2008): 94-126. <http://eudml.org/doc/250420>.

@article{Kleptsyna2008,
abstract = { In this paper we solve the basic fractional analogue of the classical linear-quadratic Gaussian regulator problem in continuous-time with partial observation. For a controlled linear system where both the state and observation processes are driven by fractional Brownian motions, we describe explicitly the optimal control policy which minimizes a quadratic performance criterion. Actually, we show that a separation principle holds, i.e., the optimal control separates into two stages based on optimal filtering of the unobservable state and optimal control of the filtered state. Both finite and infinite time horizon problems are investigated. },
author = {Kleptsyna, Marina L., Le Breton, Alain, Viot, Michel},
journal = {ESAIM: Probability and Statistics},
keywords = {Fractional Brownian motion; linear system; optimal control; optimal filtering; quadratic payoff; separation principle; fractional Brownian motion},
language = {eng},
month = {1},
pages = {94-126},
publisher = {EDP Sciences},
title = {Separation principle in the fractional Gaussian linear-quadratic regulator problem with partial observation},
url = {http://eudml.org/doc/250420},
volume = {12},
year = {2008},
}

TY - JOUR
AU - Kleptsyna, Marina L.
AU - Le Breton, Alain
AU - Viot, Michel
TI - Separation principle in the fractional Gaussian linear-quadratic regulator problem with partial observation
JO - ESAIM: Probability and Statistics
DA - 2008/1//
PB - EDP Sciences
VL - 12
SP - 94
EP - 126
AB - In this paper we solve the basic fractional analogue of the classical linear-quadratic Gaussian regulator problem in continuous-time with partial observation. For a controlled linear system where both the state and observation processes are driven by fractional Brownian motions, we describe explicitly the optimal control policy which minimizes a quadratic performance criterion. Actually, we show that a separation principle holds, i.e., the optimal control separates into two stages based on optimal filtering of the unobservable state and optimal control of the filtered state. Both finite and infinite time horizon problems are investigated.
LA - eng
KW - Fractional Brownian motion; linear system; optimal control; optimal filtering; quadratic payoff; separation principle; fractional Brownian motion
UR - http://eudml.org/doc/250420
ER -

References

top
  1. F. Biagini, Y. Hu, B. Øksendal, and A. Sulem, A stochastic maximum principle for processes driven by fractional Brownian motion. Stoch. Processes Appl.100 (2002) 233–253.  
  2. H. Cramer and M.R. Leadbetter, Stationary and related stochastic processes. John Wiley & Sons, Inc. (1967).  
  3. M.H.A. Davis, Linear Estimation and Stochastic Control. Chapman and Hall (1977).  
  4. L. Decreusefond and A.S. Üstünel, Stochastic analysis of the fractional Brownian motion. Potential Analysis10 (1999) 177–214.  
  5. T.E. Duncan, Y. Hu and B. Pasik-Duncan, Stochastic calculus for fractional Brownian motion I. Theory. SIAM J. Control Optim.38 (2000) 582–612.  
  6. G. Gripenberg and I. Norros, On the prediction of fractional Brownian motion. J. Appl. Prob.33 (1996) 400–410.  
  7. M.L. Kleptsyna and A. Le Breton, Statistical analysis of the fractional Ornstein-Uhlenbeck type process. Stat. Inf. Stoch. Processes5 (2002) 229–248.  
  8. M.L. Kleptsyna and A. Le Breton, Extension of the Kalman-Bucy filter to elementary linear systems with fractional Brownian noises. Stat. Inf. Stoch. Processes5 (2002) 249–271.  
  9. M.L. Kleptsyna, A. Le Breton and M.C. Roubaud, General approach to filtering with fractional Brownian noises – Application to linear systems. Stoch. Stoch. Reports71 (2000) 119–140.  
  10. M.L. Kleptsyna, A. Le Breton and M. Viot, About the linear-quadratic regulator problem under a fractional Brownian perturbation. ESAIM: PS7 (2003) 161–170.  
  11. M.L. Kleptsyna, A. Le Breton and M. Viot, Asymptotically optimal filtering in linear systems with fractional Brownian noises. Stat. Oper. Res. Trans.28 (2004) 177–190.  
  12. M.L. Kleptsyna, A. Le Breton and M. Viot, On the infinite time horizon linear-quadratic regulator problem under a fractional Brownian perturbation. ESAIM: PS9 (2005) 185–205.  
  13. R.S. Liptser and A.N. Shiryaev, Statistics of Random Processes. Springer-Verlag (1978).  
  14. R.S. Liptser and A.N. Shiryaev, Theory of Martingales. Kluwer Academic Publ., Dordrecht (1989).  
  15. I. Norros, E. Valkeila and J. Virtamo, An elementary approach to a Girsanov formula and other analytical results on fractional Brownian motions. Bernoulli5 (1999) 571–587.  
  16. C.J. Nuzman and H.V. Poor, Linear estimation of self-similar processes via Lamperti's transformation. J. Appl. Prob.37 (2000) 429–452.  
  17. W.M. Wonham, On the separation principle of stochastic control. SIAM J. Control6 (1968) 312–326.  

NotesEmbed ?

top

You must be logged in to post comments.