Stability and sensitivity analysis for optimal control problems with a first-order state constraint and application to continuation methods

Joseph Frédéric Bonnans; Audrey Hermant

ESAIM: Control, Optimisation and Calculus of Variations (2008)

  • Volume: 14, Issue: 4, page 825-863
  • ISSN: 1292-8119

Abstract

top
The paper deals with an optimal control problem with a scalar first-order state constraint and a scalar control. In presence of (nonessential) touch points, the arc structure of the trajectory is not stable. Under some reasonable assumptions, we show that boundary arcs are structurally stable, and that touch point can either remain so, vanish or be transformed into a single boundary arc. Assuming a weak second-order optimality condition (equivalent to uniform quadratic growth), stability and sensitivity results are given. The main tools are the study of a quadratic tangent problem and the notion of strong regularity. Those results enable us to design a new continuation algorithm, presented at the end of the paper, that handles automatically changes in the structure of the trajectory.

How to cite

top

Bonnans, Joseph Frédéric, and Hermant, Audrey. "Stability and sensitivity analysis for optimal control problems with a first-order state constraint and application to continuation methods." ESAIM: Control, Optimisation and Calculus of Variations 14.4 (2008): 825-863. <http://eudml.org/doc/250376>.

@article{Bonnans2008,
abstract = { The paper deals with an optimal control problem with a scalar first-order state constraint and a scalar control. In presence of (nonessential) touch points, the arc structure of the trajectory is not stable. Under some reasonable assumptions, we show that boundary arcs are structurally stable, and that touch point can either remain so, vanish or be transformed into a single boundary arc. Assuming a weak second-order optimality condition (equivalent to uniform quadratic growth), stability and sensitivity results are given. The main tools are the study of a quadratic tangent problem and the notion of strong regularity. Those results enable us to design a new continuation algorithm, presented at the end of the paper, that handles automatically changes in the structure of the trajectory. },
author = {Bonnans, Joseph Frédéric, Hermant, Audrey},
journal = {ESAIM: Control, Optimisation and Calculus of Variations},
keywords = {Optimal control; first-order state constraint; strong regularity; sensitivity analysis; touch point; homotopy method; optimal control; touch point},
language = {eng},
month = {2},
number = {4},
pages = {825-863},
publisher = {EDP Sciences},
title = {Stability and sensitivity analysis for optimal control problems with a first-order state constraint and application to continuation methods},
url = {http://eudml.org/doc/250376},
volume = {14},
year = {2008},
}

TY - JOUR
AU - Bonnans, Joseph Frédéric
AU - Hermant, Audrey
TI - Stability and sensitivity analysis for optimal control problems with a first-order state constraint and application to continuation methods
JO - ESAIM: Control, Optimisation and Calculus of Variations
DA - 2008/2//
PB - EDP Sciences
VL - 14
IS - 4
SP - 825
EP - 863
AB - The paper deals with an optimal control problem with a scalar first-order state constraint and a scalar control. In presence of (nonessential) touch points, the arc structure of the trajectory is not stable. Under some reasonable assumptions, we show that boundary arcs are structurally stable, and that touch point can either remain so, vanish or be transformed into a single boundary arc. Assuming a weak second-order optimality condition (equivalent to uniform quadratic growth), stability and sensitivity results are given. The main tools are the study of a quadratic tangent problem and the notion of strong regularity. Those results enable us to design a new continuation algorithm, presented at the end of the paper, that handles automatically changes in the structure of the trajectory.
LA - eng
KW - Optimal control; first-order state constraint; strong regularity; sensitivity analysis; touch point; homotopy method; optimal control; touch point
UR - http://eudml.org/doc/250376
ER -

References

top
  1. E.L. Allgower and K. Georg, Numerical continuation methods, Springer Series in Computational Mathematics13. Springer-Verlag, Berlin (1990).  
  2. L. Ambrosio, N. Fusco and D. Pallara, Functions of bounded variation and free discontinuity problems, Oxford Mathematical Monographs. The Clarendon Press Oxford University Press, New York (2000).  
  3. P. Berkmann and H.J. Pesch, Abort landing in windshear: optimal control problem with third-order state constraint and varied switching structure. J. Optim. Theory Appl.85 (1995) 21–57.  
  4. J.F. Bonnans and A. Hermant, Conditions d'optimalité du second ordre nécessaires ou suffisantes pour les problèmes de commande optimale avec une contrainte sur l'état et une commande scalaires. C. R. Math. Acad. Sci. Paris343 (2006) 473–478.  
  5. J.F. Bonnans and A. Hermant, Second-order analysis for optimal control problems with pure state constraints and mixed control-state constraints. Ann. Inst. H. Poincaré Anal. Non Linéaire (to appear).  
  6. J.F. Bonnans and A. Hermant, Well-posedness of the shooting algorithm for state constrained optimal control problems with a single constraint and control. SIAM J. Control Optim.46 (2007) 1398–1430.  
  7. J.F. Bonnans and A. Hermant, No gap second order optimality conditions for optimal control problems with a single state constraint and control. Math. Programming, Ser. B (2007) DOI: .  DOI10.1007/s10107-007-0167-8
  8. J.F. Bonnans and A. Shapiro, Perturbation analysis of optimization problems. Springer-Verlag, New York (2000).  
  9. A.E. Bryson, W.F. Denham and S.E. Dreyfus, Optimal programming problems with inequality constraints I: Necessary conditions for extremal solutions. AIAA Journal1 (1963) 2544–2550.  
  10. R. Bulirsch, F. Montrone and H.J. Pesch, Abort landing in the presence of windshear as a minimax optimal control problem. II. Multiple shooting and homotopy. J. Optim. Theory Appl.70 (1991) 223–254.  
  11. P. Deuflhard, Newton methods for nonlinear problems, Affine invariance and adaptive algorithms, Springer Series in Computational Mathematics35. Springer-Verlag, Berlin (2004).  
  12. A.L. Dontchev and W.W. Hager, Lipschitzian stability for state constrained nonlinear optimal control. SIAM J. Control Optim.36 (1998) 698–718 (electronic).  
  13. N. Dunford and J. Schwartz, Linear operators, Vols. I and II. Interscience, New York (1958), (1963).  
  14. J. Gergaud and T. Haberkorn, Homotopy method for minimum consumption orbit transfer problem. ESAIM: COCV12 (2006) 294–310 (electronic).  
  15. W.W. Hager, Lipschitz continuity for constrained processes. SIAM J. Control Optim.17 (1979) 321–338.  
  16. A. Haraux, How to differentiate the projection on a convex set in Hilbert space. Some applications to variational inequalities. J. Math. Soc. Japan29 (1977) 615–631.  
  17. R.F. Hartl, S.P. Sethi and R.G. Vickson, A survey of the maximum principles for optimal control problems with state constraints. SIAM Review37 (1995) 181–218.  
  18. A.D. Ioffe and V.M. Tihomirov, Theory of Extremal Problems. North-Holland Publishing Company, Amsterdam (1979). Russian Edition: Nauka, Moscow (1974).  
  19. D.H. Jacobson, M.M. Lele and J.L. Speyer, New necessary conditions of optimality for control problems with state-variable inequality contraints. J. Math. Anal. Appl.35 (1971) 255–284.  
  20. K. Malanowski, Two-norm approach in stability and sensitivity analysis of optimization and optimal control problems. Adv. Math. Sci. Appl.2 (1993) 397–443.  
  21. K. Malanowski, Stability and sensitivity of solutions to nonlinear optimal control problems. J. Appl. Math. Optim.32 (1995) 111–141.  
  22. K. Malanowski, Sufficient optimality conditions for optimal control subject to state constraints. SIAM J. Control Optim.35 (1997) 205–227.  
  23. K. Malanowski and H. Maurer, Sensitivity analysis for state constrained optimal control problems. Discrete Contin. Dynam. Systems4 (1998) 241–272.  
  24. P. Martinon and J. Gergaud, An application of PL continuation methods to singular arcs problems, in Recent advances in optimization, Lect. Notes Econom. Math. Systems563, Springer, Berlin (2006) 163–186.  
  25. H. Maurer, On the minimum principle for optimal control problems with state constraints. Schriftenreihe des Rechenzentrum 41, Universität Münster (1979).  
  26. H. Maurer and H.J. Pesch, Solution differentiability for nonlinear parametric control problems. SIAM J. Control Optim.32 (1994) 1542–1554.  
  27. F. Mignot, Contrôle dans les inéquations variationnelles elliptiques. J. Funct. Anal.22 (1976) 130–185.  
  28. L.S. Pontryagin, V.G. Boltyanskii, R.V. Gamkrelidze and E.F. Mishchenko, The mathematical theory of optimal processes. Translated from the Russian by K.N. Trirogoff; L.W. Neustadt Ed., Interscience Publishers John Wiley & Sons, Inc. New York-London (1962).  
  29. S.M. Robinson, First order conditions for general nonlinear optimization. SIAM J. Appl. Math.30 (1976) 597–607.  
  30. S.M. Robinson, Stability theorems for systems of inequalities, part II: Differentiable nonlinear systems. SIAM J. Numer. Anal.13 (1976) 497–513.  
  31. S.M. Robinson, Strongly regular generalized equations. Math. Oper. Res.5 (1980) 43–62.  
  32. J. Sokolowski, Sensitivity analysis of control constrained optimal control problems for distributed parameter systems. SIAM J. Control Optim.25 (1987) 1542–1556.  
  33. J. Stoer and R. Bulirsch, Introduction to Numerical Analysis. Springer-Verlag, New York (1993).  

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

                
Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.