# Nonconvex Duality and Semicontinuous Proximal Solutions of HJB Equation in Optimal Control

Mustapha Serhani; Nadia Raïssi

RAIRO - Operations Research (2009)

- Volume: 43, Issue: 2, page 201-214
- ISSN: 0399-0559

## Access Full Article

top## Abstract

top## How to cite

topSerhani, Mustapha, and Raïssi, Nadia. "Nonconvex Duality and Semicontinuous Proximal Solutions of HJB Equation in Optimal Control." RAIRO - Operations Research 43.2 (2009): 201-214. <http://eudml.org/doc/250653>.

@article{Serhani2009,

abstract = {
In this work, we study an optimal control problem dealing with differential inclusion.
Without requiring Lipschitz condition of the set valued map, it is
very hard to look for a solution of the control problem. Our aim is
to find estimations of the minimal value, (α), of the cost
function of the control problem. For this, we construct an
intermediary dual problem leading to a weak duality result, and
then, thanks to additional assumptions of monotonicity of proximal
subdifferential, we give a more precise estimation of (α). On
the other hand, when the set valued map fulfills the Lipshitz
condition, we prove that the lower semicontinuous (l.s.c.) proximal
supersolutions of the Hamilton-Jacobi-Bellman (HJB) equation
combined with the estimation of (α), lead to a sufficient
condition of optimality for a suspected trajectory. Furthermore, we
establish a strong duality between this optimal control problem and
a dual problem involving upper hull of l.s.c. proximal
supersolutions of the HJB equation (respectively with contingent
supersolutions). Finally this strong duality gives rise to necessary
and sufficient conditions of optimality.
},

author = {Serhani, Mustapha, Raïssi, Nadia},

journal = {RAIRO - Operations Research},

keywords = {Optimal control; duality; HJB equation; proximal supersolution; proximal subdifferential.; optimal control; proximal subdifferential},

language = {eng},

month = {4},

number = {2},

pages = {201-214},

publisher = {EDP Sciences},

title = {Nonconvex Duality and Semicontinuous Proximal Solutions of HJB Equation in Optimal Control},

url = {http://eudml.org/doc/250653},

volume = {43},

year = {2009},

}

TY - JOUR

AU - Serhani, Mustapha

AU - Raïssi, Nadia

TI - Nonconvex Duality and Semicontinuous Proximal Solutions of HJB Equation in Optimal Control

JO - RAIRO - Operations Research

DA - 2009/4//

PB - EDP Sciences

VL - 43

IS - 2

SP - 201

EP - 214

AB -
In this work, we study an optimal control problem dealing with differential inclusion.
Without requiring Lipschitz condition of the set valued map, it is
very hard to look for a solution of the control problem. Our aim is
to find estimations of the minimal value, (α), of the cost
function of the control problem. For this, we construct an
intermediary dual problem leading to a weak duality result, and
then, thanks to additional assumptions of monotonicity of proximal
subdifferential, we give a more precise estimation of (α). On
the other hand, when the set valued map fulfills the Lipshitz
condition, we prove that the lower semicontinuous (l.s.c.) proximal
supersolutions of the Hamilton-Jacobi-Bellman (HJB) equation
combined with the estimation of (α), lead to a sufficient
condition of optimality for a suspected trajectory. Furthermore, we
establish a strong duality between this optimal control problem and
a dual problem involving upper hull of l.s.c. proximal
supersolutions of the HJB equation (respectively with contingent
supersolutions). Finally this strong duality gives rise to necessary
and sufficient conditions of optimality.

LA - eng

KW - Optimal control; duality; HJB equation; proximal supersolution; proximal subdifferential.; optimal control; proximal subdifferential

UR - http://eudml.org/doc/250653

ER -

## References

top- J.P. Aubin, Viability theory. Birkhäuser Boston Inc. (1991). Zbl0755.93003
- J.P. Aubin and A. Cellina, Differential inclusions. A Series of Comprehensive Studies in Mathematics, Springer-Verlag (1984).
- J.P. Aubin and I. Ekeland, Applied nonlinear analysis. A Wiley Interscience Publication, John Wiley & Sons (1984). Zbl0641.47066
- J.P. Aubin and H. Frankowska, Set valued analysis. Birkhäuser (1990).
- M. Bardi and I. Capuzzo-Dolcetta, Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations. Birkhäuser (1997). Zbl0890.49011
- G. Barles, Solutions de viscosité des équations de Hamilton-Jacobi. Mathématiques & Applications, Springer-Verlag (1994).
- E.N. Barron, Viscosity solutions and analysis in L∞, in Nonlinear analysis, differential equations and control, edited by F.H. Clarke and R. Stern. NATO Sciences Series (1999). Zbl0973.49024
- E.N. Barron, L.C. Evans and R. Jensen, Viscosity solutions of Isaacs' equations and differential games with Lipshitz controls. J. Differ. Equ.53 (1984) 213–233. Zbl0548.90104
- E.N. Barron and R. Jensen, Semicontinuous viscosity solutions for Hamilton-Jacobi equations with convex Hamiltonians. Commun. Partial Differ. Equ.15 (1990) 1713–1742. Zbl0732.35014
- E.N. Barron and R. Jensen, Optimal control and semicontinuous viscosity solutions. Proc. Am. Math. Soc.113 (1991) 397–402. Zbl0741.49010
- C.W. Clark and J.M. Conrad, Natural resource economics. Cambridge University PressBirkhäuser (1995).
- F.H. Clarke, Optimization and nonsmooth analysis. Society for Industrial and Applied Mathematics, Philadelphia (1983). Zbl0582.49001
- F.H. Clarke, Yu.S. Ledyaev and Stern R.J., Invariance, monotonicity, and applications. Nonlinear analysis, differential equations and control, edited by F.H. Clarke and R. Stern. NATO Sciences Series (1999). Zbl0936.93001
- F.H. Clarke, Yu.S. Ledyaev and P.R. Wolenski, Qualitative properties of trajectories of control systems: a survey. J. Dyn. Control Syst.1 (1995) 1–48. Zbl0951.49003
- F.H. Clarke, Yu.S. Ledyaev, R.J. Stern and P.R. Wolenski, Nonsmooth analysis and control theory. Graduate Texts In Mathematics, Springer (1998). Zbl1047.49500
- F.H. Clarke and Yu.S. Ledyaev, Mean value inequalities in Hilbert space. Trans. Am. Math. Soc.344 (1994) 307–324. Zbl0803.49018
- F.H. Clarke, Yu.S. Ledyaev and P.R. Wolenski, Proximal analysis and minimization principles. J. Math. Anal. Appl.196 (1995) 722–735. Zbl0865.49015
- M.G. Crandall and P.L. Lions, Viscosity solutions of Hamilton-Jacobi equations. Trans. Am. Math. Soc.277 (1983). Zbl0599.35024
- M.G. Crandall, L.C. Evan and P.L. Lions, Some properties of viscosity solutions of Hamilton-Jacobi equations. Trans. Am. Math. Soc.282 (1984). Zbl0543.35011
- L.C. Evan and M.R. James, The Hamilton-Jacobi-Bellman equation for time-optimal control. SIAM J. Control Optim.27 (1989) 1477–1489. Zbl0688.49029
- H. Frankowska, Equations de Hamilton-Jacobi contingentes. C. R. Acad. Sci.Série I304 (1987).
- H. Frankowska, Lower semicontinuous solutions of Hamilton-Jacobi-Bellman equations. SIAM J. Control Optim.31 (1993) 257–272. Zbl0796.49024
- H. Frankowska, S. Plaskacz and T. Rzeżuchowski, Measurable viability theorem and the Hamilton-Jacobi-Bellman equations. J. Diff. Equ.116 (1995) 265–305. Zbl0836.34016
- P.L. Lions and P.E. Souganidis, Differential Games, Optimal control and directional derivatives of viscosity solutions of Bellman's and Isaacs' equations. SIAM J. Control Optim.23 (1985) 566–583. Zbl0569.49019
- J.P. Penot and M. Volle, Explicit solutions to Hamilton-Jacobi equations under mild continuity and convexity assumptions. J. Nonlinear Convex Anal.1 (2000) 177–199. Zbl0970.49022
- N. Raïssi, Analyse proximale en optimisation. Ph.D. thesis, Université Montréal, Faculté des Arts et des Sciences, Canada (1987).
- T.R. Rockafellar, Existence theorems for general control problem of Bolza and Lagrange. Adv. Math.15 (1975) 312–337. Zbl0319.49001
- M. Serhani and N. Raïssi, Nonconvex duality and generalized solutions of HJB equation in optimal control problem, in Conférence Internationale en Optimisation FGI, 4–9 Septembre, Montpellier, France (2000). Zbl1162.49004
- M. Serhani and N. Raïssi, Nonconvex duality and viscosity solutions of HJB equation in optimal control problem. J. Convex Anal.9 (2002) 625–648. Zbl1026.49022
- M. Serhani, Dualité et analyse non lisse : Optimisation non convexe, contrôle optimal et solutions généralisées de l'équation de HJB. Ph.D. thesis. University Ibn Tofail, Morocco (2002).
- R. Vinter, Convex duality and nonlinear optimal control. SIAM J. Control Optim.31 (1993) 518–538. Zbl0781.49012
- R. Vinter and P.R. Wolenski, Hamilton-Jacobi theory for optimal control problems with data measurable in time. SIAM J. Control Optim.28 (1990) 1404–1419. Zbl0721.49029
- J.J. Ye, Discontinuous solutions of the Hamilton-Jacobi equations for exit time problems. SIAM J. Control Optim.38 (2000) 1067–1085. Zbl0969.49011
- L.C. Young, Lectures on the calculus of variations and optimal control theory. W.B. Saunders Company (1969). Zbl0177.37801