A method for constructing ε-value functions for the Bolza problem of optimal control

Jan Pustelnik

International Journal of Applied Mathematics and Computer Science (2005)

  • Volume: 15, Issue: 2, page 177-186
  • ISSN: 1641-876X

Abstract

top
The problem considered is that of approximate minimisation of the Bolza problem of optimal control. Starting from Bellman's method of dynamic programming, we define the ε-value function to be an approximation to the value function being a solution to the Hamilton-Jacobi equation. The paper shows an approach that can be used to construct an algorithm for calculating the values of an ε-value function at given points, thus approximating the respective values of the value function.

How to cite

top

Pustelnik, Jan. "A method for constructing ε-value functions for the Bolza problem of optimal control." International Journal of Applied Mathematics and Computer Science 15.2 (2005): 177-186. <http://eudml.org/doc/207733>.

@article{Pustelnik2005,
abstract = {The problem considered is that of approximate minimisation of the Bolza problem of optimal control. Starting from Bellman's method of dynamic programming, we define the ε-value function to be an approximation to the value function being a solution to the Hamilton-Jacobi equation. The paper shows an approach that can be used to construct an algorithm for calculating the values of an ε-value function at given points, thus approximating the respective values of the value function.},
author = {Pustelnik, Jan},
journal = {International Journal of Applied Mathematics and Computer Science},
keywords = {Hamilton-Jacobi equation; value function; non-linear optimisation; approximate minimum; dynamic programming; Bolza problem; optimal control; nonlinear optimisation},
language = {eng},
number = {2},
pages = {177-186},
title = {A method for constructing ε-value functions for the Bolza problem of optimal control},
url = {http://eudml.org/doc/207733},
volume = {15},
year = {2005},
}

TY - JOUR
AU - Pustelnik, Jan
TI - A method for constructing ε-value functions for the Bolza problem of optimal control
JO - International Journal of Applied Mathematics and Computer Science
PY - 2005
VL - 15
IS - 2
SP - 177
EP - 186
AB - The problem considered is that of approximate minimisation of the Bolza problem of optimal control. Starting from Bellman's method of dynamic programming, we define the ε-value function to be an approximation to the value function being a solution to the Hamilton-Jacobi equation. The paper shows an approach that can be used to construct an algorithm for calculating the values of an ε-value function at given points, thus approximating the respective values of the value function.
LA - eng
KW - Hamilton-Jacobi equation; value function; non-linear optimisation; approximate minimum; dynamic programming; Bolza problem; optimal control; nonlinear optimisation
UR - http://eudml.org/doc/207733
ER -

References

top
  1. Adams R.A. (1975): Sobolev spaces. - New York: Academic Press. Zbl0314.46030
  2. Bryson S. and Levy D. (2001): Central schemes for multi-dimensional Hamilton-Jacobi Equations. - NASA Techn. Rep., NAS-01-014. 
  3. Cesari L. (1983): Optimization - Theory and Applications. - New York: Springer. Zbl0506.49001
  4. Fleming W.H. and Rishel R.W. (1975): Deterministic and Stochastic Optimal Control. - New York: Springer. 
  5. Jacewicz E. (2001): An algorithm for construction of ε-value functions for the Bolza control problem. - Int. J. Appl. Math. Comput. Sci., Vol. 11, No. 2, pp. 391-428. Zbl0974.49016
  6. Karlsen K.H. and Risebro N.H. (2002): Unconditionally stable methods for Hamilton-Jacobi equations. - J. Comput. Phys., Vol. 180, No. 2, pp. 710-735. Zbl1143.65365
  7. Kurganov A. and Tadmor E. (2000): New high-resolution semi-discrete central schemes for Hamilton-Jacobi equations. - J. Comput. Phys., Vol. 160,No. 2, pp. 720-742. Zbl0961.65077
  8. Szpiro A. and Dupuis P. (2002): Second order numerical methods for first order Hamilton-Jacobi equations. - SIAM J. Numer. Anal.,Vol. 40, No. 3, pp. 1136-1183. Zbl1031.49027
  9. Tang H.Z., Tang T. and Zhang P. (2003): An adaptive mesh redistribution method for nonlinear Hamilton-Jacobi equations in two- and three-dimensions. - J. Comput. Phys., Vol. 188, No. 2, pp. 543-572. Zbl1037.65091

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.