Discrete dynamic programming and viscosity solutions of the Bellman equation

 Access to full text

 Full (PDF)

1. [1] M. Bardi, A boundary value problem for the minimum time function, to appear on SIAM J. Control and Optimization. Zbl0682.49034MR1001919
2. [2] M. Bardi, M. Falcone, An approximation scheme for the minimum time function, preprint, july 1988 MR1051632
3. [3] G. Barles, Inéquations quasi-variationnelles du premier ordre et equations d'Hamilton-Jacobi,, C.R.Acad.Sc.Paris,t.296, 1983. MR705696
4. [4] G. Barles, Deterministic impulse control problems, SIAM J. Control and Optimization, vol.23, 3, 1985 Zbl0571.49020MR784578
5. [5] G. Barles, B. Perthame, Discontinuous solutions of deterministic optimal stopping time problems, to appear in Math. Methods and Num. Anal. Zbl0629.49017MR921827
6. [6] G. Barles, B.Perthame, Exit time problems in optimal control and vanishing viscosity method, preprint Zbl0674.49027MR957658
7. [7] R. Bellman, Dynamic programming, Princeton University Press, 1957 Zbl0077.13605MR90477
8. [8] R. Bellman, S. Dreyfus, Applied Dynamic Programming, Princeton University Press, 1962 Zbl0106.34901MR140369
9. [9] A. Bensoussan, Contrôle stochastique discret, Cahiers du Ceremade 
10. [10] A. Bensoussan, W. Runggaldier, An approximation method for stochastic control problems with partial observation of the state-A method for constructing ∈-optimal controls, Acta Applicandae Mathematicae, vol. 10, 2, 1987 Zbl0653.93069MR913557
11. [11] D.P. Bertsekas, S.E. Shreve, Stochastic optimal control: the discrete time case, Academic Press, New York, 1978. Zbl0471.93002MR511544
12. [12] I. Capuzzo Dolcetta, On a discrete approximation of the Hamilton - Jacobi equation of dynamic programming, Appl.Math.and Optim.10,1983 Zbl0582.49019MR713483
13. [13] I. Capuzzo Dolcetta, L.C. Evans, Optimal switching for ordinary differential equations, SIAM J. Control and Optimization, vol.22,1984 Zbl0641.49017MR728678
14. [14] I. Capuzzo Dolcetta, H. Ishii, Approximate solutions of the Bellman equation of deterministic control theory, Appl. Math.and Optim.11,1984. Zbl0553.49024MR743925
15. [15] I. Capuzzo Dolcetta, P.L. Lions, Hamilton-Jacobi equations and state-constrained problems, to appear in Transactions of the AMS 
16. [16] I. Capuzzo Dolcetta, M. Matzeu, On the dynamic programming inequalities associated with the optimal stopping problem in discrete and continuous time, Numer. Funct. Anal. Optim., 3 (4), 1981. Zbl0476.49021MR636737
17. [17] I. Capuzzo Dolcetta, M. Matzeu, J.L. Menaldi, On a system of first order quasi-variational inequalities connected with the optimal switching problem, System and Control Letters, Vol.3,No.2,1983. Zbl0521.49008MR712129
18. [18] D.A. Carlson, A. Haurie, Infinite horizon optimal control, Lecture Notes in Economics and Mathematical Systems, 290, Springer Verlag,1987. Zbl0649.49001MR1117222
19. [19] M.G. Crandall, H. Ishii, P.L. Lions, Uniqueness of viscosity solutions of Hamilton-Jacobi equations revisited, J. Math. Soc. Japan, vol. 39, 4, 1987 Zbl0644.35016MR905626
20. [20] M.G. Crandall, P.L. Lions, Two approximations of solutions of Hamilton-Jacobi equations, Mathematics of Computation, vol.43, n.167, 1984 Zbl0556.65076MR744921
21. [21] M.G. Crandall, P.L. Lions, Viscosity solutions of Hamilton-Jacobi equations, Trans. A.M.S.277, 1983. Zbl0599.35024MR690039
22. [22] J. Cullum, An explicit procedure for discretizing continuous optimal control problems, J. Optimization Theory and Applications, 8(1),1971. Zbl0215.21907MR311105
23. [23] M. Falcone, A numerical approach to the infinite horizon problem of deterministic control theory, Appl. Math. Optim.15, 1987 Zbl0715.49023MR866164
24. [24] M. Falcone, Numerical solution of deterministic continuous control problems, Proceedings International Symposium on Numerical Analysis, Madrid, 1985 
25. [25] M. Falcone, Approximate feedback controls for deterministic control problems, in preparation 
26. [26] W.H. Fleming, Controlled Markov processes and viscosity solutions of nonlinear evolution equations, Lecture Notes, Scuola Normale Superiore Pisa, to appear Zbl0644.60086MR936839
27. [27] W.H. Fleming, R. Rishel, Deterministic and stochastic optimal control, Springer Verlag, Berlin, 1975. Zbl0323.49001MR454768
28. [28] R. Gonzales, E. Rofman, On deterministic control problems: an approximation procedure for the optimal cost, part I and II, SIAM J. Control and Optimization, vol. 23, n. 2, 1985 Zbl0563.49025
29. [29] R.A. Howard, Dynamic programming and Markov processes, Wiley, New York, 1960 Zbl0091.16001MR118514
30. [30] M.M. Hrustalev, Necessary and sufficient optimality conditions in the form of Bellman's equation, Soviet Math.Dokl. ,19 (5), 1978. Zbl0417.49017
31. [31] R. Kalaba, On nonlinear differential equations, the maximum operation and monotone convergence, J. of Math. and Mech., vol 8, n. 4, 1959 Zbl0092.07703MR107731
32. [32] H.J. Kushner, Probability methods for approximation in stochastic control and for elliptic equations, Academic Press, New York, 1977 Zbl0547.93076
33. [33] H.J. Kushner, A.J. Kleinman, Accelerated procedures for the solution of discrete Markov control problems, IEEE Trans. Automatic control, AC-16, 1971 Zbl0217.17802MR290841
34. [34] H.J. Kushner, A.J. Kleinman, Mathematical programming and the control of Markov chains, Int. J. Control, 13, 1971 Zbl0217.17802MR309624
35. [35] R.E. Larson, State increment dynamic programming , American Elsevier, New York, 1967 Zbl0204.47101MR233583
36. [36] R.E. Larson, Korsak, A dynamic programming successive approximaton technique with convergence proofs, parts I end II, Automatica, 1969 Zbl0199.51001
37. [37] E.B. Lee, L. Markus, Foundations of optimal control, J.Wiley, New York, 1967. Zbl0159.13201MR220537
38. [38] P.L. Lions, Generalized solutions of Hamilton-Jacobi equations, Pitman, London, 1982. Zbl0497.35001MR667669
39. [39] P.L. Lions, Optimal control and viscosity solutions, in I. Capuzzo Dolcetta-W.H. Fleming-T. Zolezzi (Eds.), Recent Mathematical Methods in Dynamic Programming, Lecture Notes in Mathematics1119, Springer VerlagBerlin, 1985. MR790685
40. [40] P.L. Lions, Recent progress on first order Hamilton-Jacobi equations, in Directions in Partial Differential Equations, Academic Press, 1987 Zbl0659.35015MR1013837
41. [41] P.L. Lions, B. Mercier, Approximation numérique des equations de Hamilton-Jacobi-Bellman, R.A.I.R.O Analyse numérique, vol.14, n. 4, 1980 Zbl0469.65041MR596541
42. [42] P.L. Lions, P.E. Souganidis, Differential games, optimal control and directional derivatives of viscosity solutions of Bellman-Isaacs equations, to appear in SIAM J. Control and Optimization Zbl0569.49019MR1266104
43. [43] P. Loreti, Approssimazione di soluzioni viscosità dell'equazione di Bellman, Boll. U.M.I (6), 5-B ,1986. Zbl0618.49010
44. [44] K. Malanowski, On convergence of finite difference approximations to optimal control problems for systems with control appearing linearly, Archivum Automatyki i Telemechaniki, 24, Zeszyt 2, 1979. Zbl0408.49038MR545656
45. [45] E. Mascolo, L. Migliaccio, Relaxation methods in optimal control, to appear in J. Optim. Th. App. Zbl0689.49029
46. [46] J.L. Menaldi, Probabilistic view of estimates for finite difference methods, to appear in Mathematicae Notae Zbl0713.60075MR1049544
47. [47] J.L. Menaldi, E. Rofman, An algorithm to compute the viscosity solution of the Hamilton-Jacobi-Bellman equation, in C.I. Byrnes, A. Lindquist (eds.), Theory and Applications of Nonlinear Control Systems, North-Holland, 1986 MR935396
48. [48] M.L. Puterman, S.L. Brumelle, On the convergence of policy iteration in stationary dynamic programming, Math. of Operation Research, vol.4, n. 1, 1979 Zbl0411.90072MR543609
49. [49] J.P. Quadrat, Existence de solution et algorothme de resolutions numeriques de problemes stochastiques degenerées ou non, SIAM J. Control and Optimization, vol.18, 1980 Zbl0439.93057MR560048
50. [50] M.H. SonerOptimal control with state space constraint, SIAM J. Control and Optimization, vol.24, 3, 1986 Zbl0597.49023MR838056
51. [51] P.E. Souganidis, Approximation schemes for viscosity solutions of Hamilton-Jacobi equations, Journal of Differential Equations,57,1985. Zbl0536.70020MR803085
52. [52] J. Warga, Optimal control of differential and functional equations, Academic Press,New York,1972. Zbl0253.49001MR372708
53. [53] L.C. Young, Lectures on the Calculus of Variations and Optimal Control Theory, W.B.Saunders, Philadelfia, 1969. Zbl0177.37801MR259704

1. Fabio Camilli, Maurizio Falcone, Approximation of control problems involving ordinary and impulsive controls
2. Fabio Camilli, Maurizio Falcone, Approximation of control problems involving ordinary and impulsive controls
3. Silvia C. Di Marco, Roberto L. V. González, Minimax optimal control problems. Numerical analysis of the finite horizon case
4. Lars Grüne, Discrete feedback stabilization of semilinear control systems
5. Fabio Camilli, Maurizio Falcone, An approximation scheme for the optimal control of diffusion processes