Viscosity solutions of the Bellman equation for exit time optimal control problems with non-Lipschitz dynamics
We study the Bellman equation for undiscounted exit time optimal control problems with fully nonlinear lagrangians and fully nonlinear dynamics using the dynamic programming approach. We allow problems whose non-Lipschitz dynamics admit more than one solution trajectory for some choices of open loop controls and initial positions. We prove a uniqueness theorem which characterizes the value functions of these problems as the unique viscosity solutions of the corresponding Bellman equations that satisfy...