Dynamic Programming: an overview
Dynamic programming as optimal path problem in weighted digraphs.
Dynamic programming for an investment/consumption problem in illiquid markets with regime-switching
We consider an illiquid financial market with different regimes modeled by a continuous time finite-state Markov chain. The investor can trade a stock only at the discrete arrival times of a Cox process with intensity depending on the market regime. Moreover, the risky asset price is subject to liquidity shocks, which change its rate of return and volatility, and induce jumps on its dynamics. In this setting, we study the problem of an economic agent optimizing her expected utility from consumption...
Dynamic programming for stochastic target problems and geometric flows
Dynamic programming for the stochastic Navier-Stokes equations
Dynamic Programming for the stochastic Navier-Stokes equations
We solve an optimal cost problem for a stochastic Navier-Stokes equation in space dimension 2 by proving existence and uniqueness of a smooth solution of the corresponding Hamilton-Jacobi-Bellman equation.
Dynamic programming in constrained Markov decision processes
Dynamic programming principle for stochastic recursive optimal control problem with delayed systems
In this paper, we study one kind of stochastic recursive optimal control problem for the systems described by stochastic differential equations with delay (SDDE). In our framework, not only the dynamics of the systems but also the recursive utility depend on the past path segment of the state process in a general form. We give the dynamic programming principle for this kind of optimal control problems and show that the value function is the viscosity solution of the corresponding infinite dimensional...