Semi-group methods in stochastic control
Stochastic evolution equations on Hilbert spaces with partially observed relaxed controls and their necessary conditions of optimality
In this paper we consider the question of optimal control for a class of stochastic evolution equations on infinite dimensional Hilbert spaces with controls appearing in both the drift and the diffusion operators. We consider relaxed controls (measure valued random processes) and briefly present some results on the question of existence of mild solutions including their regularity followed by a result on existence of partially observed optimal relaxed controls. Then we develop the necessary conditions...
Strong average optimality criterion for continuous-time Markov decision processes
This paper deals with continuous-time Markov decision processes with the unbounded transition rates under the strong average cost criterion. The state and action spaces are Borel spaces, and the costs are allowed to be unbounded from above and from below. Under mild conditions, we first prove that the finite-horizon optimal value function is a solution to the optimality equation for the case of uncountable state spaces and unbounded transition rates, and that there exists an optimal deterministic...
Suboptimality Of Stochastic Systems: Structural Uncertainties And Information Constraints