Displaying similar documents to “Optimal stopping and impulsive control of one-dimensional diffusion processes”

A note on impulsive control of Feller processes with costly information

Dariusz Gątarek (1990)

Aplikace matematiky

Similarity:

The paper deals with the optimal inspections and maintenance problem with costly information for a Markov process with positive discount factor. The associated dynamic programming equation is a quasi-variational inequality with first order differential terms. In this paper we study its different formulations: strong, visousity and evolutionary. The case of impulsive control of purely jump Markov processes is studied as a special case.

Adaptive control for discrete-time Markov processes with unbounded costs: Discounted criterion

Evgueni I. Gordienko, J. Adolfo Minjárez-Sosa (1998)

Kybernetika

Similarity:

We study the adaptive control problem for discrete-time Markov control processes with Borel state and action spaces and possibly unbounded one-stage costs. The processes are given by recurrent equations x t + 1 = F ( x t , a t , ξ t ) , t = 0 , 1 , ... with i.i.d. ℜ k -valued random vectors ξ t whose density ρ is unknown. Assuming observability of ξ t we propose the procedure of statistical estimation of ρ that allows us to prove discounted asymptotic optimality of two types of adaptive policies used early for the processes with bounded...