Displaying similar documents to “Infinite horizon discrete time control problems for bounded processes.”

Potentials of a Markov process are expected suprema

Hans Föllmer, Thomas Knispel (2007)

ESAIM: Probability and Statistics

Similarity:

Expected suprema of a function  observed along the paths of a nice Markov process define an excessive function, and in fact a potential if  vanishes at the boundary. Conversely, we show under mild regularity conditions that any potential admits a representation in terms of expected suprema. Moreover, we identify the maximal and the minimal representing function in terms of probabilistic potential theory. Our results are motivated by the work of El Karoui and Meziou (2006) on the max-plus...

A note on the optimal portfolio problem in discrete processes

Naoyuki Ishimura, Yuji Mita (2009)

Kybernetika

Similarity:

We deal with the optimal portfolio problem in discrete-time setting. Employing the discrete Itô formula, which is developed by Fujita, we establish the discrete Hamilton–Jacobi–Bellman (d-HJB) equation for the value function. Simple examples of the d-HJB equation are also discussed.