Calcul des variations sur un brownien subordonné
In this paper we study finite state conditional Markov chains (CMCs). We give two examples of CMCs, one which admits intensity, and another one, which does not admit an intensity. We also give a sufficient condition under which a doubly stochastic Markov chain is a CMC. In addition we provide a method for construction of conditional Markov chains via change of measure.
Motivated by the recent development in the theory of jump processes, we investigate its conservation property. We will show that a jump process is conservative under certain conditions for the volume-growth of the underlying space and the jump rate of the process. We will also present examples of jump processes which satisfy these conditions.
The continuity of the solutions of difference and algebraic coupled Riccati equations for the discrete-time Markovian jump linear quadratic control problem as a function of coefficients is verified. The line of reasoning goes through the use of the minimum property formulated analogously to the one for coupled continuous Riccati equations presented by Wonham and a set of comparison theorems.