Cadenas de Markov en poblaciones aleatorias y probabilidades en cadena generalizadas.
In this article we present a generalization of Markov Decision Processes with discreet time where the immediate rewards in every period are not deterministic but random, with the two first moments of the distribution given.Formulas are developed to calculate the expected value and the variance of the reward of the process, formulas which generalize and partially correct other results. We make some observations about the distribution of rewards for processes with limited or unlimited horizon and...
In this paper we obtain a representation of semimartingalas in the plane by means of stochastic integrals. Some applications to the study of random Markov gaussian fields are given.
We study the question of the law of large numbers and central limit theorem for an additive functional of a Markov processes taking values in a Polish space that has Feller property under the assumption that the process is asymptotically contractive in the Wasserstein metric.
A sample of i.i.d. continuous time Markov chains being defined, the sum over each component of a real function of the state is considered. For this functional, a central limit theorem for the first hitting time of a prescribed level is proved. The result extends the classical central limit theorem for order statistics. Various reliability models are presented as examples of applications.
A sample of i.i.d. continuous time Markov chains being defined, the sum over each component of a real function of the state is considered. For this functional, a central limit theorem for the first hitting time of a prescribed level is proved. The result extends the classical central limit theorem for order statistics. Various reliability models are presented as examples of applications.