Displaying 441 – 460 of 2837

Showing per page

Calculating the variance in Markov-processes with random reward.

Francisco Benito (1982)

Trabajos de Estadística e Investigación Operativa

In this article we present a generalization of Markov Decision Processes with discreet time where the immediate rewards in every period are not deterministic but random, with the two first moments of the distribution given.Formulas are developed to calculate the expected value and the variance of the reward of the process, formulas which generalize and partially correct other results. We make some observations about the distribution of rewards for processes with limited or unlimited horizon and...

Central limit theorem for hitting times of functionals of Markov jump processes

Christian Paroissin, Bernard Ycart (2004)

ESAIM: Probability and Statistics

A sample of i.i.d. continuous time Markov chains being defined, the sum over each component of a real function of the state is considered. For this functional, a central limit theorem for the first hitting time of a prescribed level is proved. The result extends the classical central limit theorem for order statistics. Various reliability models are presented as examples of applications.

Central limit theorem for hitting times of functionals of Markov jump processes

Christian Paroissin, Bernard Ycart (2010)

ESAIM: Probability and Statistics

A sample of i.i.d. continuous time Markov chains being defined, the sum over each component of a real function of the state is considered. For this functional, a central limit theorem for the first hitting time of a prescribed level is proved. The result extends the classical central limit theorem for order statistics. Various reliability models are presented as examples of applications.

Central limit theorems for the brownian motion on large unitary groups

Florent Benaych-Georges (2011)

Bulletin de la Société Mathématique de France

In this paper, we are concerned with the large n limit of the distributions of linear combinations of the entries of a Brownian motion on the group of n × n unitary matrices. We prove that the process of such a linear combination converges to a Gaussian one. Various scales of time and various initial distributions are considered, giving rise to various limit processes, related to the geometric construction of the unitary Brownian motion. As an application, we propose a very short proof of the asymptotic...

Changing the branching mechanism of a continuous state branching process using immigration

Romain Abraham, Jean-François Delmas (2009)

Annales de l'I.H.P. Probabilités et statistiques

We consider an initial population whose size evolves according to a continuous state branching process. Then we add to this process an immigration (with the same branching mechanism as the initial population), in such a way that the immigration rate is proportional to the whole population size. We prove this continuous state branching process with immigration proportional to its own size is itself a continuous state branching process. By considering the immigration as the apparition of a new type,...

Currently displaying 441 – 460 of 2837