Busy period analysis, rare events and transient behavior in fluid flow models.
On étend aux martingales bi-browniennes la formule de Itô et les inégalités de Burkholder-Gundy. On en déduit une démonstration probabiliste des inégalités de norme géométriques pour les fonctions bi-harmoniques sur le bi-disque.
In this article we present a generalization of Markov Decision Processes with discreet time where the immediate rewards in every period are not deterministic but random, with the two first moments of the distribution given.Formulas are developed to calculate the expected value and the variance of the reward of the process, formulas which generalize and partially correct other results. We make some observations about the distribution of rewards for processes with limited or unlimited horizon and...
If a regenerative process is represented as semi-regenerative, we derive formulae enabling us to calculate basic characteristics associated with the first occurrence time starting from corresponding characteristics for the semi-regenerative process. Recursive equations, integral equations, and Monte-Carlo algorithms are proposed for practical solving of the problem.