Displaying similar documents to “On some method for diagnosing convergence in MCMC setups via atoms and renewal sets”

Calculating the variance in Markov-processes with random reward.

Francisco Benito (1982)

Trabajos de Estadística e Investigación Operativa

Similarity:

In this article we present a generalization of Markov Decision Processes with discreet time where the immediate rewards in every period are not deterministic but random, with the two first moments of the distribution given. Formulas are developed to calculate the expected value and the variance of the reward of the process, formulas which generalize and partially correct other results. We make some observations about the distribution of rewards for processes with limited...

Bounds on regeneration times and limit theorems for subgeometric Markov chains

Randal Douc, Arnaud Guillin, Eric Moulines (2008)

Annales de l'I.H.P. Probabilités et statistiques

Similarity:

This paper studies limit theorems for Markov chains with general state space under conditions which imply subgeometric ergodicity. We obtain a central limit theorem and moderate deviation principles for additive not necessarily bounded functional of the Markov chains under drift and minorization conditions which are weaker than the Foster–Lyapunov conditions. The regeneration-split chain method and a precise control of the modulated moment of the hitting time to small sets are employed...

Solutions of Analytical Systems of Partial Differential Equations

Trenčevski, K. (1995)

Serdica Mathematical Journal

Similarity:

In this paper are examined some classes of linear and non-linear analytical systems of partial differential equations. Compatibility conditions are found and if they are satisfied, the solutions are given as functional series in a neighborhood of a given point (x = 0).