Occupation laws for some time-nonhomogeneous Markov chains.
On a bound on algebraic connectivity: the case of equality
In a recent paper the authors proposed a lower bound on , where , , is an eigenvalue of a transition matrix of an ergodic Markov chain. The bound, which involved the group inverse of , was derived from a more general bound, due to Bauer, Deutsch, and Stoer, on the eigenvalues of a stochastic matrix other than its constant row sum. Here we adapt the bound to give a lower bound on the algebraic connectivity of an undirected graph, but principally consider the case of equality in the bound when...
On a class of linear models.
This paper is concerned with classification criteria, asymptotic behaviour and stationarity of a non-Markovian model with linear transition rule, called a linear OM-chain. This problems are solved by making use of the structure of the stochastic matrix appearing in the definition of such a model. The model studied includes as special cases the Markovian model as well as the linear learning model, and has applications in psychological and biological research, in control theory, and in adaptation...
On a direct method for the solution of nearly uncoupled Markov chains.
On a gambler's ruin problem
On a stochastic inventory model with deteriorating items.
On absorption times and Dirichlet eigenvalues
This paper gives a stochastic representation in spectral terms for the absorption time T of a finite Markov chain which is irreducible and reversible outside the absorbing point. This yields quantitative informations on the parameters of a similar representation due to O'Cinneide for general chains admitting real eigenvalues. In the discrete time setting, if the underlying Dirichlet eigenvalues (namely the eigenvalues of the Markov transition operator restricted to the functions vanishing on...
On convergence of homogeneous Markov chains
Let be a vector of absolute distributions of probabilities in an irreducible aperiodic homogeneous Markov chain with a finite state space. Professor Alladi Ramakrishnan conjectured the following strict inequality for norms of differences . In the paper, a necessary and sufficient condition for the validity of this inequality is proved, which may be useful in investigating the character of convergence of distributions in Markov chains.
On ergodicity coefficients of infinite stochastic matrices.
On infinite horizon active fault diagnosis for a class of non-linear non-Gaussian systems
The paper considers the problem of active fault diagnosis for discrete-time stochastic systems over an infinite time horizon. It is assumed that the switching between a fault-free and finitely many faulty conditions can be modelled by a finite-state Markov chain and the continuous dynamics of the observed system can be described for the fault-free and each faulty condition by non-linear non-Gaussian models with a fully observed continuous state. The design of an optimal active fault detector that...
On Nonuniform Gaussian Approximation for Random Summation.
On random evolutions induced by countable state space Markov chains
On randomly colouring locally sparse graphs.
On self-optimizing control of Markov processes
On some properties of the Lüroth-type alternating series representations for real numbers.
On Strassen's theorem on stochastic domination.
On strong ergodicity of inhomogeneous products of finite stochastic matrices
On the asymptotic events of a Markov chain.
On the central limit theorem for some birth and death processes
Suppose that {Xn, n ≥ 0} is a stationary Markov chain and V is a certain function on a phase space of the chain, called an observable. We say that the observable satisfies the central limit theorem (CLT) if [...] [...] converge in law to a normal random variable, as N → +∞. For a stationary Markov chain with the L2 spectral gap the theorem holds for all V such that V (X0) is centered and square integrable, see Gordin [7]. The purpose of this article is to characterize a family of observables V for...
On the Chung-Diaconis-Graham random process.