On the cover time of planar graphs.
On the discrete time-varying JLQG problem
In the present paper optimal time-invariant state feedback controllers are designed for a class of discrete time-varying control systems with Markov jumping parameter and quadratic performance index. We assume that the coefficients have limits as time tends to infinity and the boundary system is absolutely observable and stabilizable. Moreover, following the same line of reasoning, an adaptive controller is proposed in the case when system parameters are unknown but their strongly consistent estimators...
On the distribution of waiting time until k-th repetition of any event.
On the exchanges between Wolfgang Doeblin and Bohuslav Hostinský
We present the letters sent by Wolfgang Doeblin to Bohuslav Hostinský between 1936 and 1938. They concern some aspects of the general theory of Markov chains and the solutions of the Chapman-Kolmogorov equation that Doeblin was then establishing for his PhD thesis.
On the fundamental matrix of finite state Markov chains, its eigensystem and its relation to hitting times.
On the invariant measure of the random difference equation Xn = AnXn−1 + Bn in the critical case
We consider the autoregressive model on ℝd defined by the stochastic recursion Xn = AnXn−1 + Bn, where {(Bn, An)} are i.i.d. random variables valued in ℝd× ℝ+. The critical case, when , was studied by Babillot, Bougerol and Elie, who proved that there exists a unique invariant Radon measureν for the Markov chain {Xn}. In the present paper we prove that the weak limit of properly dilated measure ν exists and defines a homogeneous measure on ℝd ∖ {0}.
On the moments of hitting times for random walks on trees.
On the number of collisions in lambda-coalescents.
On the perturbation of Markov chains with nearly transient states.
On the set of optimal controls for Markov chains with rewards
On the space of Markov chain's finite projections.
On the spectral analysis of second-order Markov chains
Second order Markov chains which are trajectorially reversible are considered. Contrary to the reversibility notion for usual Markov chains, no symmetry property can be deduced for the corresponding transition operators. Nevertheless and even if they are not diagonalizable in general, we study some features of their spectral decompositions and in particular the behavior of the spectral gap under appropriate perturbations is investigated. Our quantitative and qualitative results confirm that the...
On the variance in controlled Markov chains
On variance conditions for Markov chain CLTs.
One-dimensional finite range random walk in random medium and invariant measure equation
We consider a model of random walks on ℤ with finite range in a stationary and ergodic random environment. We first provide a fine analysis of the geometrical properties of the central left and right Lyapunov eigenvectors of the random matrix naturally associated with the random walk, highlighting the mechanism of the model. This allows us to formulate a criterion for the existence of the absolutely continuous invariant measure for the environments seen from the particle. We then deduce a characterization...
One-Step Prediction for P...-Weakly Stationary Processes.
Optimal stopping for Markov Processes
In questa nota presentiamo dei nuovi risultati sul problema di tempo d’arresto ottimale per processi di Markov con tempo discreto.
Optimal stopping of a sequence of maxima over an unobservable sequence of maxima
Order properties of the space of finitely additive transition functions.