Displaying 41 – 60 of 106

Showing per page

Intertwining of birth-and-death processes

Jan M. Swart (2011)

Kybernetika

It has been known for a long time that for birth-and-death processes started in zero the first passage time of a given level is distributed as a sum of independent exponentially distributed random variables, the parameters of which are the negatives of the eigenvalues of the stopped process. Recently, Diaconis and Miclo have given a probabilistic proof of this fact by constructing a coupling between a general birth-and-death process and a process whose birth rates are the negatives of the eigenvalues,...

Intertwining of the Wright-Fisher diffusion

Tobiáš Hudec (2017)

Kybernetika

It is known that the time until a birth and death process reaches a certain level is distributed as a sum of independent exponential random variables. Diaconis, Miclo and Swart gave a probabilistic proof of this fact by coupling the birth and death process with a pure birth process such that the two processes reach the given level at the same time. Their coupling is of a special type called intertwining of Markov processes. We apply this technique to couple the Wright-Fisher diffusion with reflection...

Limit shapes of Gibbs distributions on the set of integer partitions : the expansive case

Michael M. Erlihson, Boris L. Granovsky (2008)

Annales de l'I.H.P. Probabilités et statistiques

We find limit shapes for a family of multiplicative measures on the set of partitions, induced by exponential generating functions with expansive parameters, ak∼Ckp−1, k→∞, p>0, where C is a positive constant. The measures considered are associated with the generalized Maxwell–Boltzmann models in statistical mechanics, reversible coagulation–fragmentation processes and combinatorial structures, known as assemblies. We prove a central limit theorem for fluctuations of a properly scaled partition...

Markoff-Ketten bei sich füllenden Löchern im Zustandsraum

Hermann Rost (1971)

Annales de l'institut Fourier

Given a substochastic kernel P from a measurable space ( E , β ) into itself one considers for a pair ( μ , ν ) of finite measures on β the following sequences: μ 0 = ( μ - ν ) + , ν 0 = ( μ - ν ) - ; μ n + 1 ...

Markov chain comparison.

Dyer, Martin, Goldberg, Leslie Ann, Jerrum, Mark, Martin, Russell (2006)

Probability Surveys [electronic only]

Mean-variance optimality for semi-Markov decision processes under first passage criteria

Xiangxiang Huang, Yonghui Huang (2017)

Kybernetika

This paper deals with a first passage mean-variance problem for semi-Markov decision processes in Borel spaces. The goal is to minimize the variance of a total discounted reward up to the system's first entry to some target set, where the optimization is over a class of policies with a prescribed expected first passage reward. The reward rates are assumed to be possibly unbounded, while the discount factor may vary with states of the system and controls. We first develop some suitable conditions...

Molecular motors and stochastic networks

Reinhard Lipowsky, Steffen Liepelt (2008)

Banach Center Publications

Molecular motors are nano- or colloidal machines that keep the living cell in a highly ordered, stationary state far from equilibrium. This self-organized order is sustained by the energy transduction of the motors, which couple exergonic or 'downhill' processes to endergonic or 'uphill' processes. A particularly interesting case is provided by the chemomechanical coupling of cytoskeletal motors which use the chemical energy released during ATP hydrolysis in order to generate mechanical forces and...

Monotonicity and comparison results for nonnegative dynamic systems. Part II: Continuous-time case

Nico M. van Dijk, Karel Sladký (2006)

Kybernetika

This second Part II, which follows a first Part I for the discrete-time case (see [DijkSl1]), deals with monotonicity and comparison results, as generalization of the pure stochastic case, for stochastic dynamic systems with arbitrary nonnegative generators in the continuous-time case. In contrast with the discrete-time case the generalization is no longer straightforward. A discrete-time transformation will therefore be developed first. Next, results from Part I can be adopted. The conditions,...

Monotonicity and comparison results for nonnegative dynamic systems. Part I: Discrete-time case

Nico M. van Dijk, Karel Sladký (2006)

Kybernetika

In two subsequent parts, Part I and II, monotonicity and comparison results will be studied, as generalization of the pure stochastic case, for arbitrary dynamic systems governed by nonnegative matrices. Part I covers the discrete-time and Part II the continuous-time case. The research has initially been motivated by a reliability application contained in Part II. In the present Part I it is shown that monotonicity and comparison results, as known for Markov chains, do carry over rather smoothly...

Non-fragile sampled data H filtering of general continuous Markov jump linear systems

Mouquan Shen, Guangming Zhang, Yuhao Yuan, Lei Mei (2014)

Kybernetika

This paper is concerned with the non-fragile sampled data H filtering problem for continuous Markov jump linear system with partly known transition probabilities (TPs). The filter gain is assumed to have additive variations and TPs are assumed to be known, uncertain with known bounds and completely unknown. The aim is to design a non-fragile H filter to ensure both the robust stochastic stability and a prescribed level of H performance for the filtering error dynamics. Sufficient conditions for...

Nonlinear Markov processes in big networks

Quan-Lin Li (2016)

Special Matrices

Big networks express multiple classes of large-scale networks in many practical areas such as computer networks, internet of things, cloud computation, manufacturing systems, transportation networks, and healthcare systems. This paper analyzes such big networks, and applies the mean-field theory and the nonlinear Markov processes to constructing a broad class of nonlinear continuous-time block-structured Markov processes, which can be used to deal with many practical stochastic systems. Firstly,...

Currently displaying 41 – 60 of 106