On absorption times and Dirichlet eigenvalues

Laurent Miclo

ESAIM: Probability and Statistics (2010)

  • Volume: 14, page 117-150
  • ISSN: 1292-8100

Abstract

top
This paper gives a stochastic representation in spectral terms for the absorption time T of a finite Markov chain which is irreducible and reversible outside the absorbing point. This yields quantitative informations on the parameters of a similar representation due to O'Cinneide for general chains admitting real eigenvalues. In the discrete time setting, if the underlying Dirichlet eigenvalues (namely the eigenvalues of the Markov transition operator restricted to the functions vanishing on the absorbing point) are nonnegative, we show that T is distributed as a mixture of sums of independent geometric laws whose parameters are successive Dirichlet eigenvalues (starting from the smallest one). The mixture weights depend on the starting law. This result leads to a probabilistic interpretation of the spectrum, in terms of strong random times and local equilibria through a simple intertwining relation. Next this study is extended to the continuous time framework, where geometric laws have to be replaced by exponential distributions having the (opposite) Dirichlet eigenvalues of the generator as parameters. Returning to the discrete time setting we consider the influence of negative eigenvalues which are given another probabilistic meaning. These results generalize results of Karlin and McGregor and Keilson for birth and death chains.

How to cite

top

Miclo, Laurent. "On absorption times and Dirichlet eigenvalues." ESAIM: Probability and Statistics 14 (2010): 117-150. <http://eudml.org/doc/250816>.

@article{Miclo2010,
abstract = { This paper gives a stochastic representation in spectral terms for the absorption time T of a finite Markov chain which is irreducible and reversible outside the absorbing point. This yields quantitative informations on the parameters of a similar representation due to O'Cinneide for general chains admitting real eigenvalues. In the discrete time setting, if the underlying Dirichlet eigenvalues (namely the eigenvalues of the Markov transition operator restricted to the functions vanishing on the absorbing point) are nonnegative, we show that T is distributed as a mixture of sums of independent geometric laws whose parameters are successive Dirichlet eigenvalues (starting from the smallest one). The mixture weights depend on the starting law. This result leads to a probabilistic interpretation of the spectrum, in terms of strong random times and local equilibria through a simple intertwining relation. Next this study is extended to the continuous time framework, where geometric laws have to be replaced by exponential distributions having the (opposite) Dirichlet eigenvalues of the generator as parameters. Returning to the discrete time setting we consider the influence of negative eigenvalues which are given another probabilistic meaning. These results generalize results of Karlin and McGregor and Keilson for birth and death chains. },
author = {Miclo, Laurent},
journal = {ESAIM: Probability and Statistics},
keywords = {Irreducible and reversible subMarkovian matrices; exit or absorption times; Dirichlet eigenvalues; mixtures; geometric laws; exponential distributions; strong random times; local equilibria; intertwining; birth and death chains and processes; irreducible reversible finite Markov chains; Dirichlet eigenvalues; strong random times},
language = {eng},
month = {5},
pages = {117-150},
publisher = {EDP Sciences},
title = {On absorption times and Dirichlet eigenvalues},
url = {http://eudml.org/doc/250816},
volume = {14},
year = {2010},
}

TY - JOUR
AU - Miclo, Laurent
TI - On absorption times and Dirichlet eigenvalues
JO - ESAIM: Probability and Statistics
DA - 2010/5//
PB - EDP Sciences
VL - 14
SP - 117
EP - 150
AB - This paper gives a stochastic representation in spectral terms for the absorption time T of a finite Markov chain which is irreducible and reversible outside the absorbing point. This yields quantitative informations on the parameters of a similar representation due to O'Cinneide for general chains admitting real eigenvalues. In the discrete time setting, if the underlying Dirichlet eigenvalues (namely the eigenvalues of the Markov transition operator restricted to the functions vanishing on the absorbing point) are nonnegative, we show that T is distributed as a mixture of sums of independent geometric laws whose parameters are successive Dirichlet eigenvalues (starting from the smallest one). The mixture weights depend on the starting law. This result leads to a probabilistic interpretation of the spectrum, in terms of strong random times and local equilibria through a simple intertwining relation. Next this study is extended to the continuous time framework, where geometric laws have to be replaced by exponential distributions having the (opposite) Dirichlet eigenvalues of the generator as parameters. Returning to the discrete time setting we consider the influence of negative eigenvalues which are given another probabilistic meaning. These results generalize results of Karlin and McGregor and Keilson for birth and death chains.
LA - eng
KW - Irreducible and reversible subMarkovian matrices; exit or absorption times; Dirichlet eigenvalues; mixtures; geometric laws; exponential distributions; strong random times; local equilibria; intertwining; birth and death chains and processes; irreducible reversible finite Markov chains; Dirichlet eigenvalues; strong random times
UR - http://eudml.org/doc/250816
ER -

References

top
  1. D. Aldous and P. Diaconis, Strong uniform times and finite random walks. Adv. Appl. Math.8 (1987) 69–97.  
  2. D. Aldous and J. Fill, Reversible Markov chains and random walks on graphs. Monograph in preparation, available on the web site: ∼aldous/RWG/book.html (1994-2002).  URIhttp://www.stat.berkeley.edu/
  3. R.F. Botta, C.M. Harris and W.G. Marchal, Characterizations of generalized hyperexponential distribution functions. Commun. Statist. Stoch. Models3 (1987) 115–148.  
  4. C. Commault and S. Mocanu, Phase-type distributions and representations: some results and open problems for system theory. Int. J. Control76 (2003) 566–580.  
  5. P. Diaconis and J.A. Fill, Strong stationary times via a new form of duality. Ann. Probab.18 (1990) 1483–1522.  
  6. P. Diaconis and L. Miclo, On times to quasi-stationarity for birth and death processes. J. Theoret. Probab.22 (2009) 558–586.  
  7. P. Diaconis and L. Saloff-Coste, Separation cut-offs for birth and death chains. Ann. Appl. Probab.16 (2006) 2098–2122.  
  8. J. Ding, E. Lubetzky and Y. Peres, Total variation cutoff in birth-and-death chains. Probab. Theory Relat. Fields146 (2010) 61–85.  
  9. P.D. Egleston, T.D. Lenker and S.K. Narayan, The nonnegative inverse eigenvalue problem. Linear Algebra Appl.379 (2004) 475–490.  
  10. J.A. Fill, Strong stationary duality for continuous-time Markov chains, Part I: Theory. J. Theoret. Probab.5 (1992) 45–70.  
  11. J.A. Fill, The passage time distribution for a birth-and-death chain: Strong stationary duality gives a first stochastic proof. J. Theoret. Probab.22 (2009) 543–557.  
  12. J.A. Fill, On hitting times and fastest strong stationary times for skip-free processes. J. Theoret. Probab.22 (2009) 587–600.  
  13. Qi-Ming He and Hanqin Zhang, Spectral polynomial algorithms for computing bi-diagonal representations for phase type distributions and matrix-exponential distributions. Stoch. Models22 (2006) 289–317.  
  14. Qi-Ming He and Hanqin Zhang, PH-invariant polytopes and Coxian representations of phase type distributions. Stoch. Models22 (2006) 383–409.  
  15. S. Karlin and J. McGregor, Coincidence properties of birth and death processes. Pacific J. Math.9 (1959) 1109–1140.  
  16. T. Kato, Perturbation theory for linear operators. Classics in Mathematics. Springer-Verlag, Berlin (1995). Reprint of the 1980 edition.  
  17. J. Keilson, Log-concavity and log-convexity in passage time densities of diffusion and birth-death processes. J. Appl. Probab.8 (1971) 391–398.  
  18. J.T. Kent, Eigenvalue expansions for diffusion hitting times, Z. Wahrsch. Verw. Gebiete52 (1980) 309–319.  
  19. J.T. Kent, The spectral decomposition of a diffusion hitting time. Ann. Probab.10 (1982) 207–219.  
  20. J.T. Kent, The appearance of a multivariate exponential distribution in sojourn times for birth-death and diffusion processes. In Probability, statistics and analysis. London Math. Soc. Lect. Note Ser.79. Cambridge Univ. Press, Cambridge (1983) 161–179.  
  21. C.A. Micchelli and R.A. Willoughby, On functions which preserve the class of Stieltjes matrices. Linear Algebra Appl.23 (1979) 141–156.  
  22. M.F. Neuts, Matrix-geometric solutions in stochastic models, Johns Hopkins Series in the Mathematical Sciences: An algorithmic approach, Vol. 2. Johns Hopkins University Press, Baltimore, MD (1981).  
  23. C.A. O'Cinneide, Characterization of phase-type distributions. Commun. Statist. Stoch. Models6 (1990) 1–57.  
  24. C.A. O'Cinneide, Phase-type distributions and invariant polytopes. Adv. Appl. Probab.23 (1991) 515–535.  
  25. C.A. O'Cinneide, Phase-type distributions: open problems and a few properties. Commun. Statist. Stoch. Models15 (1999) 731–757.  

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

                
Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.