The exit path of a Markov chain with rare transitions

Olivier Catoni; Raphaël Cerf

ESAIM: Probability and Statistics (1997)

  • Volume: 1, page 95-144
  • ISSN: 1292-8100

How to cite

top

Catoni, Olivier, and Cerf, Raphaël. "The exit path of a Markov chain with rare transitions." ESAIM: Probability and Statistics 1 (1997): 95-144. <http://eudml.org/doc/104244>.

@article{Catoni1997,
author = {Catoni, Olivier, Cerf, Raphaël},
journal = {ESAIM: Probability and Statistics},
keywords = {Freidlin-Wentzell theory; large deviation principles; Metropolis dynamics; large deviation estimates},
language = {eng},
pages = {95-144},
publisher = {EDP Sciences},
title = {The exit path of a Markov chain with rare transitions},
url = {http://eudml.org/doc/104244},
volume = {1},
year = {1997},
}

TY - JOUR
AU - Catoni, Olivier
AU - Cerf, Raphaël
TI - The exit path of a Markov chain with rare transitions
JO - ESAIM: Probability and Statistics
PY - 1997
PB - EDP Sciences
VL - 1
SP - 95
EP - 144
LA - eng
KW - Freidlin-Wentzell theory; large deviation principles; Metropolis dynamics; large deviation estimates
UR - http://eudml.org/doc/104244
ER -

References

top
  1. ALONSO, L. and CERF, R. ( 1996), The three dimensional polyominoes of minimal area, Electronic Journal of Combinatorics 3 # R27. Zbl0885.05056MR1410882
  2. BEN AROUS, G. and CERF, R. ( 1996), Metastability of the three dimensional Ising model on a torus at very low temperatures, Electronic Journal of Probability 1 1-55. Zbl0888.60057MR1423463
  3. CASSANDRO, M., GALVES, A., OLIVIERI, E. and VARES, M.E. ( 1984), Metastable behaviour of stochastic dynamics: a pathwise approach, Jour. Stat. Phys. 35 nos. 5/6 603-634. Zbl0591.60080MR749840
  4. CATONI, O. ( 1988), Grandes déviations et décroissance de la température dans les algorithmes de recuit, C.R. Acad. Sci. Paris Sér. 1 307 535-538. Zbl0645.60035MR966258
  5. CATONI, O. ( 1990), Large deviations for annealing, PhD Thesis, University Paris XI. 
  6. CATONI, O. ( 1991a), Sharp large deviation estimates for simulated annealing algorithms, Ann. Inst. Henri Poincaré Vol. 27 no. 3 291-383. Zbl0746.60024MR1131838
  7. CATONI, O. ( 1991b), Applications of Sharp Large Deviation Estimates to Optimal Cooling Schedules, Ann. Inst. Henri Poincaré 27 463-518. Zbl0752.60025MR1141244
  8. CATONI, O. ( 1992), Rough large deviation estimates for simulated annealing. Application to exponential schedules, Annals of Probab. 20 1109-1146. Zbl0755.60021MR1175253
  9. CATONI, O. ( 1994), The energy transformation method for the Metropolis algorithm compared with simulated annealing, Probab. Theory and Rel. Fields (to appear). Zbl0897.60078MR1602040
  10. CATONI, O. ( 1995), Algorithmes de recuit simulé et chaînes de Markov à transitions rares. Notes de cours de DEA, English translation: Simulated Annealing Algorithms and Markov Chains with Rare Transitions ( 1996), Université Paris 11, lecture notes, DEA Stochastic Models and Statistics. 
  11. CATONI, O. and COT, C. ( 1996), Rate of Convergence of Generalized Simulated Annealing with Piecewise Constant Triangular Cooling Schedules, preprint Rapport de Recherche du L.M.E.N.S.. 
  12. CERF, R. ( 1993), Asymptotic convergence of genetic algorithms, preprint. MR1642852
  13. CERF, R. ( 1994), Une théorie asymptotique des algorithmes génétiques, PhD Thesis, Université Montpellier II. 
  14. CERF, R. ( 1996a), An asymptotic theory for genetic algorithms, Artificial Evolution, Lecture Notes in Computer Science 1063, Springer-Verlag, 37-53. 
  15. CERF, R. ( 1996b), The dynamics of mutation-selection algorithms with large population sizes, Ann. Inst. Henri Poincaré 32 no. 4 455-508. Zbl0861.60038MR1411269
  16. CERF, R. ( 1996c), A new genetic algorithm, Annals Applied Probab. Vol. 6 no. 3 778-817. Zbl0860.60017MR1410116
  17. CHEN, D., FENG, J. and QIAN, M. ( 1995), The Metastability of Exponentially Perturbed Markov Chains, Chinese Science A 25(6) 590-595. MR1397231
  18. CHIANG, T.S. and CHOW, Y. ( 1989), A Limit Theorem for a Class of Inhomogeneous Markov Processes, Annals of Probab. 17 no 4 1483-1502. Zbl0687.60070MR1048941
  19. CHIANG, T.S. and CHOW, Y. ( 1995), On the Exit Problem from a Cycle of Simulated Annealing Processes, Tech. Rept. Inst. of Math. Academia Sinica. MR1335464
  20. DIACONIS, P. and STROOCK, D. ( 1991), Geometric bounds for eigenvalues of Markov chains, Annals Applied Probab. Vol. 1 no. 1 36-61. Zbl0731.60061MR1097463
  21. DEUSCHEL, J.D. and MAZZA, C. ( 1994), L2 convergence of time nonhomogeneous Markov processes: I. Spectral Estimates, Annals Applied Probab. Vol. 4 no. 4 1012-1056. Zbl0819.60063MR1304771
  22. FREIDLIN, M.I. and WENTZELL, A.D. ( 1984), Random perturbations of dynamical systems, Springer-Verlag, New York. Zbl0522.60055MR722136
  23. GÖTZE, F. ( 1991), Rate of Convergence of Simulated Annealing Processes, preprint. MR1106283
  24. HOLLEY, R. and STROOCK, D.W. ( 1988), Simulated Annealing via Sobolev Inequalities, Commun. Math. Phys. Vol. 115 553-569. Zbl0643.60092MR933455
  25. HOLLEY, R., KUSUOKA, S. and STROOCK, D. ( 1989), Asymptotics of the Spectral Gap with Applications to the Theory of Simulated Annealing, J. Funct. Anal. 83 333-347. Zbl0706.58075MR995752
  26. HWANG, C.R. and SHEU, S.J. ( 1986), Large Time Behaviors of Perturbed Diffusion Markov Processes with Applications III Simulated Annealing, preprint, cited in Chiang and Chow ( 1989). MR854657
  27. HWANG, C.R. and SHEU, S.J. ( 1992), Singular perturbed Markov chains and exact behaviour of simulated annealing processes, J. Theoret. Prob. Vol. 5 no. 2 223-249. Zbl0755.60047MR1157983
  28. KOTECKY, R. and OLIVIERI, E. ( 1993), Droplet dynamics for asymmetric Ising model, Jour. Stat. Phys. 70 nos. 5/6 1121-1148. Zbl1081.82591MR1208633
  29. KOTECKY, R. and OLIVIERI, E. ( 1994), Shapes of growing droplets - a model of escape from a metastable phase, Jour. Stat. Phys. 75 nos 3/4 409-506. Zbl0831.60103MR1279759
  30. MlCLO, L. ( 1991), Evolution de l'énergie libre. Application à l'étude de la convergence des algorithmes de recuit simulé, Thèse, Université Paris XI-Orsay. 
  31. MlCLO, L. ( 1995), Sur les temps d'occupations des processus de Markov finis inhomogènes à basse température, preprint, submitted to Stochastics and Stochastics Reports. Zbl1002.60565
  32. MlCLO, L. ( 1996), Sur les problèmes de sortie discrets inhomogène, Annals Applied Probab. (to appear). Zbl0870.60062MR1422980
  33. NEVES, E.J. and SCHONMANN, R.H. ( 1991), Critical droplets and metastability for a Glauber dynamics at very low temperatures, Commun. Math. Phys. 137 209-230. Zbl0722.60107MR1101685
  34. NEVES, E.J. and SCHONMANN, R.H. ( 1992), Behaviour of droplets for a class of Glauber dynamics at very low temperatures, Prob. Th. Related Fields 91 331-354. Zbl0739.60101MR1151800
  35. OLIVIERI, E. and SCOPPOLA, E. ( 1995), Markov chains with exponentially small transition probabilities: first exit problem from a general domain -I. The reversible case, Journ. Stat. Phys. 79 613-647. Zbl1081.60541MR1327899
  36. OLIVIERI, E. and SCOPPOLA, E. ( 1996), Markov chains with exponentially small transition probabilities: first exit problem from a general domain -II. The general case, Journ. Stat. Phys. (to appear). Zbl1081.60542MR1412076
  37. SCHONMANN, R.H. ( 1992), The pattern of escape from metastability of a stochastic Ising model, Commun. Math. Phys 147 231-240. Zbl0755.60093MR1174411
  38. SCOPPOLA, E. ( 1993), Renormalization group for Markov chains: a general procedure based on renormalization group ideas, Jour. Stat. Phys. 73 nos. 1/2 83-121. Zbl1101.82330MR1247859
  39. TROUVÉ, A. ( 1992), Convergence optimale pour les algorithmes de recuits généralisés. C. R. Acad. Sci. Paris t.315 Série I 1197-1202. Zbl0776.60088MR1194517
  40. TROUVÉ, A. (january 1993), Parallélisation massive du recuit simulé, PhD Thesis, University Paris XI. 
  41. TROUVÉ A. ( 1996a), Cycle decompositions and simulated annealing, SIAM J. Control Optimization 34 no. 3 966-986. Zbl0852.60031MR1384962
  42. TROUVÉ, A. ( 1996b), Rough large deviation estimates for the optimal convergence speed exponent of generalized simulated annealing algorithms, Ann. Inst. Henri Poincaré 32 no. 3 299-348. Zbl0853.60029MR1387393
  43. TSITSIKLIS, J.N. ( 1989), Markov Chains with Rare Transitions and Simulated Annealing, Math. Oper. Res. 14 70-90. Zbl0664.60067MR984559

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.