Asymptotic behavior of second-order dissipative evolution equations combining potential with non-potential effects

Hedy Attouch; Paul-Émile Maingé

ESAIM: Control, Optimisation and Calculus of Variations (2011)

  • Volume: 17, Issue: 3, page 836-857
  • ISSN: 1292-8119

Abstract

top
In the setting of a real Hilbert space ℋ , we investigate the asymptotic behavior, as time t goes to infinity, of trajectories of second-order evolution equations            ü(t) + γ u ˙ (t) + ∇ϕ(u(t)) + A(u(t)) = 0, where ∇ϕ is the gradient operator of a convex differentiable potential function ϕ: ℋ → ℝ ,A: ℋ → ℋ is a maximal monotone operator which is assumed to beλ-cocoercive, and γ > 0 is a damping parameter. Potential and non-potential effects are associated respectively to ∇ϕ and A. Under condition λγ2 > 1, it is proved that each trajectory asymptotically weakly converges to a zero of ∇ϕ + A. This condition, which only involves the non-potential operator and the damping parameter, is sharp and consistent with time rescaling. Passing from weak to strong convergence of the trajectories is obtained by introducing an asymptotically vanishing Tikhonov-like regularizing term. As special cases, we recover the asymptotic analysis of the heavy ball with friction dynamic attached to a convex potential, the second-order gradient-projection dynamic, and the second-order dynamic governed by the Yosida approximation of a general maximal monotone operator. The breadth and flexibility of the proposed framework is illustrated through applications in the areas of constrained optimization, dynamical approach to Nash equilibria for noncooperative games, and asymptotic stabilization in the case of a continuum of equilibria.

How to cite

top

Attouch, Hedy, and Maingé, Paul-Émile. "Asymptotic behavior of second-order dissipative evolution equations combining potential with non-potential effects." ESAIM: Control, Optimisation and Calculus of Variations 17.3 (2011): 836-857. <http://eudml.org/doc/272864>.

@article{Attouch2011,
abstract = {In the setting of a real Hilbert space $\{\mathcal \{H\}\}$, we investigate the asymptotic behavior, as time t goes to infinity, of trajectories of second-order evolution equations            ü(t) + γ$\dot\{u\}$(t) + ∇ϕ(u(t)) + A(u(t)) = 0, where ∇ϕ is the gradient operator of a convex differentiable potential function ϕ: $\{\mathcal \{H\}\}\rightarrow \mathbb \{R\}$,A: $\{\mathcal \{H\}\}\rightarrow \{\mathcal \{H\}\}$ is a maximal monotone operator which is assumed to beλ-cocoercive, and γ &gt; 0 is a damping parameter. Potential and non-potential effects are associated respectively to ∇ϕ and A. Under condition λγ2 &gt; 1, it is proved that each trajectory asymptotically weakly converges to a zero of ∇ϕ + A. This condition, which only involves the non-potential operator and the damping parameter, is sharp and consistent with time rescaling. Passing from weak to strong convergence of the trajectories is obtained by introducing an asymptotically vanishing Tikhonov-like regularizing term. As special cases, we recover the asymptotic analysis of the heavy ball with friction dynamic attached to a convex potential, the second-order gradient-projection dynamic, and the second-order dynamic governed by the Yosida approximation of a general maximal monotone operator. The breadth and flexibility of the proposed framework is illustrated through applications in the areas of constrained optimization, dynamical approach to Nash equilibria for noncooperative games, and asymptotic stabilization in the case of a continuum of equilibria.},
author = {Attouch, Hedy, Maingé, Paul-Émile},
journal = {ESAIM: Control, Optimisation and Calculus of Variations},
keywords = {second-order evolution equations; asymptotic behavior; dissipative systems; maximal monotone operators; potential and non-potential operators; cocoercive operators; Tikhonov regularization; heavy ball with friction dynamical system; constrained optimization; coupled systems; dynamical games; Nash equilibria; coercive operators},
language = {eng},
number = {3},
pages = {836-857},
publisher = {EDP-Sciences},
title = {Asymptotic behavior of second-order dissipative evolution equations combining potential with non-potential effects},
url = {http://eudml.org/doc/272864},
volume = {17},
year = {2011},
}

TY - JOUR
AU - Attouch, Hedy
AU - Maingé, Paul-Émile
TI - Asymptotic behavior of second-order dissipative evolution equations combining potential with non-potential effects
JO - ESAIM: Control, Optimisation and Calculus of Variations
PY - 2011
PB - EDP-Sciences
VL - 17
IS - 3
SP - 836
EP - 857
AB - In the setting of a real Hilbert space ${\mathcal {H}}$, we investigate the asymptotic behavior, as time t goes to infinity, of trajectories of second-order evolution equations            ü(t) + γ$\dot{u}$(t) + ∇ϕ(u(t)) + A(u(t)) = 0, where ∇ϕ is the gradient operator of a convex differentiable potential function ϕ: ${\mathcal {H}}\rightarrow \mathbb {R}$,A: ${\mathcal {H}}\rightarrow {\mathcal {H}}$ is a maximal monotone operator which is assumed to beλ-cocoercive, and γ &gt; 0 is a damping parameter. Potential and non-potential effects are associated respectively to ∇ϕ and A. Under condition λγ2 &gt; 1, it is proved that each trajectory asymptotically weakly converges to a zero of ∇ϕ + A. This condition, which only involves the non-potential operator and the damping parameter, is sharp and consistent with time rescaling. Passing from weak to strong convergence of the trajectories is obtained by introducing an asymptotically vanishing Tikhonov-like regularizing term. As special cases, we recover the asymptotic analysis of the heavy ball with friction dynamic attached to a convex potential, the second-order gradient-projection dynamic, and the second-order dynamic governed by the Yosida approximation of a general maximal monotone operator. The breadth and flexibility of the proposed framework is illustrated through applications in the areas of constrained optimization, dynamical approach to Nash equilibria for noncooperative games, and asymptotic stabilization in the case of a continuum of equilibria.
LA - eng
KW - second-order evolution equations; asymptotic behavior; dissipative systems; maximal monotone operators; potential and non-potential operators; cocoercive operators; Tikhonov regularization; heavy ball with friction dynamical system; constrained optimization; coupled systems; dynamical games; Nash equilibria; coercive operators
UR - http://eudml.org/doc/272864
ER -

References

top
  1. [1] S. Adly, H. Attouch and A. Cabot, Finite time stabilization of nonlinear oscillators subject to dry friction – Nonsmooth mechanics and analysis. Adv. Mech. Math.12 (2006) 289–304. MR2205459
  2. [2] F. Alvarez, On the minimizing property of a second order dissipative system in Hilbert space. SIAM J. Control Optim.38 (2000) 1102–1119. Zbl0954.34053MR1760062
  3. [3] F. Alvarez, Weak convergence of a relaxed and inertial hybrid projection-proximal point algorithm for maximal monotone operators in Hilbert space. SIAM J. Optim.14 (2004) 773–782. Zbl1079.90096MR2085942
  4. [4] F. Alvarez and H. Attouch, The heavy ball with friction dynamical system for convex constrained minimization problems, in Optimization, Namur (1998), Lecture Notes in Econom. Math. Systems 481, Springer, Berlin (2000) 25–35. Zbl0980.90062MR1758015
  5. [5] F. Alvarez and H. Attouch, An inertial proximal method for monotone operators via discretization of a nonlinear oscillator with damping. Set Valued Anal.9 (2001) 3–11. Zbl0991.65056MR1845931
  6. [6] F. Alvarez and H. Attouch, Convergence and asymptotic stabilization for some damped hyperbolic equations with non-isolated equilibria. ESAIM: COCV 6 (2001) 539–552. Zbl1004.34045MR1849415
  7. [7] F. Alvarez, H. Attouch, J. Bolte and P. Redont, A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics. J. Math. Pures Appl. 81 (2002) 747–779. Zbl1036.34072MR1930878
  8. [8] A.S. Antipin, Minimization of convex functions on convex sets by means of differential equations. Differ. Uravn. 30 (1994) 1475–1486 (in Russian). English translation: Diff. Equ. 30 (1994) 1365–1375. Zbl0852.49021MR1347800
  9. [9] H. Attouch and R. Cominetti, A dynamical approach to convex minimization coupling approximation with the steepest descent method. J. Diff. Equ.128 (1996) 519–540. Zbl0886.49024MR1398330
  10. [10] H. Attouch and M.-O. Czarnecki, Asymptotic control and stabilization of nonlinear oscillators with non-isolated equilibria. J. Diff. Equ.179 (2002) 278–310. Zbl1007.34049MR1883745
  11. [11] H. Attouch and A. Soubeyran, Inertia and reactivity in decision making as cognitive variational inequalities. J. Convex. Anal.13 (2006) 207–224. Zbl1138.91370MR2252229
  12. [12] H. Attouch, D. Aze and R. Wets, Convergence of convex-concave saddle functions: Applications to convex programming and mechanics. Ann. Inst. Henri Poincaré, Anal. Non Linéaire 5 (1988) 537–572. Zbl0667.49009MR978671
  13. [13] H. Attouch, X. Goudou and P. Redont, The heavy ball with friction method: The continuous dynamical system. Global exploration of local minima by asymptotic analysis of a dissipative dynamical system. Commun. Contemp. Math. 1 (2000) 1–34. Zbl0983.37016MR1753136
  14. [14] H. Attouch, A. Cabot and P. Redont, The dynamics of elastic shocks via epigraphical regularization of a differential inclusion. Barrier and penalty approximations. Adv. Math. Sci. Appl. 12 (2002) 273–306. Zbl1038.49029MR1909449
  15. [15] H. Attouch, J. Bolte, P. Redont and A. Soubeyran, Alternating proximal algorithms for weakly coupled minimization problems. Applications to dynamical games and PDE's. J. Convex Anal. 15 (2008) 485–506. Zbl1154.65044MR2431407
  16. [16] J.-B. Baillon and G. Haddad, Quelques propriétés des opérateurs angles-bornés et n-cycliquement monotones. Israel J. Math.26 (1977) 137–150. Zbl0352.47023MR500279
  17. [17] J.-B. Baillon and A. Haraux, Comportement à l'infini pour les équations d'évolution avec forcing périodique. Arch. Rat. Mech. Anal.67 (1977) 101–109. Zbl0382.47021MR493553
  18. [18] J. Bolte, Continuous gradient projection method in Hilbert spaces. J. Optim. Theory Appl.119 (2003) 235–259. Zbl1055.90069MR2028993
  19. [19] J. Bolte and M. Teboulle, Barrier operators and associated gradient-like dynamical systems for constrained minimization problems. SIAM J. Control Optim.42 (2003) 1266–1292. Zbl1051.49010MR2044795
  20. [20] H. Brézis, Opérateurs maximaux monotones et semi-groupes de contractions dans les espaces de Hilbert, Mathematical Studies. North-Holland (1973). Zbl0252.47055MR348562
  21. [21] A. Cabot, Inertial gradient-like dynamical system controlled by a stabilizing term. J. Optim. Theory Appl.120 (2004) 275–303. Zbl1070.90107MR2044898
  22. [22] T. Cazenave and A. Haraux, An introduction to semilinear evolution equations, Oxford Lecture Series in Mathematics and its Applications 13. Oxford University Press, Oxford (1998). Zbl0926.35049MR1691574
  23. [23] P.L. Combettes and S.A. Hirstoaga, Visco-penalization of the sum of two operators. Nonlinear Anal.69 (2008) 579–591. Zbl1168.47040MR2426274
  24. [24] R. Cominetti, J. Peypouquet and S. Sorin, Strong asymptotic convergence of evolution equations governed by maximal monotone operators with Tikhonov regularization. J. Diff. Equ.245 (2008) 3753–3763. Zbl1169.34045MR2462703
  25. [25] S. Ervedoza and E. Zuazua, Uniformly exponentially stable approximations for a class of damped systems. J. Math. Pures Appl.91 (2009) 20–48. Zbl1163.74019MR2487899
  26. [26] S.D. Flam and J. Morgan, Newtonian mechanics and Nash play. Int. Game Theory Rev.6 (2004) 181–194. Zbl1087.91001MR2071364
  27. [27] I. Gallagher, Asymptotics of the solutions of hyperbolic equations with a skew-symmetric perturbation. J. Diff. Equ.150 (1998) 363–384. Zbl0921.35095MR1658597
  28. [28] J.K. Hale and G. Raugel, Convergence in gradient-like systems with applications to PDE. Z. Angew. Math. Phys.43 (1992) 63–125. Zbl0751.58033MR1149371
  29. [29] A. Haraux, Systèmes dynamiques dissipatifs et applications 17. Masson, RMA (1991). Zbl0726.58001MR1084372
  30. [30] J. Hofbauer and S. Sorin, Best response dynamics for continuous zero-sum games. Discrete Continuous Dyn. Syst. Ser. B6 (2006) 215–224. Zbl1183.91006MR2172204
  31. [31] P.E. Maingé, Regularized and inertial algorithms for common fixed points of nonlinear operators. J. Math. Anal. Appl.344 (2008) 876–887. Zbl1146.47042MR2426316
  32. [32] D. Monderer and L.S. Shapley, Potential Games. Games Econ. Behav.14 (1996) 124–143. Zbl0862.90137MR1393599
  33. [33] Z. Opial, Weak convergence of the sequence of successive approximations for nonexpansive mappings. Bull. Amer. Math. Soc.73 (1967) 591–597. Zbl0179.19902MR211301
  34. [34] B.T. Polyak, Introduction to Optimization. Optimization Software, New York (1987). Zbl0652.49002MR1099605
  35. [35] R.T. Rockafellar, Monotone operators associated with saddle-functions and mini-max problems, in Nonlinear operators and nonlinear equations of evolution in Banach spaces 2, 18th Proceedings of Symposia in Pure Mathematics, F.E. Browder Ed., American Mathematical Society (1976) 241–250. Zbl0237.47030MR285942
  36. [36] M. Schatzman, A class of nonlinear differential equations of second order in time. Nonlinear Anal.2 (1978) 355–373. Zbl0382.34003MR512664

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

                
Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.