Recursive form of general limited memory variable metric methods

Ladislav Lukšan; Jan Vlček

Kybernetika (2013)

  • Volume: 49, Issue: 2, page 224-235
  • ISSN: 0023-5954

Abstract

top
In this report we propose a new recursive matrix formulation of limited memory variable metric methods. This approach can be used for an arbitrary update from the Broyden class (and some other updates) and also for the approximation of both the Hessian matrix and its inverse. The new recursive formulation requires approximately 4 m n multiplications and additions per iteration, so it is comparable with other efficient limited memory variable metric methods. Numerical experiments concerning Algorithm 1, proposed in this report, confirm its practical efficiency.

How to cite

top

Lukšan, Ladislav, and Vlček, Jan. "Recursive form of general limited memory variable metric methods." Kybernetika 49.2 (2013): 224-235. <http://eudml.org/doc/260574>.

@article{Lukšan2013,
abstract = {In this report we propose a new recursive matrix formulation of limited memory variable metric methods. This approach can be used for an arbitrary update from the Broyden class (and some other updates) and also for the approximation of both the Hessian matrix and its inverse. The new recursive formulation requires approximately $4 m n$ multiplications and additions per iteration, so it is comparable with other efficient limited memory variable metric methods. Numerical experiments concerning Algorithm 1, proposed in this report, confirm its practical efficiency.},
author = {Lukšan, Ladislav, Vlček, Jan},
journal = {Kybernetika},
keywords = {unconstrained optimization; large scale optimization; limited memory methods; variable metric updates; recursive matrix formulation; algorithms; unconstrained optimization; large scale optimization; limited memory methods; variable metric updates; recursive matrix formulation; algorithms},
language = {eng},
number = {2},
pages = {224-235},
publisher = {Institute of Information Theory and Automation AS CR},
title = {Recursive form of general limited memory variable metric methods},
url = {http://eudml.org/doc/260574},
volume = {49},
year = {2013},
}

TY - JOUR
AU - Lukšan, Ladislav
AU - Vlček, Jan
TI - Recursive form of general limited memory variable metric methods
JO - Kybernetika
PY - 2013
PB - Institute of Information Theory and Automation AS CR
VL - 49
IS - 2
SP - 224
EP - 235
AB - In this report we propose a new recursive matrix formulation of limited memory variable metric methods. This approach can be used for an arbitrary update from the Broyden class (and some other updates) and also for the approximation of both the Hessian matrix and its inverse. The new recursive formulation requires approximately $4 m n$ multiplications and additions per iteration, so it is comparable with other efficient limited memory variable metric methods. Numerical experiments concerning Algorithm 1, proposed in this report, confirm its practical efficiency.
LA - eng
KW - unconstrained optimization; large scale optimization; limited memory methods; variable metric updates; recursive matrix formulation; algorithms; unconstrained optimization; large scale optimization; limited memory methods; variable metric updates; recursive matrix formulation; algorithms
UR - http://eudml.org/doc/260574
ER -

References

top
  1. Bongartz, I., Conn, A. R., Gould, N., Toint, P. L., 10.1145/200979.201043, ACM Trans. Math. Software 21 (1995), 123-160. Zbl0886.65058DOI10.1145/200979.201043
  2. Byrd, R. H., Nocedal, J., Schnabel, R. B., 10.1007/BF01582063, Math. Programming 63 (1994), 129-156. MR1268604DOI10.1007/BF01582063
  3. Davidon, W. C., 10.1007/BF01681328, Math. Programming 9 (1975), 1-30. Zbl0328.90055MR0383741DOI10.1007/BF01681328
  4. Dolan, E. D., Moré, J. J., 10.1007/s101070100263, Math. Programming 91 (2002), 201-213. Zbl1049.90004MR1875515DOI10.1007/s101070100263
  5. Hoshino, S., 10.1093/imamat/10.3.394, J. Institute of Mathematics and its Applications 10 (1972), 394-403. Zbl0258.65065MR0336997DOI10.1093/imamat/10.3.394
  6. Lukšan, L., Quasi-Newton methods without projections for unconstrained minimization., Kybernetika 18 (1982), 290-306. Zbl0514.65047MR0688368
  7. Lukšan, L., Matonoha, C., Vlček, J., Sparse Test Problems for Unconstrained Optimization., Report V-1064, Institute of Computer Science AS CR, Prague 2010. 
  8. Lukšan, L., Matonoha, C., Vlček, J., Modified CUTE Problems for Sparse Unconstrained Optimization., Report V-1081, Institute of Computer Science AS CR, Prague 2010. 
  9. Spedicato, L. Lukšan amd E., 10.1016/S0377-0427(00)00420-9, J. Comput. Appl. Math. 124 (2000), 61-95. MR1803294DOI10.1016/S0377-0427(00)00420-9
  10. Matthies, H., Strang, G., 10.1002/nme.1620141104, Internat. J. Numer. Methods Engrg. 14 (1979), 1613-1623. Zbl0419.65070MR0551801DOI10.1002/nme.1620141104
  11. Nocedal, J., 10.1090/S0025-5718-1980-0572855-7, Math. Comput. 35 (1980), 773-782. Zbl0464.65037MR0572855DOI10.1090/S0025-5718-1980-0572855-7
  12. Vlček, J., Lukšan, L., Generalizations of the Limited-memory BFGS Method Based on Quasi-product Form of Update., Report V-1060, Institute of Computer Science AS CR, Prague 2009. 

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.