Abstract
The BFGS update formula is shown to have an important property that is independent of the algorithmic context of the update, and that is relevant to both constrained and unconstrained optimization. The BFGS method for unconstrained optimization, using a variety of line searches, including backtracking, is shown to be globally and superlinearly convergent on uniformly convex problems. The analysis is particularly simple due to the use of some new tools introduced in this paper.
Keywords
Broyden–Fletcher–Goldfarb–Shanno algorithmQuasi-Newton methodBacktrackingLine searchMathematicsContext (archaeology)Mathematical optimizationMinificationVariety (cybernetics)Simple (philosophy)Property (philosophy)AlgorithmNewton's methodApplied mathematicsComputer scienceNonlinear system
Affiliated Institutions
Related Publications
ROBUST MODELING WITH ERRATIC DATA
An attractive alternative to least‐squares data modeling techniques is the use of absolute value error criteria. Unlike the least‐squares techniques the inclusion of some infini...
Decoding by Linear Programming
This paper considers a natural error correcting problem with real valued input/output. We wish to recover an input vector f/spl isin/R/sup n/ from corrupted measurements y=Af+e....
Handbook of Genetic Algorithms
This book sets out to explain what genetic algorithms are and how they can be used to solve real-world problems. The first objective is tackled by the editor, Lawrence Davis. Th...
On clusterings
We motivate and develop a natural bicriteria measure for assessing the quality of a clustering that avoids the drawbacks of existing measures. A simple recursive heuristic is sh...
A spectral algorithm for envelope reduction of sparse matrices
Abstract The problem of reordering a sparse symmetric matrix to reduce its envelope size is considered. A new spectral algorithm for computing an envelope‐reducing reordering is...
Publication Info
- Year
- 1989
- Type
- article
- Volume
- 26
- Issue
- 3
- Pages
- 727-739
- Citations
- 362
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
362
OpenAlex
Cite This
Richard H. Byrd,
Jorge Nocedal
(1989).
A Tool for the Analysis of Quasi-Newton Methods with Application to Unconstrained Minimization.
SIAM Journal on Numerical Analysis
, 26
(3)
, 727-739.
https://doi.org/10.1137/0726042
Identifiers
- DOI
- 10.1137/0726042