On Modified Newton Methods for Unconstrained Optimization Based on Lanczos Tridiagonalization
Abstract
For a strongly convex unconstrained minimization problem, Newton's method with a line search offers rapid convergence to a minimizer by incorporating second-order information. However, for a general unconstrained problem the Hessian need not be positive definite, which can lead to the inability to find a search direction or to search directions that fail to produce descent. Modified Newton methods are designed to handle this situation. This paper considers modifications to a Newton-conjugate-gradient approach based on Lanczos tridiagonalization. Existing methods are extended using dynamic modification schemes that provide a descent direction while keeping the modification bounded. A Lanczos-based scheme and a conjugate-gradient (CG)-based scheme are formulated and analyzed. These methods are mathematically equivalent in exact arithmetic, but their practical behavior differs in finite precision. Finally, it is shown how the convergence and computational cost are affected by varying the amount of additional curvature introduced and by allowing the early termination of the inner iterations.
Related
- A Twin gradient method for unconstrained optimization
- A simple adaptive accelerated optimistic dual averaging method for unconstrained convex optimization in p-norm geometry
- Finite-Precision Symmetric Krylov Methods: Exact Rounding Examples, Block Paige Identities,and a Variable-Block Lanczos Model
- Explicit charge-conserving and modified energy-conserving PIC methods using the SAV approach
- High-order positivity-preserving well-balanced schemes: combining flux globalization with modified Patankar deferred correction methods
BibTeX
@misc{ansarionnestam2026modified,
title = {{On Modified Newton Methods for Unconstrained Optimization Based on Lanczos Tridiagonalization}},
author = {Aban Ansari-Önnestam and Anders Forsgren and Philip E. Gill},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.31110},
eprint = {2610.31110},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.31110},
}
RIS
TY - UNPB
TI - On Modified Newton Methods for Unconstrained Optimization Based on Lanczos Tridiagonalization
AU - Aban Ansari-Önnestam
AU - Anders Forsgren
AU - Philip E. Gill
PY - 2026
DA - 2026/10/22
PB - arXiv
DO - 10.48550/arxiv.2610.31110
UR - https://arxiv.org/abs/2610.31110
AB - For a strongly convex unconstrained minimization problem, Newton's method with a line search offers rapid convergence to a minimizer by incorporating second-order information. However, for a general unconstrained problem the Hessian need not be positive definite, which can lead to the inability to find a search direction or to search directions that fail to produce descent. Modified Newton methods are designed to handle this situation. This paper considers modifications to a Newton-conjugate-gradient approach based on Lanczos tridiagonalization. Existing methods are extended using dynamic modification schemes that provide a descent direction while keeping the modification bounded. A Lanczos-based scheme and a conjugate-gradient (CG)-based scheme are formulated and analyzed. These methods are mathematically equivalent in exact arithmetic, but their practical behavior differs in finite precision. Finally, it is shown how the convergence and computational cost are affected by varying the amount of additional curvature introduced and by allowing the early termination of the inner iterations.
ER -