2108.10249
NEW Q-NEWTON’S METHOD MEETS BACKTRACKING LINE SEARCH: GOOD CONVERGENCE GUARANTEE, SADDLE POINTS AVOIDANCE, QUADRATIC RATE OF CONVERGENCE, AND EASY IMPLEMENTATION
Tuyen Trung Truong
correcthigh confidence
- Category
- math.DS
- Journal tier
- Strong Field
- Processed
- Sep 28, 2025, 12:56 AM
- arXiv Links
- Abstract ↗PDF ↗
Audit review
The paper proves a global dichotomy and quadratic convergence for the New Q-Newton Backtracking method on Morse functions, via (i) a pigeonhole spectral-shift lemma, (ii) descent with Armijo backtracking, (iii) a compact-set step-size bound, and (iv) a projective-metric argument to force convergence when bounded; it then shows local stabilization near nondegenerate critical points so that the method reduces to the non-backtracking NQ-Newton in a neighborhood and inherits its local behavior, thereby avoiding saddles almost surely and achieving quadratic convergence at minima . The candidate solution establishes the same claims through a closely related—but not identical—line of reasoning: it proves the spectral-gap selection via the same pigeonhole argument, descent plus Armijo well-posedness using a Lipschitz gradient estimate, bounded-iterates ⇒ gradient→0, and a careful local linearization of the iteration map F(x)=x−|A(x)|^{-1}∇f(x) to obtain quadratic convergence at minima and a measure-zero stable set at saddles. The only substantive difference is that the paper’s global bifurcation (bounded ⇒ convergence) leverages a projective-metric device , whereas the model gives a high-level trapping argument; this is a minor gap in exposition rather than a contradiction. Overall, both are correct, with different proof organization and tools.
Referee report (LaTeX)
\textbf{Recommendation:} minor revisions
\textbf{Journal Tier:} strong field
\textbf{Justification:}
The paper develops a Newton-like method with a provable dichotomy and quadratic convergence on Morse objectives and supports it with simple, implementable algorithms. The analysis is concise and correct, and the projective-metric device convincingly addresses the bounded ⇒ convergence step. Minor clarifications would enhance readability, especially around local stabilization and explicit constants.