Adaptive Acceleration Without Strong Convexity Priors Or Restarts
Joao V. Cavalcanti, Laurent Lessard & Ashia C. Wilson · 2025
Read Adaptive Acceleration Without Strong Convexity Priors Or Restarts by Joao V. Cavalcanti, Laurent Lessard & Ashia C. Wilson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13033.txt.
Introduction
Joao Cavalcanti, Laurent Lessard, and Ashia Wilson tackle, in a 2025 paper, a standing headache in optimization. The fastest gradient methods need a number that measures how strongly curved the problem is. When that number is unknown, the usual fixes are restarts or lucky guesses, both wasteful.
Their method, NAG-free, extends Nesterov's classic accelerated scheme so it estimates the curvature as it goes. The estimate costs nothing extra: it reuses a stored past point and gradient the scheme already computes. Proofs show it never does worse than plain gradient descent overall, and that near the answer it accelerates under mild conditions. Tests on fake and real data show it matches restart methods while adapting to easy local curvature.
Catalog record
| CREATOR | Joao V. Cavalcanti, Laurent Lessard & Ashia C. Wilson |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 216 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-13033