Adaptive Acceleration Without Strong Convexity Priors Or Restarts

Joao V. Cavalcanti, Laurent Lessard & Ashia C. Wilson · 2025

Read Adaptive Acceleration Without Strong Convexity Priors Or Restarts by Joao V. Cavalcanti, Laurent Lessard & Ashia C. Wilson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13033.txt.

Introduction

Joao Cavalcanti, Laurent Lessard, and Ashia Wilson tackle, in a 2025 paper, a standing headache in optimization. The fastest gradient methods need a number that measures how strongly curved the problem is. When that number is unknown, the usual fixes are restarts or lucky guesses, both wasteful.

Their method, NAG-free, extends Nesterov's classic accelerated scheme so it estimates the curvature as it goes. The estimate costs nothing extra: it reuses a stored past point and gradient the scheme already computes. Proofs show it never does worse than plain gradient descent overall, and that near the answer it accelerates under mild conditions. Tests on fake and real data show it matches restart methods while adapting to easy local curvature.

Catalog record

CREATORJoao V. Cavalcanti, Laurent Lessard & Ashia C. Wilson
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE216 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-13033

Browse the full library · About the Tower of Babel