An optimal first-order method for smooth and strongly convex composite optimization and its stationary limit
Manu Upadhyaya 1,2 Daniel Berg Thomsen 1,2 [email protected] [email protected] Aymeric Dieuleveut 2 Adrien B. Taylor 1 [email protected] [email protected] 1 Inria, D.I. ENS, CNRS, PSL Research University, Paris, France 2 CMAP, École Polytechnique, Institut Polytechnique de Paris, Palaiseau, France · 2026
Read An optimal first-order method for smooth and strongly convex composite optimization and its stationary limit by Manu Upadhyaya 1,2 Daniel Berg Thomsen 1,2 [email protected] [email protected] Aymeric Dieuleveut 2 Adrien B. Taylor 1 [email protected] [email protected] 1 Inria, D.I. ENS, CNRS, PSL Research University, Paris, France 2 CMAP, École Polytechnique, Institut Polytechnique de Paris, Palaiseau, France (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22929.txt.
Description
Upadhyaya and three coauthors introduce Prox-ITEM, an optimal proximal gradient scheme for minimizing a sum of a smooth, strongly convex function and a convex, proper, lower semicontinuous function. In the smooth case it reduces to the information-theoretic exact method. They prove an exact distance-to-solution bound matching that method's rate and show the rate is minimax optimal within span-based first-order methods. Its stationary limit, Prox-TMM, extends the triple momentum method to the composite setting.
Catalog record
| CREATOR | Manu Upadhyaya 1,2 Daniel Berg Thomsen 1,2 [email protected] [email protected] Aymeric Dieuleveut 2 Adrien B. Taylor 1 [email protected] [email protected] 1 Inria, D.I. ENS, CNRS, PSL Research University, Paris, France 2 CMAP, École Polytechnique, Institut Polytechnique de Paris, Palaiseau, France |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61202 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22929