Second-Order Bilevel Optimization with Accelerated Convergence Rates
Sheng Yang, Chengchang Liu, Lesi Chen, John C.S. Lui · 2026
Read Second-Order Bilevel Optimization with Accelerated Convergence Rates by Sheng Yang, Chengchang Liu, Lesi Chen, John C.S. Lui (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06431.txt.
Description
Sheng Yang, Chengchang Liu, Lesi Chen, and John C. S. Lui design faster second-order methods for bilevel optimization where the outer problem is nonconvex and the inner one strongly convex. Their fully second-order method, FSBA, reaches a second-order stationary point of the hyper-objective with an accelerated iteration rate over first-order methods.
Second-order information is costly, so a lazy variant reuses it across several iterations and improves computational complexity by a factor tied to problem dimension. The same lazy idea yields a cubic-regularized Newton method for nonconvex strongly-concave minimax problems with better complexity than existing second-order options. The work targets problems where curvature information is worth its price.
Catalog record
| CREATOR | Sheng Yang, Chengchang Liu, Lesi Chen, John C.S. Lui |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 132 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06431