Second-Order Bilevel Optimization with Accelerated Convergence Rates

Sheng Yang, Chengchang Liu, Lesi Chen, John C.S. Lui · 2026

Read Second-Order Bilevel Optimization with Accelerated Convergence Rates by Sheng Yang, Chengchang Liu, Lesi Chen, John C.S. Lui (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06431.txt.

Description

Sheng Yang, Chengchang Liu, Lesi Chen, and John C. S. Lui design faster second-order methods for bilevel optimization where the outer problem is nonconvex and the inner one strongly convex. Their fully second-order method, FSBA, reaches a second-order stationary point of the hyper-objective with an accelerated iteration rate over first-order methods.

Second-order information is costly, so a lazy variant reuses it across several iterations and improves computational complexity by a factor tied to problem dimension. The same lazy idea yields a cubic-regularized Newton method for nonconvex strongly-concave minimax problems with better complexity than existing second-order options. The work targets problems where curvature information is worth its price.

Catalog record

CREATORSheng Yang, Chengchang Liu, Lesi Chen, John C.S. Lui
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE132 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.06431

Browse the full library · About the Tower of Babel