Computationally efficient Gauss-Newton reinforcement learning for model predictive control

Dean Brandner, Sebastien Gros, Sergio Lucia · 2025

Read Computationally efficient Gauss-Newton reinforcement learning for model predictive control by Dean Brandner, Sebastien Gros, Sergio Lucia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02441.txt.

Description

Dean Brandner, Sebastien Gros, and Sergio Lucia speed up learning-based control in a 2025 paper. Model predictive control plans actions by solving an optimization at each step, and it can serve as the policy that reinforcement learning tunes. Because each policy update needs many of those plans, simple first-order learning crawls.

The team build a Gauss-Newton shortcut: a second-order update that skips the expensive second derivatives of the policy itself. With that shortcut, learning can advance in superlinear steps instead of tiny shuffles. Low-parameter controllers, exactly the kind used in process plants, stand to gain fast, reliable tuning from few trials.

Catalog record

CREATORDean Brandner, Sebastien Gros, Sergio Lucia
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE83 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-02441

Browse the full library · About the Tower of Babel