Adaptive Tuning of Online Feedback Optimization for Process Control Applications footnoteinfo Research supported by Marie Curie Horizon Postdoctoral Fellowship project RELIC (M. Zagorowska and L. Imsland, grant no 101063948), Delft Technology Fellowship (M. Zagorowska), and by the Wallenberg AI, Autonomous Systems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation (G. Belgioioso).

Marta Zagorowska, Lukas Ortmann, Giuseppe Belgioioso, Lars Imsland · 2026

Read Adaptive Tuning of Online Feedback Optimization for Process Control Applications footnoteinfo Research supported by Marie Curie Horizon Postdoctoral Fellowship project RELIC (M. Zagorowska and L. Imsland, grant no 101063948), Delft Technology Fellowship (M. Zagorowska), and by the Wallenberg AI, Autonomous Systems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation (G. Belgioioso). by Marta Zagorowska, Lukas Ortmann, Giuseppe Belgioioso, Lars Imsland (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12863.txt.

Introduction

Marta Zagorowska and three colleagues auto-tune online feedback optimization controllers for process control. Tuning is hard because algorithm settings lack a direct link to process behavior. Their method adapts scaled projected gradient descent using objective sensitivity to algorithm settings. Operator choices shrink to scalars capping how much inputs and objective shift per step. No extra system knowledge or repeat experiments are needed. Gas lift and stirred tank reactor tests beat standard manual tuning on closed-loop performance.

Catalog record

CREATORMarta Zagorowska, Lukas Ortmann, Giuseppe Belgioioso, Lars Imsland
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34786
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.12863

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Adaptive Tuning of Online Feedback Optimization for Process Control Applications footnoteinfo Research supported by Marie Curie Horizon Postdoctoral Fellowship project RELIC (M. Zagorowska and L. Imsland, grant no 101063948), Delft Technology Fellowship (M. Zagorowska), and by the Wallenberg AI, Autonomous Systems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation (G. Belgioioso). Marta Zagorowska, Lukas Ortmann, Giuseppe Belgioioso, Lars Imsland Abstract Online Feedback Optimization leverages properties of optimization algorithms to develop controllers for systems with limited model availability, which is often the case in process control. The interplay between the parameters of the chosen optimization algorithm, as well as lack of direct connection to the characteristics of the underlying process make their tuning challenging. We propose a method for adaptive tuning of Online Feedback Optimization controllers based on scaled projected gradient descent by using sensitivity of the desired objective to the parameters of the algorithm. The proposed adaptive tuning method limits the operator-tunable parameters to scalar values that represent how much the control inputs and the objective can change between iterations without requiring either additional information about the controlled system or repeated experiments. Numerical studies on a gas lift and a continuously-stirred tank reactor processes confirm that our adaptive scheme improves closed-loop performance of Online Feedback optimization compared to standard manual tuning methods. keywords Model-predictive and optimization-based control in chemical processes; Real-time optimization and control in chemical processes; Advanced process control 1 Introduction Online Feedback Opitmization (OFO) allows reaching the optimal operating points while satisfying constraints and relying on limited model information ( Hauswirth et al. 2024 ) , which makes it a promising method for process control applications. The closed-loop performance of these controllers is determined by the parameters of the optimization algorithms, which are disconnected from the properties of the controlled system and usually need to be tuned through a series of experiments. To simplify tuning of these parameters, this paper proposes an adaptive method for choosing the parameters of Online Feedback Optimization removing the need for repeated experiments. 1.0.1 Motivation Online Feedback Optimization based on scaled projected gradient descent has been proposed as a controller by Häberle et al. 2020 , with performance determined by two parameters: a scalar step size and a scaling matrix. Several methods have been proposed for adapting the scaling matrices in optimization algorithms, especially for unconstrained problems ( Hazan 2019 , Chapter 5.6) . However, OFO relies on real-time measurements and limited model information, which precludes the use of line-search strategies ( Häberle et al. 2020 ) or Hessian information ( Bonettini et al. 2008 ; Bertsekas 2016 ) . In practical uses of OFO, choosing the parameters requires multiple runs of the system ( Gil et al. 2023 ; Zagorowska et al. 2024 ) , or sufficient knowledge about the underlying system ( Ortmann et al. 2024 ) . Bernstein et al. 2023 proposed an adaptive tuning method for the step size for steady-state problems with quadratic objective functions with linear constraints, while Huang and Grammatico 2025 also assumed linear dynamics of the underlying system. They used the derivatives with respect to problem variables as indicators whether the step should be increased or decreased. We build on these approaches and propose an online tuning method for nonlinear systems arising in process control applications. 1.0.2 Contribution In this work, we propose an adaptive method for choosing the scaling matrix and the step size to improve closed-loop performance and reduce the operator-tunable parameters to scalar values. We avoid additional experiments by approximating the derivatives with respect to parameters using known derivatives with respect to inputs and outputs that are used in standard OFO controllers. The scaling matrix is found by solving an auxiliary semi-definite optimization problem that preserves its properties, while the step size comes from a quadratic approximation of the objective inspired by Bertsekas 2016 . This paper is structured as follows. Section 2 introduces the background of OFO and the formulation used in this work. Section 3 introduces the adaptive tuning method, which is validated in numerical examples in Section 4 . Section 5 closes the paper with suggestions for future work. 2 Background We consider the steady-state optimization problem \displaystyle\min_{u,y} \displaystyle\quad\Phi(u,y) (1a) s.t. \displaystyle\quad y=h(u),\;Au\leq b,\;Cy\leq d, (1b) with n_{u} inputs and n_{y} outputs where \Phi:\mathds{R}^{n_{u}}\times\mathds{R}^{n_{y}}\rightarrow\mathds{R} is a continuously differentiable nonlinear cost, h:\mathds{R}^{n_{u}}\rightarrow\mathds{R}^{n_{y}} is a continuously differentiable nonlinear input-output mapping, A\in\mathds{R}^{n_{c_{1}}\times n_{u}} , b\in\mathds{R}^{n_{c_{1}}} , C\in\mathds{R}^{n_{c_{2}}\times n_{y}} , and d\in\mathds{R}^{n_{c_{2}}} are constant matrices, and c_{1} and c_{2} are the number of input and output constraints, respectively. 2.1 OFO with scaled projected gradient descent Online Feedback Optimization with scaled projected gradient descent proposed by Häberle et al. 2020 solves ( 1 ) by iteratively finding control inputs as \displaystyle u^{k+1}=u^{k}+\alpha^{k}w^{k} (2) where \alpha^{k}\in(0,\alpha_{\max}] is a tunable step size and w^{k} is the solution to the quadratic optimization problem: \displaystyle\min_{w\in\mathbb{R}^{p}}\quad \displaystyle\left\|w+S^{k+1}H^{\top}(u^{k})\nabla\Phi^{\top}(u^{k},y^{k})\right\|_{{(S^{k+1})}^{-1}}^{2} (3a) s.t. \displaystyle A\left(u^{k}+\alpha_{\max}w\right)\leq b (3b) \displaystyle C\left(y^{k}+\nabla h(u^{k})\alpha_{\max}w\right)\leq d (3c) \displaystyle S^{k}\in\mathbb{S}_{+}^{n_{u}}, (3d) where H(u)^{\top}=\left[\mathbb{I}_{n_{u}}\ \nabla h(u)^{\top}\right] , S^{k}:\mathcal{U}\rightarrow\mathbb{S}_{+}^{n_{u}} is a continuous metric on \mathcal{U} , and \|x\|_{S}:=\sqrt{x^{\top}Sx} . The set \mathbb{S}_{+}^{n_{u}} denotes the set of symmetric positive definite matrices of size n_{u}\times n_{u} and \mathbb{I}_{n_{u}} is an identity matrix of size n_{u}\times n_{u} . Implementing ( 2 ) requires only the so-called sensitivity \nabla h rather than the full input-output mapping h from ( 1b ), which is obtained as an on-line measurement y^{k} in ( 3c ). The impact of the step \alpha on closed-loop performance of the plant-algorithm interconnection was studied by Häberle et al. 2020 , while Ortmann et al. 2024 have shown the role of the scaling matrix S . Typically, tuning these hyperparameters requires a series of experiments where the values are gradually increased until reaching the desired performance ( Gil et al. 2023 ) 1 1 1 Gil et al. 2023 considered S=G^{-1} , so the elements were decreased during tuning and kept constant throughout online operation. However, repeated experiments are time-consuming and may be affected by changing operating conditions. 2.2 Sensitivity of Online Feedback Optimization Our adaptive tuning method leverages the sensitivity of the objective \Phi in ( 1a ) to the scaling matrix S and the step size studied by Zagorowska and Imsland 2025 . From ( 1a ) and the chain rule we obtain at any time step k\in\mathds{N}_{+} , l\in\mathds{N}_{\leq k} : \displaystyle\frac{\partial\Phi^{k}}{\partial S^{l}}= \displaystyle}{\displaystyle\left(\frac{\partial\Phi^{k}}{\partial u^{k}}+\frac{\partial\Phi^{k}}{\partial y^{k}}\cdot\frac{\partial y^{k}}{\partial u^{k}}\right)\cdot\frac{\partial u^{k}}{\partial S^{l}}. (4) To obtain \frac{\partial u^{k}}{\partial S^{l}} , we first get from ( 2 ): \displaystyle u^{k}= \displaystyle{}u^{0}+\sum\limits_{l=0}^{k-1}\alpha^{l}w^{l}, (5) where w^{l}\in\mathds{R}^{n_{u}} is obtained from ( 3 ) and, as such, also depends on S^{0},\ldots,S^{l} . By differentiating ( 5 ) with respect to S^{k} , we get: \displaystyle\frac{\partial u^{k}}{\partial S^{l}}= \displaystyle{}\underbrace{\frac{\partial u^{0}}{\partial S^{l}}}_{=0}+\alpha^{0}\underbrace{\frac{\partial w^{0}}{\partial S^{l}}}_{=0}+\ldots+\alpha^{l}\frac{\partial w^{l}}{\partial S^{l}}+\ldots+\alpha^{k-1}\frac{\partial w^{k-1}}{\partial S^{l}} \displaystyle= \displaystyle{}\sum\limits_{m=l}^{k-1}\alpha^{m}\frac{\partial w^{m}}{\partial S^{l}}, ( 6 ) because u_{0} is independent of S^{l} and w^{m} is independent of S^{l} for m<l . Stacking the columns of S vertically into p^{l}=\text{vec}(S^{l}) enables using the sensitivity formulas from Zagorowska and Imsland 2025 to obtain \frac{\partial w^{m}}{\partial S^{l}} . 3 Adaptive tuning The adaptive method in this work is inspired by iterative feedback tuning algorithms developed for PID controllers ( Hjalmarsson et al. 1998 ; Hjalmarsson 2002 ) . These algorithms use sensitivity with respect to controller parameters to find

Read the complete text