Unrolled Neural Networks for Constrained Optimization
Samar Hadou, Alejandro Ribeiro · 2026
Read Unrolled Neural Networks for Constrained Optimization by Samar Hadou, Alejandro Ribeiro (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17274.txt.
Introduction
Samar Hadou and Alejandro Ribeiro build neural networks that solve constrained optimization fast. Classic dual ascent methods solve such problems step by step. They are sound but can be slow. The authors unroll those steps into a learned network. Their frame is called constrained dual unrolling. Two coupled networks learn the two sides of the problem.
Together the networks near the saddle point of the Lagrangian. That point holds the best primal and dual values at once. Learned solvers can then answer new cases in one pass. Speed like that helps control, planning, and design tools. The work keeps the shape of a trusted method while adding learned pace.
Catalog record
| CREATOR | Samar Hadou, Alejandro Ribeiro |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-17274
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Unrolled Neural Networks for Constrained Optimization Samar Hadou, Alejandro Ribeiro Abstract In this paper, we develop unrolled neural networks to solve constrained optimization problems, offering accelerated, learnable counterparts to dual ascent (DA) algorithms. Our framework, termed constrained dual unrolling (CDU), comprises two coupled neural networks that jointly approximate the saddle point of the Lagrangian. The primal network emulates an iterative optimizer that finds a stationary point of the Lagrangian for a given dual multiplier, sampled from an unknown distribution. The dual network generates trajectories towards the optimal multipliers across its layers while querying the primal network at each layer. Departing from standard unrolling, we induce DA dynamics by imposing primal-descent and dual-ascent constraints through constrained learning. We formulate training the two networks as a nested optimization problem and propose an alternating procedure that updates the primal and dual networks in turn, mitigating uncertainty in the multiplier distribution required for primal network training. We numerically evaluate the framework on mixed-integer quadratic programs (MIQPs) and power allocation in wireless networks. In both cases, our approach yields near-optimal near-feasible solutions and exhibits strong out-of-distribution (OOD) generalization. I Introduction Bridging the gap between model-based optimization and data-driven learning, algorithm unrolling embeds iterative solvers into neural network architectures, yielding learnable optimizers that are structured from domain-specific knowledge [ 13 , 26 ] . Beyond the interpretability inherited from standard optimizers, unrolling offers accelerated convergence, with unrolled models often achieving superior performance using substantially fewer layers (i.e., iterations) than conventional iterative algorithms. While the seminal work of Greg and LeCun [ 13 ] introduced unrolling in the context of sparse coding, the approach has since achieved notable success in many applications such as computer vision [ 44 , 40 , 27 , 23 , 32 ] , wireless networks [ 17 , 10 , 36 , 43 ] , and medical imaging [ 39 , 22 , 9 , 38 ] , among others [ 16 , 30 , 24 , 1 , 33 , 14 ] . Despite the extensive literature on unrolling, the vast majority of existing work focuses on unconstrained optimization problems. In the relatively few works that address constrained optimization, a common approach is to incorporate constraints into the training losses as penalty terms, effectively transforming the task into an unconstrained problem [ 19 , 3 , 14 ] . Another line of work considers unrolling primal-dual methods [ 29 , 43 , 41 , 21 ] , but typically restricts learning to a small set of scalar hyperparameters, such as step sizes, rather than learning the full algorithmic dynamics. As a result, these approaches tend to be narrowly tailored to the problem classes they were designed to address. In this paper, we introduce constrained dual unrolling (CDU), a novel unrolling framework to solve constrained optimization problems in the dual domain. The approach employs two unrolled neural networks that collaboratively solve the dual problem, i.e., finding the saddle point of the Lagrangian function. The primal network finds a stationary point of the Lagrangian for a given multiplier, while the dual network maximizes the dual function. We cast the training problem as a nested optimization problem, where the inner level trains the primal network over a joint distribution of constrained problems and Lagrangian multipliers and the outer level trains the dual network over the distribution of problem instances. The multiplier distribution required for the inner level is not known a priori, as it depends on the sequence of multipliers generated by the forward pass of the dual network. To address this, we train our networks through an alternating scheme: the dual network first generates multipliers for training the primal network, whose solutions are then used to update the dual network. Alernating between these two steps ensures that each network is optimized against the recent output of the other. Our method departs from traditional unrolling literature in two key aspects. First, rather than hard-coding the structure of an iterative solver, we use off-the-shelf neural networks to model the primal and dual iterates, allowing for more expressive and flexible architectures. Second, we enforce the optimization dynamics by imposing descent and ascent constraints on the outputs of the unrolled layers during training. The first difference concerns adopting a broader interpretation of unrolling. Our unrolled networks still mimic an iterative algorithm and predict a trajectory towards the optimum across the unrolled layers. However, the architecture itself does not replicate the underlying iterative algorithm. Rather, we use a standard neural network, however shallow, as an unrolled layer. This perspective is not entirely new; similar approaches have been explored in related areas, such as optimal control [ 19 ] , deep equilibrium networks [ 2 ] and plug-and-play (PnP) approaches [ 35 , 12 ] . This choice is motivated by the fact that these networks can approximate continuous functions, including iterative update rules, under some regularity assumptions and with great precision [ 25 , 42 ] . Fig. 1 : Trajectories generated by (left) DA algorithm, (middle) constrained dual unrolling and (right) its unconstrained counterpart for a QP instance: (Top) primal trajectories toward the stationary point of the Lagrangian {\mathcal{L}}(\cdot,\bm{\lambda};{\mathbf{z}}) , and (bottom) dual trajectories maximizing the dual function g(\cdot\,;{\mathbf{x}}^{*}(\bm{\lambda}),{\mathbf{z}}) . The constrained networks generate descent trajectories emulating the DA algorithm, while the unconstrained models generate random trajectories and fail to hit the optimum of the dual function (bottom right). The second aspect tackles the lack of descent behavior of unrolled models, which our prior work has shown to be particularly susceptible to out-of-distribution (OOD) examples [ 15 ] . To address this limitation, we impose monotonic descent and ascent constraints on the output of the primal and dual layers during training. Figure 1 illustrates the effect of imposing these constraints on quadratic programs (QPs). The right panels show the evolution of the Lagrangian (top) and dual (bottom) functions across the layers of primal and dual networks. The trajectories exhibit large excursions across the optimization spaces and fail to locate the maximum of the dual function as precisely as the iterative algorithm on the left. In contrast, the middle panels show that imposing the constraints yields descent and ascent trajectories toward the true solution with mild oscillations. Overall, our numerical experiments show that these descent constraints improve the final-layer performance and enhance the OOD generalization. Last but not least, our framework is agnostic to the primal and dual architectures and the specific constrained problem being solved. In this work, we tackle mixed-integer quadratic programs (MIQP) and power allocation in wireless networks, using graph neural networks (GNNs). GNNs are particularly well-suited for these tasks, as they naturally capture the relational structure between variables and constraints, and are endowed with stability, transferability, and permutation equivariance [ 34 ] . Nevertheless, our approach generalizes to a wide range of problems and architectures. In summary, the main contributions of this work are: • We design a pair of primal and dual networks that interact at the layer level to solve the dual problem (Section II-B ). • We formulate the training problem as a nested optimization problem and provide an alternating training scheme that updates the two networks in turn (Section III ). • We impose descent and ascent constraints on the