Conformal Mixed-Integer Constraint Learning with Feasibility Guarantees
Daniel Ovalle, Lorenz T. Biegler, Ignacio E. Grossmann, Carl D. Laird, and, Mateo Dulce Rubio · 2025
Read Conformal Mixed-Integer Constraint Learning with Feasibility Guarantees by Daniel Ovalle, Lorenz T. Biegler, Ignacio E. Grossmann, Carl D. Laird, and, Mateo Dulce Rubio (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-03531.txt.
Introduction
Daniel Ovalle, Carl Laird and their co-authors present a conformal method for learning constraints in optimization with feasibility guarantees in 2025. Standard data-driven constraints can violate the true limits because of model error or thin data, which risks unsafe decisions.
Their framework uses conformal prediction so that solutions judged feasible are truly feasible with a chosen high probability. The guarantee needs no access to the true constraint function and works for both regression and classification tasks. It also avoids the scaling problems of ensemble heuristics. Tests on real applications hit target feasibility rates with competitive results and far lower compute cost.
Catalog record
| CREATOR | Daniel Ovalle, Lorenz T. Biegler, Ignacio E. Grossmann, Carl D. Laird, and, Mateo Dulce Rubio |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-03531
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Conformal Mixed-Integer Constraint Learning with Feasibility Guarantees Daniel Ovalle, Lorenz T. Biegler, Ignacio E. Grossmann, Carl D. Laird, and, Mateo Dulce Rubio Abstract We propose Conformal Mixed-Integer Constraint Learning (C-MICL), a novel framework that provides probabilistic feasibility guarantees for data-driven constraints in optimization problems. While standard Mixed-Integer Constraint Learning methods often violate the true constraints due to model error or data limitations, our C-MICL approach leverages conformal prediction to ensure feasible solutions are ground-truth feasible. This guarantee holds with probability at least 1 − α 1{-}\alpha , under a conditional independence assumption. The proposed framework supports both regression and classification tasks without requiring access to the true constraint function, while avoiding the scalability issues associated with ensemble-based heuristics. Experiments on real-world applications demonstrate that C-MICL consistently achieves target feasibility rates, maintains competitive objective performance, and significantly reduces computational cost compared to existing methods. Our work bridges mathematical optimization and machine learning, offering a principled approach to incorporate uncertainty-aware constraints into decision-making with rigorous statistical guarantees. 1 Introduction Constraint Learning (CL) deals with inferring the functional form of constraints or objectives from observed data to embed them into mathematical optimization problems, particularly when parts of the system behavior are difficult to model explicitly [ 1 ] . This is especially relevant in settings where the relationship between decision and output variables is unknown but can be learned from data, enabling a supervised learning approach [ 2 , 3 ] . It is also valuable in surrogate modeling scenarios where the relationship is known but difficult to optimize, either due to its nonlinearity, computational cost, or complexity (e.g., high dimensionality) [ 4 , 5 , 6 ] . That is, CL simply leverages modern machine learning systems to learn the structure and patterns of complex constraints directly from data, enabling prediction of constraint boundaries at unobserved points to efficiently navigate feasible solution spaces and discover better optima. The core principle that enables CL is that many machine learning models can be represented as mixed-integer programs (MIPs), making it possible to encode their predictive mechanism as algebraic optimization-compatible expressions [ 1 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 ] . This integration is commonly referred to as Mixed-Integer Constraint Learning (MICL). However, a critical challenge arises from the very nature of optimization algorithms: they systematically leverage the mathematical structure of the problem to identify extreme points. As a result, small approximation errors in the learned constraint model (e.g., arising from noisy data, model bias, or insufficient training) can be systematically exploited during the optimization. This behavior often leads to solutions that are infeasible with respect to the true system, meaning that the optimal decision variables found by optimization programs under CL frequently violate the original constraints when evaluated using the true underlying model [ 18 ] . This lack of true feasibility results in solutions that cannot be implemented in practice, or that are overly conservative due to the need for additional safety margins. To improve the robustness of MICL solutions, recent research has proposed ensemble-based approaches where multiple predictive models are trained on different bootstrap samples of the data [ 19 ] . In particular, Maragno et al. 2025 introduce a framework in which P models are independently trained on bootstrapped datasets, and the optimization is constrained so that a 1{-}\alpha fraction of these models must satisfy the imposed constraints. There is some empirical evidence that suggests that this heuristic yields solutions that are typically feasible with respect to the true underlying system, and its robustness improves as P increases. However, this approach lacks formal guarantees as there is no assurance that the final solution will satisfy the true constraints with high probability, particularly in the presence of model misspecification or low-quality data used in the MICL step. Moreover, the method suffers from key scalability issues: as P grows, the size of the optimization problem increases accordingly due to the replication of model constraints and auxiliary variables, rapidly making the problem computationally intractable for large ensembles. In this paper, we introduce Conformal Mixed-Integer Constraint Learning (C-MICL), a novel model-agnostic framework for incorporating data-driven constraints into optimization problems with formal probabilistic feasibility guarantees. Our method supports both regression and classification settings and is computationally efficient without sacrificing significant solution quality. Specifically: • Probabilistic Guarantees: We provide a new optimization formulation that guarantees ground-truth feasibility with probability at least 1{-}\alpha when the true constraint function is unknown or inaccessible, under a mild conditional independence assumption. • Model-Agnostic and MIP-Compatible: C-MICL is compatible with any predictive model that admits a MIP encoding, enabling integration into standard optimization solvers. • Scalability and Efficiency: Our method avoids query access or model refinement during optimization, does not scale with dataset size, and requires training at most two models, achieving orders-of-magnitude computational speedup over ensemble-based heuristics. • Empirical Validation: We demonstrate the effectiveness of C-MICL on real-world case studies in both regression and classification settings. Extensive experiments show that our method consistently achieves target feasibility levels, while delivering competitive objective values with significantly reduced computation times compared to state-of-the-art baselines. 2 Literature Review Mixed-Integer Constraint Learning. The mixed-integer constraint learning framework has enabled a wide range of developments in machine learning, including neural network verification [ 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 ] , adversarial example generation [ 28 , 29 , 30 ] , and applications in reinforcement learning [ 31 , 32 , 33 ] . It has also been successfully applied to domain-specific tasks in power systems [ 34 , 35 ] , healthcare [ 36 ] , supply chain management [ 37 , 38 ] , and chemical process design [ 39 ] . For a comprehensive overview of recent advances in constraint learning methodologies, we refer readers to Fajemisin et al. 2024 , and for a review focused on engineering applications, see Misener and Biegler 2023 . However, existing CL frameworks generally lack guarantees of true system feasibility, particularly in settings where predictive uncertainty from noisy data or model misspecification is prevalent but typically ignored. The approach proposed in this work directly addresses this gap by providing formal feasibility guarantees for uncertain learned constraints embedded into optimization problems. Trust-Region-Filter for Optimization. Trust region filter methods have been proposed as a strategy to optimize over learned constraints while ensuring that the solution aligns with that of the true, underlying system [ 18 ] . These approaches operate by iteratively refining the learned constraint through local sampling and evaluation of the truth function, progressively narrowing the optimization domain within trust regions where the learned model is accurate [ 41 , 42 ] . However, such methods rely on strong assumptions: they typically assume noise-free data, differentiability of the learned constraint, and direct query access to the truth function. In contrast, our framework is designed for settings where these assumptions do not hold. We account for noisy data, allow for non-differentiable learned models, and, most importantly, do not require access to or knowledge of the underlying function, enabling robust and feasible optimization even under limited and imperfect information. Conformal-Enhanced Optimization. Building on advances