Machine Learning Algorithms for Improving Exact Classical Solvers in Mixed Integer Continuous Optimization
Morteza Kimiaei · 2025
Read Machine Learning Algorithms for Improving Exact Classical Solvers in Mixed Integer Continuous Optimization by Morteza Kimiaei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06906.txt.
Introduction
Morteza Kimiaei and co-authors survey learning-aided exact solvers in twenty twenty-five. Mixed integer optimization drives logistics, energy, and scheduling, but it is computationally hard. Machine learning might speed up exact methods such as branch-and-bound. The challenge is to gain speed without giving up guaranteed optimality.
The survey covers discrete, continuous, and mixed-integer problem forms. Applications include vehicle routing, hydropower planning, and crew scheduling. A unified branch-and-bound framework embeds learning at several points. Branching, cut selection, node ordering, and parameter control can all be learned. Supervised, imitation, and reinforcement learning each appear. The authors close with a taxonomy by solver class and learning style, plus open challenges.
Catalog record
| CREATOR | Morteza Kimiaei |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 132 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-06906
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Machine Learning Algorithms for Improving Exact Classical Solvers in Mixed Integer Continuous Optimization Morteza Kimiaei Abstract Abstract. Integer and mixed-integer nonlinear programming (INLP, MINLP) are central to logistics, energy, and scheduling, but remain computationally challenging. This survey examines how machine learning and reinforcement learning can enhance exact optimization methods—particularly branch-and-bound (BB)—without compromising global optimality. We cover discrete, continuous, and mixed-integer formulations, and highlight applications such as crew scheduling, vehicle routing, and hydropower planning. We introduce a unified BB framework that embeds learning-based strategies into branching, cut selection, node ordering, and parameter control. Classical algorithms are augmented using supervised, imitation, and reinforcement learning models to accelerate convergence while maintaining correctness. We conclude with a taxonomy of learning methods by solver class and learning paradigm, and outline open challenges in generalization, hybridization, and scaling intelligent solvers. 1 Introduction Machine Learning (ML) and Reinforcement Learning (RL) have garnered increasing attention in recent years due to their ability to model complex relationships, learn from data, and enhance algorithmic decision-making. These capabilities are particularly promising in the domain of discrete optimization, where classical methods often struggle with scalability. In the context of Integer Programming (IP) and Mixed-Integer Programming (MIP), core problem classes in Operations Research, ML, and RL have emerged as powerful tools for enhancing the efficiency and scalability of exact solution methods. Solving large-scale (M)IPs remains a fundamental challenge due to their combinatorial complexity. The solution space typically grows exponentially with the number of variables and constraints, especially when the problem lacks exploitable structure. As a result, many instances become computationally intractable, posing significant obstacles in high-stakes applications such as logistics, scheduling, and transportation, where timely and optimal decisions are crucial. ML models, especially when embedded within algorithmic frameworks, can leverage empirical data to learn patterns or decision policies that improve solver performance. These models often exhibit strong scalability with respect to input size. They can inform key algorithmic choices, such as branching decisions, node selection, and heuristic design, thereby complementing or accelerating traditional optimization techniques. Despite their theoretical convergence guarantees, exact MINLP solvers often suffer from exponential branching complexity and inefficient heuristics, especially in real-time or data-rich settings. ML and RL models offer adaptive control strategies that enhance solver performance while preserving correctness—enabling scalable deployment in domains such as energy optimization, autonomous planning, and supply chain scheduling. In this paper, we review recent developments in ML and RL techniques aimed at improving the solution of IP and MIP problems. Our focus is specifically on the integration of learning-based methods within exact solution paradigms , those that provide guarantees of global optimality, as opposed to purely heuristic or approximate methods. We begin by outlining classical solution approaches for (M)IPs and then examine how learning-based strategies are being incorporated into or reshaping these methods. The main contributions of this survey can be summarized as follows: • Comprehensive review of exact MINLP solver components. We provide a systematic overview of the core components of exact solvers for Integer, Continuous, and Mixed-Integer Nonlinear Programming problems, with a particular focus on the Branch-and-Bound ( BB ) framework and its integration points for data-driven enhancement. • Unification of ML and RL strategies within a solver-centric taxonomy. We propose a unified classification of ML and RL approaches according to the solver component they augment—covering branching, node selection, cut management, parameter tuning, decomposition strategies, and surrogate modeling—alongside the learning paradigm (supervised, imitation, reinforcement). • Synthesis of prior work and positioning within the literature. We review and contrast previous surveys on ML and RL for exact optimization methods, identifying overlaps, differences in scope, and gaps in coverage. Our work situates recent contributions within a broader methodological and application-oriented context. • Detailed analysis of ML- and RL-enhanced BB methods. We examine in depth the state-of-the-art in learning-based branching decision prediction, relaxation quality estimation, cut selection, node selection, adaptive search control, and parameter tuning, highlighting both algorithmic design choices and empirical performance trends. • Application mapping and practical relevance. We link the discussed methods to high-impact application domains—such as crew scheduling, vehicle routing, facility location, and hydropower scheduling—demonstrating how learned solver policies can accelerate convergence without compromising global optimality. • Identification of challenges and research directions. We outline open issues in generalization across problem classes, data efficiency in training, hybrid symbolic–ML/RL solver architectures, explainability, and the scaling of intelligent solvers to large, real-world instances. Collectively, these contributions aim to provide both a consolidated entry point for researchers new to the topic and a structured reference for practitioners seeking to integrate ML and RL techniques into exact optimization pipelines. 2 Background - Integer and Mixed Integer Programming Problems We begin by presenting a comprehensive set of problem formulations that involve integer, continuous, or mixed-integer decisions. Computationally, it can be seen that many of the distinct formulations are equivalent. However, the distinct choices of space, that is, integers, sets, etc., can, together with the form of the functions and expressions, provide insight into the structure facilitating solution methods. Unlike with continuous decisions, wherein local first-order variations approximate a gradient flow, and thus a direction of monotonic decrease for a variational formulation of the problem, with discrete problems, local considerations are no longer front and center of consideration for finding extrema. That is not to say they are not important, but that these considerations must be appropriately tuned to the space and context, and carefully combined with considerations more native to combinatorics – of counting and global search. 2.1 Foundation — Integer Structures The fundamental distinction between continuous and discrete optimization, or more broadly, computational research, lies in the underlying solution space. Continuous optimization operates within topological vector spaces and normed functional spaces, where natural notions of continuity, ordering, and satisfaction are derived from the structure of the real numbers, complete fields supporting calculus and gradient-based reasoning. Variational calculus, in particular, exploits these continuous properties to derive optimality conditions via differential information, assuming connected domains and smooth trajectories through feasible regions. In contrast, discrete mathematics (cf. [ 16 ] ) entails a qualitatively different landscape, where continuity is absent and problems must be modeled using finite or countably infinite sets. At the foundation of this divergence lies the classical result of Cantor: the cardinality of the real numbers is 2^{\aleph_{0}} , strictly greater than that of the natural numbers \aleph_{0} . This distinction underpins two major mathematical paradigms—those of continuity and those of discrete counting. Focusing on the latter, discrete optimization problems—including integer and mixed-integer programming—primarily operate over structured subsets of the integers. While discrete mathematics spans diverse objects such as graphs, permutations, and finite sets, the class of problems with integer-valued variables reflects a deep algebraic structure. Integer lattices, in particular, support natural orderings and arithmetic operations that can be exploited algorithmically. These problems are typically defined over \mathbb{Z}^{n} (or subsets thereof), where the absence of convexity and differentiability challenges the application of standard continuous techniques. The presence of an ordering is essential for defining optimization: a clear notion of what constitutes more or less of some quantity. In integer spaces, this is often provided by the standard total order on \mathbb{Z} or by partial orders in structured sets like lattices. Optimization then becomes the task of identifying the minimal or maximal element, under an ordering