Prediction Loss Guided Decision-Focused Learning

Haeun Jeon, Hyunglip Bae, Chanyeong Kim, Yongjae Lee \corresponding, Woo Chang Kim \corresponding · 2025

Read Prediction Loss Guided Decision-Focused Learning by Haeun Jeon, Hyunglip Bae, Chanyeong Kim, Yongjae Lee \corresponding, Woo Chang Kim \corresponding (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-08359.txt.

Introduction

Predict first, optimise second is the usual pipeline for decisions under uncertainty, and Haeun Jeon with 4 co-authors blend its two rival training styles in a 2025 machine learning paper. Prediction-focused learning is stable but ignores whether predictions lead to good decisions. Decision-focused learning trains on decision quality directly, yet its loss landscapes mix flat and sharp regions, so convergence wobbles even with good gradients.

Prediction loss is brought in as a guide to steady the decision-focused training. The hybrid aims at decisions that are both well-aimed and reliably reached. Portfolio choices, inventory orders, and energy dispatch all share this predict-then-decide shape, and all suffer when a forecaster optimises the wrong scoreboard.

Catalog record

CREATORHaeun Jeon, Hyunglip Bae, Chanyeong Kim, Yongjae Lee \corresponding, Woo Chang Kim \corresponding
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-08359

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Prediction Loss Guided Decision-Focused Learning Haeun Jeon, Hyunglip Bae, Chanyeong Kim, Yongjae Lee \corresponding, Woo Chang Kim \corresponding Abstract Decision‑making under uncertainty is often considered in two stages: predicting the unknown parameters, and then optimizing decisions based on predictions. While traditional prediction-focused learning (PFL) treats these two stages separately, decision-focused learning (DFL) trains the predictive model by directly optimizing the decision quality in an end-to-end manner. However, despite using exact or well-approximated gradients, vanilla DFL often suffers from unstable convergence due to its flat-and-sharp loss landscapes. In contrast, PFL yields more stable optimization, but overlooks the downstream decision quality. To address this, we propose a simple yet effective approach: perturbing the decision loss gradient using the prediction loss gradient to construct an update direction. Our method requires no additional training and can be integrated with any DFL solvers. Using the sigmoid-like decaying parameter, we let the prediction loss gradient guide the decision loss gradient to train a predictive model that optimizes decision quality. Also, we provide a theoretical convergence guarantee to Pareto stationary point under mild assumptions. Empirically, we demonstrate our method across three stochastic optimization problems, showing promising results compared to other baselines. We validate that our approach achieves lower regret with more stable training, even in situations where either PFL or DFL struggles. 1 Introduction We study decision-making under uncertainty through the model a^{*}(y)\;=\;\arg\min_{a\in\mathcal{A}}\,f(a,y)\quad\text{with}\quad y\;=\;M_{\theta}(x), (1) with decision variable a , uncertain parameter y , known feasible set \mathcal{A} , objective function f , and a predictive model M_{\theta} parameterized by \theta that maps input features x to an estimate of y . This two‐stage formulation underlies a variety of applications such as vehicle routing, portfolio optimization, inventory control, and the knapsack problem, where one first forecasts the uncertain parameters and then solves for the optimal decision ( Mandi et al. 2020 ; Elmachtoub and Grigas 2022 ; Donti, Amos, and Kolter 2017 ; Wilder, Dilkina, and Tambe 2019 ) . Traditionally, such problems have been addressed via the predict-focused learning (PFL) paradigm. A predictive model in PFL is trained solely to minimize the error between M_{\theta}(x) and the true parameter y . Once trained, these forecasts are fed into a downstream optimizer to select a^{*} . The underlying belief in PFL is that good predictions will yield better decisions; yet even small forecast errors can cascade into horrible decisions. Consequently, in practice, prediction and optimization are deeply entwined and cannot always be decoupled without loss of performance. To bridge this gap, decision-focused learning (DFL) has been developed. DFL embeds the optimization layer into the training loop by defining a decision loss that measures the quality of decisions. Then, the decision loss is backpropagated through the solver. This backpropagation requires special techniques such as implicit differentiation via KKT conditions ( Amos and Kolter 2017 ; Donti, Amos, and Kolter 2017 ) , perturbation-based gradient estimators ( Wilder, Dilkina, and Tambe 2019 ) , or fully differentiable convex optimization layers ( Agrawal et al. 2019 ) to obtain gradients for end-to-end training. Despite leveraging exact or well-approximated gradients, vanilla DFL often shows unstable convergence behavior. Its decision loss landscape exhibits abrupt jumps and flat regions ( Bansal et al. 2024 ) . To mitigate these geometric hurdles, researchers have introduced smooth surrogate losses and objectives that blend prediction and decision losses, aiming for stable training. However, these existing approaches suffer from three key limitations. First, many are tailored to a narrow class of optimization problems and cannot be easily generalized to other decision-making settings. Second, learning the surrogate loss models often incurs substantial computational overhead, undermining their practicality for large-scale or time-sensitive applications. Third, by relying on a fixed weighting scheme to combine prediction and task losses, they lack the flexibility to dynamically adjust the balance between prediction and decision loss as training progresses. In this paper, we begin with a geometric analysis showing discrepancies in both direction and magnitude between PFL and DFL gradients, caused by their distinct loss landscape structures. Building on this insight, we propose Prediction Loss Guided Decision-Focused Learning , a gradient-perturbation framework that injects prediction loss gradients into the decision loss update. We compute a new descent direction by bisecting the angle between the two gradient vectors and then shifting toward the decision loss gradient under a tunable parameter \kappa . We prove that our model with \kappa=0 converges to a Pareto stationary point. Finally, through experiments on three stochastic optimization tasks, we demonstrate that our method outperforms baselines in minimizing decision loss. Overall, this paper makes the following contributions: • We avoid constructing any surrogate loss models. Our method directly perturbs the original gradients, reducing the computational overhead compared to existing surrogate loss approaches. • Our method can be combined with any vanilla DFL algorithms, making it universally applicable across diverse frameworks. • To our knowledge, this is the first study to explicitly adjust the DFL gradient direction (rather than tweaking the loss) to boost decision-making performance. • We provide the in-depth geometric comparison that quantifies the directional and magnitude discrepancies between prediction and decision loss gradients. • We prove that our method converges to a Pareto stationary point under mild assumptions. • We conduct experiments on three stochastic optimization problems and demonstrate that our method outperforms other baselines. 2 Related Works Decision-Focused Learning Gradient-based DFL has been explored through several complementary strategies ( Mandi et al. 2023 ) . One line of work directly differentiates through the constrained optimization layer: convex quadratic programs have been handled by applying KKT-based backpropagation with OptNet for efficiency ( Amos and Kolter 2017 ; Donti, Amos, and Kolter 2017 ) , and this idea was generalized to arbitrary convex problems via the differentiable solver Cvxpylayers ( Agrawal et al. 2019 ) . A second family of methods smooths the mapping from predicted parameters to decisions by adding regularizer. Examples include appending the Euclidean norm of decision variables to enable quadratic programming based differentiation ( Wilder, Dilkina, and Tambe 2019 ) , incorporating a logarithmic barrier to make linear programs differentiable ( Mandi and Guns 2010 ) , and using entropy penalties to tackle multi‐label tasks ( Martins and Kreutzer 2017 ; Amos, Koltun, and Kolter 2019 ) . Perturb-and-MAP frameworks further regularize via random perturbations to the objective or constraints ( Papandreou and Yuille 2011 ; Niepert, Minervini, and Franceschi 2021 ; Berthet et al. 2020 ) . More recently, researchers have designed explicit surrogate losses to approximate the true task loss in a differentiable way. The SPO+ loss ( Elmachtoub and Grigas 2022 ) provides a convex upper bound with computable subgradients; NCE ( Mulamba et al. 2020 ) and its ranking extension LTR ( Mandi et al. 2022 ) derive loss families via noise‐contrastive estimation; SO-EBM ( Kong et al. 2022 ) employs an energy‐based layer as a proxy optimizer; and LODL ( Shah et al. 2022 ) builds local parametric surrogates (e.g. WeightedMSE, Quadratic) around each instance, later extended to a global model in EGL ( Shah et al. 2024 ) and LANCER ( Zharmagambetov et al. 2024 ) . Most recently, a Lipschitz‐continuous perturbation gradient loss has been proposed whose approximation error vanishes with increasing samples ( Huang and Gupta 2024 )

Read the complete text