Semi-Decision-Focused Learning with Deep Ensembles: A Practical Framework for Robust Portfolio Optimization
Juhyeong Kim · 2025
Read Semi-Decision-Focused Learning with Deep Ensembles: A Practical Framework for Robust Portfolio Optimization by Juhyeong Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-13544.txt.
Introduction
The authors reframe portfolio building as supervised learning in a 2025 paper. Robust investing needs allocations that survive market shifts. Prediction-first pipelines often misalign with actual decisions. Their framework trains models to output good portfolio weights directly.
Target weights come from optimizing classic risk-adjusted ratios. Cross-entropy loss teaches the model to match those targets. Deep ensembles then stabilize the predicted allocations. Variance across ensemble members shrinks as size grows. Backtests spanned diverse markets and network designs. The method beat traditional strategies in those tests. Leading machine learning approaches also fell behind it. Median returns rose with larger ensembles. Risk-adjusted performance grew steadier as well. Code is public for replication. The framework brands itself as practical rather than exotic. Portfolio teams can adopt it with standard tooling.
Catalog record
| CREATOR | Juhyeong Kim |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-13544
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semi-Decision-Focused Learning with Deep Ensembles: A Practical Framework for Robust Portfolio Optimization Juhyeong Kim Abstract I propose Semi-Decision-Focused Learning , a practical adaptation of Decision-Focused Learning for portfolio optimization. Rather than directly optimizing complex financial metrics, I employ simple target portfolios (Max-Sortino or One-Hot) and train models with a convex, cross-entropy loss. I further incorporate Deep Ensemble methods to reduce variance and stabilize performance. Experiments on two universes (one upward-trending and another range-bound) show consistent outperformance over baseline portfolios, demonstrating the effectiveness and robustness of my approach. Code is available at https://github.com/sDFLwDE/sDFLwDE 1 Introduction Machine learning technologies have transformed portfolio optimization, with numerous studies leveraging deep learning to automate and enhance the process. Recent work encompasses gradient-based learning methods ( Zhang et al. 2020 ) and Reinforcement Learning approaches ( Betancourt & Chen 2021 ; Chaouki et al. 2020 ; Jang & Seong 2023 ; Jiang et al. 2024 ; Koratamaddi et al. 2021 ; Yu et al. 2019 ; Acero et al. 2024 ; Sood et al. ) . Zhang et al. 2020 introduced the Sharpe ratio as an objective function, exemplifying a Decision-Focused Learning approach. Although theoretically sound, directly optimizing the Sharpe ratio often proves challenging in practice. Because the ratio is non-convex with respect to portfolio weights, such optimization can be unstable and prone to converging on suboptimal solutions. Moreover, deep learning model parameters typically exhibit complex, non-linear relationships with outputs, exacerbating the non-convexity and instability issues. Reinforcement Learning (RL) methods are also proposed for portfolio optimization. However, selecting appropriate RL algorithms and tuning their hyperparameters can be difficult. RL approaches are also inherently prone to uncertainty, leading to significant performance variability across different runs. Consequently, there is a pressing need for a more robust and practical machine learning strategy in portfolio optimization. One avenue for reducing predictive uncertainty is Deep Ensemble. Although ensembling increases computational overhead in proportion to the number of models, it significantly enhances prediction accuracy, calibration, and robustness ( Gupta et al. 2022 ) . Contribution. I propose the Semi-Decision-Focused Learning framework, which refines Decision-Focused Learning into a practical method for decision-making tasks. My approach reformulates the problem as supervised learning, using a straightforward loss function and target. I evaluate multiple deep sequence model architectures within this framework and observe variability in backtesting performance. To address this, I explore strategies to mitigate instability in portfolio optimization. Notably, I show that adopting a Deep Ensemble—aggregating and averaging predictions from multiple models—consistently reduces uncertainty and enhances overall portfolio optimization results. 2 Method 2.1 Preliminaries Decision-Focused Learning. Decision-Focused Learning directly optimizes decision-making objectives to solve a target problem. In contrast, Predict-then-Optimize or two-stage learning first predicts model parameters, then performs decision-making as a separate step. By unifying both stages under one objective, Decision-Focused Learning produces decisions that more closely align with the final task requirements. Predict-then-Optimize for portfolio optimization can be expressed with the following formulas: \text{Stage 1 objective: }\hat{\theta}=\argmin_{\theta}\mathcal{L}(\hat{y},y),\quad\hat{y}=f_{\theta}(x)\ (\text{Prediction}) \text{Stage 2 objective: }\hat{w}=\argmax_{w}\mathcal{P}(w,\hat{y})\quad(\text{Desion Making}) Here, \mathcal{L} is a loss function such as the mean squared error. The parameter \theta may represent the machine learning model’s weights, while y typically denotes the mean and covariance of returns. \mathcal{P} is a performance metric (e.g., Sharpe ratio), and w is the portfolio weights. Practitioners may impose constraints at the decision-making step. By contrast, Decision-Focused Learning unifies two stages and optimizes a single objective: \text{Objective: }\hat{\theta}=\argmax_{\theta}\mathcal{P}(\hat{w},y),\quad\hat{w}=f_{\theta}(x)\ (\text{Model}) Deep Ensemble. Deep Ensemble enhances output quality by aggregating the predictions of multiple deep learning models, each initialized independently. It has been shown to improve prediction performance, calibration, and robustness ( Gupta et al. 2022 ) . Conceptually, Deep Ensemble reduces the variance of the overall prediction. Suppose I have multiple models f_{1},f_{2},\ldots,f_{m} . If I assume \mathbf{Var}[f_{i}(x)]=\sigma^{2} and \mathbf{Cov}[f_{i},f_{j}]=\rho\sigma^{2} for i\neq j , then \mathbf{Var}[\bar{f}(x)]=\frac{\sigma^{2}\bigl(1+(m-1)\rho\bigr)}{m},\quad\text{where}\quad\bar{f}(x)=\frac{1}{m}\sum_{i=1}^{m}f_{i}(x). Details of this derivation appear in Appendix A.1 . When \rho<1 , the correlation among individual model predictions is less than one, reducing the overall variance. This condition typically holds in a Deep Ensemble because each Deep Learning model is trained independently with different initializations and produces different outputs for the same input. 2.2 Semi-Decision-Focused Learning with Deep Ensemble Semi-Decision-Focused Learning. I introduce Semi-Decision-Focused Learning to achieve the benefits of Decision-Focused Learning in a stable, practical manner. My framework treats the decision-making task as a supervised learning problem by employing cross-entropy loss with a precomputed, hypothetically optimal portfolio as the target. Unlike Zhang et al. 2020 , I use a cross-entropy loss function that is convex with respect to the model outputs. I refer to my approach as Semi-Decision-Focused Learning because, although the model is trained to perform decision-making, the loss function is not a direct performance metric of that decision-making task. Nevertheless, random parameter initialization introduces inherent uncertainty in deep learning models, which can significantly affect portfolio optimization performance. To mitigate this, I use Deep Ensemble—aggregating predictions from multiple independent models—to stabilize outcomes. I compute ensemble portfolio weights that are less sensitive to any single model’s initialization. 3 Experiment 3.1 Experiment Settings Universe. I evaluate my portfolio optimization approach on two distinct universes. Universe 1 comprises 24 equities that generally trend upward, while Universe 2 consists of 84 equities that remain largely range-bound. Target Portfolios. As described in Section 2.2 , my framework relies on hypothetically optimal portfolios as training targets. I investigate two such portfolios. The first is a Max-Sortino portfolio, computed using the means and semi-variances of future returns. The second is a One-Hot portfolio that invests entirely in the equity with the highest future return. All portfolios in this study refer Long-Only portfolio. Each portfolio for the sample period is visualized in Appendix A.4 Models. I employ three widely used deep sequence architectures: LSTM ( Hochreiter & Schmidhuber 1997 ) , Transformer (TRF) ( Vaswani et al. 2017 ) , and Mamba ( Gu & Dao 2024 ) . Additional Details. Further experimental settings are described in Appendix A.2 . 3.2 Experiment Results Figure 1: Backtesting Performance. I perform backtesting under a 40 bp trading cost and a two-day lag for rebalancing. Each curve represents cumulative returns starting at 1 at the beginning of the backtesting period. Results reflect ensemble weights aggregated from 100 independently trained models. The y-axis represents cumulative returns. Universe 1 Universe 2 CR SHR SOR CR SHR SOR Baseline Equal Weight 3.014 0.884 1.391 1.749 0.416 0.653 Value Weight 4.462 0.860 1.362 1.728 0.354 0.566 mSSRM PGA 2.799 0.890 1.435 1.777 0.436 0.687 DL4PO 1.408 0.219 0.341 1.976 0.388 0.642 My Method Mamba Max-Sortino 5.760 1.007 1.577 1.887 0.397 0.646 TRF Max-Sortino 4.013 0.981 1.546 1.870 0.447 0.713 LSTM Max-Sortino 7.123 0.938 1.510 1.817 0.352 0.574 Mamba One-hot 6.957 0.868 1.410 2.685 0.530 0.894 TRF One-hot 6.007 0.953 1.533 1.751 0.367 0.587 LSTM One-hot 6.848 0.755 1.237 1.659 0.257 0.430 Table 1: Backtesting Performance. I conduct portfolio optimization experiments on two universes. Each backtest uses an ensemble of 100 models. CR denotes cumulative return. SHR and SOR refer to the Sharpe and Sortino ratios, respectively (§ A.3 ). Best performances are highlighted. Figure 1 presents the backtesting performance metrics. mSSRM PGA , proposed by Lin et al. 2024 , is treated as a maximum-Sharpe portfolio by setting m to the number of items in the universe without