Prediction-Enhanced Monte Carlo: A Machine Learning View on Control Variate
Fengpei Li ∗ 1 ‡ {\ddagger}, Haoxian Chen ∗ 1 †, Jiahe Lin ∗ 1, Arkin Gupta 1, Xiaowei Tan 1, Honglei Zhao 1, Gang Xu 1, Yuriy Nevmyvaka 1, Agostino Capponi 2, Henry Lam 2 · 2024
Read Prediction-Enhanced Monte Carlo: A Machine Learning View on Control Variate by Fengpei Li ∗ 1 ‡ {\ddagger}, Haoxian Chen ∗ 1 †, Jiahe Lin ∗ 1, Arkin Gupta 1, Xiaowei Tan 1, Honglei Zhao 1, Gang Xu 1, Yuriy Nevmyvaka 1, Agostino Capponi 2, Henry Lam 2 (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-11257.txt.
Introduction
A team of ten authors, led by Fengpei Li, Haoxian Chen, and Jiahe Lin, presents Prediction-Enhanced Monte Carlo in 2024. Monte Carlo runs give clean error bounds but can be too slow for nested or path-based tasks. Pure machine learning swaps are fast yet add bias that is hard to measure.
Their frame uses a learned model fed by cheap runs to cut spread while keeping results unbiased. Tests cover equity products, interest rate products, and ambulance dispatch with hospital load balance. In each case the method cut spread and run time against the standard Monte Carlo base line.
Catalog record
| CREATOR | Fengpei Li ∗ 1 ‡ {\ddagger}, Haoxian Chen ∗ 1 †, Jiahe Lin ∗ 1, Arkin Gupta 1, Xiaowei Tan 1, Honglei Zhao 1, Gang Xu 1, Yuriy Nevmyvaka 1, Agostino Capponi 2, Henry Lam 2 |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-11257
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Prediction-Enhanced Monte Carlo: A Machine Learning View on Control Variate Thanks: ∗ Equal Contribution. 1 Morgan Stanley. 2 Department of IEOR, Columbia University. † The work was done during empolyment at Morgan Stanley. ‡ Corresponding author: [email protected] Fengpei Li ∗ 1 ‡ {\ddagger}, Haoxian Chen ∗ 1 †, Jiahe Lin ∗ 1, Arkin Gupta 1, Xiaowei Tan 1, Honglei Zhao 1, Gang Xu 1, Yuriy Nevmyvaka 1, Agostino Capponi 2, Henry Lam 2 Abstract . For many complex simulation tasks spanning areas such as healthcare, engineering, and finance, Monte Carlo (MC) methods are invaluable due to their unbiased estimates and precise error quantification. Nevertheless, MC simulations often become computationally prohibitive, especially for nested, multi-level, or path-dependent evaluations lacking effective variance reduction techniques. While machine learning (ML) surrogates appear as natural alternatives, naïve replacements typically introduce unquantifiable biases. We address this challenge by introducing Prediction-Enhanced Monte Carlo (PEMC), a framework that leverages modern ML models as learned predictors , using cheap and parallelizable simulations as features , to output unbiased evaluations with reduced variance and runtime. As a result, PEMC eliminates the closed-form-mean requirement that constrains classical control-variate methods, preserves unbiasedness and explicit confidence intervals of MC, and achieves scheme-wide variance reduction. Our theoretical analysis quantifies the optimal allocation between expensive evaluations and large batches of cheap, parallelizable feature draws. Across three representative applications—variance-swap pricing under stochastic-local-volatility, swaption pricing under Heath–Jarrow–Morton models, and ambulance diversion policy evaluation—we show that PEMC reduces root-mean-squared error by 30–55% relative to standard MC at similar computational cost. \markleft Li et al. Key words : Monte Carlo methods, Exotic Options Pricing, Control Variates, Variance Swaps, Swaptions. 1. Introduction Monte Carlo (MC) is a fundamental tool for evaluating complex stochastic models where closed-form solutions are unavailable. Its main strengths—unbiasedness and rigorous uncertainty quantification through variance estimation and confidence intervals—make it essential in high-stakes, high-complexity applications such as healthcare resource allocation and financial risk management, where fairness or regulatory compliance are crucial. For example, transparent and bias-aware methods in healthcare are vital to ensure equitable outcomes and prevent disparities in care access [ 113 , 77 , 42 ] . Similarly, financial risk assessments rely on MC estimation to support hedging, re-balancing decisions, and valid error bounds, as minor biases in financial simulations can accumulate [ 30 ] . Despite these advantages, classical MC faces significant challenges in nested, multilevel, or path-dependent simulations that are difficult to parallelize. Complex stochastic dynamics can make each sample path extremely costly to generate—sometimes taking hours for one sample (e.g., to estimate credit valuation adjustments in over-the-counter contracts, see [ 63 ] )—and effective variance reduction methods are often unavailable [ 9 ] . Consequently, MC’s inherent \mathcal{O}(1/\sqrt{n}) convergence rate often prohibits real-time decision-making with adequate precision. This is the case, for example, in the context of pricing of exotic options, where sample paths need to be generated sequentially under complex dynamics, making parallelization not easily achievable [ 61 ] . These computational challenges are critical in financial derivative pricing, as highlighted in the literature, for example, in [ 74 , Chapter 21] and [ 30 , Chapter 4] . Similar computational bottlenecks arise in healthcare simulation, where modeling complex patient flows and hospital operations can require extensive computation time but transparent and bias-aware methods are crucial to ensure equitable outcomes [ 113 , 77 , 42 ] . Conversely, machine learning (ML) based predictive modeling has emerged as a fast alternative for approximating MC evaluations, including pricing financial derivatives [ 75 , 53 , 15 ] . Neural networks and other ML techniques can learn complex mappings and, once trained, can generate predictions at negligible marginal cost - what practitioners often call “fast evaluation" [ 73 ] . However, their black-box nature and lack of inherent statistical control hinder the quantification of errors, rendering them unsuitable for tasks requiring rigorous reliability assessments, such as high-stakes applications in risk management [ 75 , 32 ] . Thus, MC and ML represent opposite ends of the spectrum: MC is reliable and uncertainty quantifiable but intrinsically slow, while ML is computationally fast but falls short in statistical guarantees. Given this trade-off between the speed of ML and the reliability of MC, a natural question arises: can we design a method that combines both advantages while avoiding their respective pitfalls? In this paper, we provide a positive answer by introducing the Prediction-Enhanced Monte Carlo (PEMC) framework. PEMC leverages predictive ML modeling to replace a large portion of costly simulations with cheap/parallelizable samples from ML models, reducing variance on a scheme-wide level. Moreover, despite relying on black-box predictive models, PEMC maintains unbiasedness, balancing computational savings with rigorous statistical guarantees. 1.1. Our Contributions PEMC innovates in two aspects. First, PEMC integrates ML predictive models into any MC baseline while preserving unbiasedness and error quantification of MC. Specifically, we show how the predictive modeling of ML combined with cheap, parallelizable samples will result in a reduction of variance and costly samples, enhancing real-time efficiency for complex MC simulations. Second, PEMC can also be viewed as a modernized variant of the control variate (CV) technique, a classical approach that reduces MC variance via auxiliary outputs whose known mean offsets random fluctuations [ 61 , 9 , 98 ] . Unfortunately, the classical CV approach, which requires a closed-form expression for the mean of a correlated auxiliary output, often becomes unavailable in many modern applications or complex stochastic systems, effectively barring the use of CV. To explain concretely the second point above, our PEMC framework bridges ML with MC by substantially enlarging the scope of CV to many ML candidates. The key idea is the following: In the traditional CV framework, the known mean of CV is used to achieve a per-replication variance reduction while maintaining unbiasedness, i.e., the variance is reduced even if we run just one simulation replication. While this is a powerful feature, it comes at the cost of significantly limiting CV’s applicability, due to the requirement of a closed-form expression for the mean. However, if the CV itself is computationally cheap in the sense of being estimatable with fast simulation, then we can afford to run plenty of additional MC separately from the original MC to estimate its mean. This would preserve unbiasedness and overall estimation variance relative to the total computation cost, as long as we consider efficiency improvement at the scheme-wide level. That is, in the PEMC framework, we consider total cost-aware instead of per-replication variance reduction, through which we relax the crucial requirement of known CV mean, and this in turn allows us to substantially expand the CV methodology to cover modern ML models. The alignment of our framework with the use of ML predictions prompts us to regard PEMC as a modernized view of CV. 1.2. Literature Review The literature on enhancing MC simulations with ML approximators is extensive, yet many existing ML-based methods for CV and variance reduction impose restrictive conditions that appear to limit their practical applicability. Approaches such as reproducing Stein kernels [ 102 , 89 ] , Neural CV derived from Stein’s identity [ 132 , 83 ] , regularized least squares for CV construction [ 109 , 124 , 86 ] , adaptive CV schemes [ 67