Variational Inference for Lévy Process-Driven SDEs via Neural Tilting

Yaman Kındap, Manfred Opper, Benjamin Dupuis, Umut Şimşekli, Tolga Birdal, [0.75em] Imperial College London, UK · 2026

Read Variational Inference for Lévy Process-Driven SDEs via Neural Tilting by Yaman Kındap, Manfred Opper, Benjamin Dupuis, Umut Şimşekli, Tolga Birdal, [0.75em] Imperial College London, UK (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10934.txt.

Introduction

Yaman Kındap and four colleagues bring variational inference to Lévy-driven stochastic differential equations, the jump-heavy models behind extreme events in finance, climate, and safety-critical AI. Monte Carlo methods are rigorous but slow, while neural variational methods assume Gaussian shapes that miss jumps.

Their neural exponential tilting reweights the Lévy measure with neural networks, keeping jump structure while staying tractable. A quadratic setup gives closed-form normalization, a bell-curve view steadies simulation, and symmetry-aware estimators scale optimization. Tests show accurate capture of jump behavior where bell-curve methods fail. Modelers of extremes get a fast, faithful inference toolkit.

Catalog record

CREATORYaman Kındap, Manfred Opper, Benjamin Dupuis, Umut Şimşekli, Tolga Birdal, [0.75em] Imperial College London, UK
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE85695
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.10934

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Variational Inference for Lévy Process-Driven SDEs via Neural Tilting Yaman Kındap, Manfred Opper, Benjamin Dupuis, Umut Şimşekli, Tolga Birdal, [0.75em] Imperial College London, UK Abstract Modelling extreme events and heavy-tailed phenomena is central to building reliable predictive systems in domains such as finance, climate science, and safety-critical AI. While Lévy processes provide a natural mathematical framework for capturing jumps and heavy tails, Bayesian inference for Lévy-driven stochastic differential equations (SDEs) remains intractable with existing methods: Monte Carlo approaches are rigorous but lack scalability, whereas neural variational inference methods are efficient but rely on Gaussian assumptions that fail to capture discontinuities. We address this tension by introducing a neural exponential tilting framework for variational inference in Lévy-driven SDEs. Our approach constructs a flexible variational family by exponentially reweighting the Lévy measure using neural networks. This parametrization preserves the jump structure of the underlying process while remaining computationally tractable. To enable efficient inference, we develop a quadratic neural parametrization that yields closed-form normalization of the tilted measure, a conditional Gaussian representation for stable processes that facilitates simulation, and symmetry-aware Monte Carlo estimators for scalable optimization. Empirically, we demonstrate that the method accurately captures jump dynamics and yields reliable posterior inference in regimes where Gaussian-based variational approaches fail, on both synthetic and real-world datasets. 1 Introduction Real-world stochastic systems, from financial markets to climate dynamics and safety-critical AI, generate observations exhibit sudden discontinuities, asymmetric shocks, and extreme events whose probability decays as a power law x^{-\alpha} rather than exponentially. This heavy-tailed structure is a defining property of many consequential phenomena, not an anomalous departure from Gaussianity. Models that approximate it with Gaussian noise are therefore systematically miscalibrated at the extremes, where the cost of error is highest. The natural mathematical language for this full class of stochastic behaviour is the theory of infinitely divisible distributions and associated Lévy processes, which form the complete family of processes with independent and stationary increments ( 19 ; 27 ) . Providing tractable approximate Bayesian inference over latent trajectories in Lévy process-driven stochastic differential equations (SDEs) would therefore yield a principled, uncertainty-aware framework for modelling temporal dynamics across any domain where the data-generating process departs from Gaussianity. Neural SDE and ODE approaches have transformed continuous-time sequence modelling by providing end-to-end differentiable, scalable frameworks competitive on standard benchmarks ( 9 ; 55 ; 28 ; 40 ; 12 ) , with recent extensions such as Neural Jump SDEs ( 25 ) and Neural MJD ( 18 ) explicitly incorporating discontinuities and achieving strong results on time series with abrupt changes. Deep time-series forecasters, including DeepAR, DLinear, and N-HiTS ( 49 ; 60 ; 8 ) , achieve state-of-the-art performance on standard benchmarks through flexible, data-driven parametrizations without any differential equation structure. Yet all of these methods share a fundamental limitation. They model noise, including jump magnitudes, with light-tailed distributions and fit their parameters by maximum likelihood. This commits each model to a parametric noise structure calibrated to average behaviour, yielding predictions that are systematically overconfident at extreme quantiles, the failure mode that heavy-tailed phenomena directly expose, as shown in Figure 1 . Figure 1: Posterior sample paths for two representative realisations of the OU (left pair) and double-well (right pair) systems, comparing the Gaussian SDE and our tilted-stable model. This leaves a critical gap: no tractable framework exists for posterior inference over the latent dynamics of a Lévy-driven SDE, leaving jump structure as a fixed parametric assumption rather than a latent quantity to be inferred from data. Existing variational inference (VI) methods for stochastic processes obtain tractable path-space objectives through Brownian change-of-measure formulas, but these cannot produce posterior inference over the Lévy measure. Continuous variational processes are singular with respect to jump processes, and Brownian drift corrections in jump-diffusions leave the jump law unchanged. We close this gap by learning a neural exponential tilt of the prior Lévy measure, preserving the end-to-end differentiability and scalability of neural methods while yielding a tractable variational posterior with explicit jump and drift contributions to the ELBO. Our contributions are : • A path-space VI framework for Lévy-driven SDEs that derives the optimal Markov variational posterior as an exponential tilt of the prior Lévy measure. • Neural Tilting : a quadratic neural parametrisation of the tilting function that preserves flexible state- and time-dependent posterior jump behaviour while yielding closed-form normalising constants. • Efficient simulation and ELBO optimisation algorithms that exploit the conditionally Gaussian representation of stable processes and the symmetry of their Lévy measures. • Empirical validation on synthetic and real-world datasets showing that the framework recovers heavy-tailed jump dynamics and improves tail calibration where Gaussian baselines fail. Our source code will be made publicly available under: circle-group.github.io/research/NeuralTilting . 2 Related work Simulation and data-driven methods for Lévy systems Numerical methods for Lévy-driven SDEs build on time-discretisation schemes 42 ; 17 , with variance reduction via multilevel Monte Carlo 15 ; 24 , adaptive grids 30 , and exact simulation 41 . Continuous-time formulations 7 ; 29 and conditionally Gaussian jump representations 21 ; 31 improve efficiency; the latter technique is extended in our work from the prior Lévy measure to the exponentially tilted posterior. Data-driven approaches recover Lévy dynamics from observations via stable distribution properties 34 and Koopman operator methods 35 . Despite exactness or arbitrarily small discretisation error, all of these methods lack end-to-end differentiability, precluding integration with modern ML pipelines. Neural differential equation models Neural ODEs 9 and their stochastic extensions provide scalable, end-to-end differentiable continuous-time sequence models, with scalable adjoint gradients 33 and expressive latent architectures 28 . Extensions incorporate fractional white noise 54 and rough-path-driven jump dynamics 22 , and training efficiency has been substantially improved via stochastic optimal control 12 . All of these methods are restricted to continuous-path dynamics, precluding heavy-tailed jump behaviour. Jump-diffusion and Markov jump process models A complementary line introduces jump structure into neural dynamical models: 25 extends neural ODEs with event-driven latent discontinuities, 18 combines a neural Itô diffusion with a compound Poisson process, and 61 reformulates temporal point processes as neural jump-diffusion SDEs. All restrict jump magnitudes to light-tailed distributions, with no capacity to represent heavy-tailed Lévy geometry. A parallel line targets discrete-state Markov jump processes (MJPs) via variational mean-field approximations 39 , neural ODE rate functions 50 , expectation propagation 16 , and zero-shot foundation models 4 ; these address discrete state spaces rather than continuous heavy-tailed dynamics. Deep time-series forecasters Recurrent networks with parametric likelihoods 49 , hierarchical interpolation 8 , linear models 60 , and normalising flows conditioned on sequential context 44 achieve strong benchmark performance. Score-based diffusion models 43 ; 53 ; 37 ; 38 and interpretable diffusion architectures 58 provide richer generative distributions. Distribution-free calibration via conformal prediction 52 ; 56 ; 59 provides coverage guarantees independently of the noise model. All of these methods are restricted to light-tailed parametric noise distributions, with no capacity to represent heavy-tailed jump geometry. Variational inference (VI) for stochastic processes VI for stochastic processes typically relies on the standard Girsanov theorem, which provides a tractable Radon–Nikodym derivative between path measures by changing the drift under a Brownian SDE, yielding a quadratic ELBO in closed form for Brownian motion 40 and its fractional counterpart 11 , with black-box variants using

Read the complete text