Compositional simulation-based inference for time series

Manuel Gloeckler, Shoji Toyota, Kenji Fukumizu, Jakob H. Macke · 2024

Read Compositional simulation-based inference for time series by Manuel Gloeckler, Shoji Toyota, Kenji Fukumizu, Jakob H. Macke (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-02728.txt.

Description

Abstract Amortized simulation-based inference (SBI) methods train neural networks on simulated data to perform Bayesian inference. While this strategy avoids the need for tractable likelihoods, it often requires a large number of simulations and has been challenging to scale to time series data. Scientific simulators frequently emulate real-world dynamics through thousands of single-state transitions over time.

Catalog record

CREATORManuel Gloeckler, Shoji Toyota, Kenji Fukumizu, Jakob H. Macke
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE92 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-02728

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Compositional simulation-based inference for time series Manuel Gloeckler, Shoji Toyota, Kenji Fukumizu, Jakob H. Macke Abstract Amortized simulation-based inference (SBI) methods train neural networks on simulated data to perform Bayesian inference. While this strategy avoids the need for tractable likelihoods, it often requires a large number of simulations and has been challenging to scale to time series data. Scientific simulators frequently emulate real-world dynamics through thousands of single-state transitions over time. We propose an SBI approach that can exploit such Markovian simulators by locally identifying parameters consistent with individual state transitions. We then compose these local results to obtain a posterior over parameters that align with the entire time series observation. We focus on applying this approach to neural posterior score estimation but also show how it can be applied, e.g., to neural likelihood (ratio) estimation. We demonstrate that our approach is more simulation-efficient than directly estimating the global posterior on several synthetic benchmark tasks and simulators used in ecology and epidemiology. Finally, we validate scalability and simulation efficiency of our approach by applying it to a high-dimensional Kolmogorov flow simulator with around one million data dimensions. 1 Introduction Numerical simulations are a central approach for tackling problems in a wide range of scientific and engineering disciplines, including physics ( Brehmer & Cranmer, 2022 ; Dax et al., 2021 ) , molecular dynamics ( Hollingsworth & Dror, 2018 ) , neuroscience ( Gonçalves et al., 2020 ) and climate science ( Watson-Parris et al., 2021 ) . Simulators often include at least some parameters that cannot be measured experimentally. Inferring such parameters from observed data is a fundamental challenge. Bayesian inference provides a principled approach to identifying parameters that align with empirical observations ( Gelman et al., 2020 ) . Standard algorithms for Bayesian inference, such as Markov Chain Monte Carlo (MCMC) ( Gilks et al., 1995 ) and variational inference ( Beal, 2003 ) , generally require access to the likelihoods p({\bm{x}}|{\bm{\theta}}) . However, for many simulators, directly evaluating the likelihood remains intractable, rendering conventional Bayesian approaches inapplicable. Yet, generating synthetic data {\bm{x}}\sim p({\bm{x}}|{\bm{\theta}}) is feasible for numerical simulators. Simulation-based inference (SBI) methods offer a powerful alternative to perform Bayesian inference for such simulator models with intractable likelihoods ( Cranmer et al., 2020 ) . Fig 1: Illustration of Factorized Neural Score Estimation (FNSE) . The goal is to perform parameter inference on a full time series model. The training process uses a smaller subsets of single-state transitions initialized at arbitrary proposal \tilde{p}({\bm{x}}^{t}) , with parameters sampled from a prior distribution. During inference, the time series is divided into single state transitions, and each state transition is evaluated by the neural network to estimate local posterior scores. These local estimates are then aggregated to form a global approximation, which is subsequently used to sample from the overall posterior distribution. Here, a denotes the diffusion time, and {\bm{\theta}}_{a} is the associated noisy parameter. Classical SBI methods, like Approximate Bayesian Computation (ABC) ( Beaumont et al., 2002 ) and synthetic likelihoods ( Wood, 2010 ) , struggle to effectively scale to high-dimensional simulations. To address this, SBI methods have been developed, which train neural networks to represent likelihoods ( Papamakarios et al., 2019 ; Glöckler et al., 2022 ; Boelts et al., 2022 ) , likelihood ratios ( Durkan et al., 2020 ; Hermans et al., 2020 ; Hermans et al., 2022 ; Miller et al., 2022 ) , posteriors ( Papamakarios & Murray, 2016 ; Lueckmann et al., 2017 ; Greenberg et al., 2019 ; Deistler et al., 2022 ; Geffner et al., 2023 ; Wildberger et al., 2023 ; Sharrock et al., 2024 ) or target several properties at once ( Radev et al., 2023 ; Gloeckler et al., 2024b ) . These methods allow for parameter inference without requiring additional simulations after training, making them more efficient than traditional approaches ( Lueckmann et al., 2021 ) : they effectively amortize the cost of the simulation, and/or the full inference approach ( Gershman & Goodman, 2014 ; Le et al., 2017 ) . However, applying these neural amortized methods to time series simulations can be challenging due to the high computational cost of repeated simulator calls. Running numerous time series simulations—possibly with varying sequence lengths—can be computationally prohibitive or at least wasteful. Instead, it seems advantageous to exploit the temporal structure of these simulators: Many—if not most—scientific simulators for time series data are based on (stochastic) differential equations that model dynamics of a system through state transitions over time (e.g., Sedlmeier et al. (2016) ; Goswami et al. (2006) ; Strauss & Effenberger (2017) ; Sirur et al. (2016) ), or directly model processes which are iteratively updated at each time-step. As a consequence, such simulators have an inherently Markovian structure, which can be leveraged for efficient inference! In particular, we can approach the problem on the level of single-state transitions, a simpler task that can be tackled with fewer simulations. For instance, in the Kolmogorov Flow simulator (Sec. 4.4 ), the simulation outputs reach nearly one million dimensions for a time series of length hundred, which is out of range for most direct SBI approaches. In contrast, the dimensionality of single state transitions is only a few thousand. In this work, we propose a method for efficient simulation-based inference for Markovian time series simulators. Unlike other neural SBI methods that require long sequences for training, our approach locally estimates parameters consistent with a single state transition. By aggregating these local solutions, we recover a global posterior approximation for time series of arbitrary length, significantly reducing simulation costs (Fig. 1 ). We focus on applying our strategy to posterior score-based approaches (FNSE, Factorized Neural Score Estimation) and additionally apply it to likelihood(-ratio) estimation methods (FNLE and FNRE) . A related challenge has been addressed in prior studies ( Geffner et al., 2023 ; Linhart et al., 2024 ; Boelts et al., 2022 ) which had focused on efficient inference of i.i.d. (independently and identically distributed) observations. We here show that these approaches can be extended to Markovian simulators—arguably the dominant model-class for mechanistic simulators for time-series—and empirically evaluate our approach on a series of synthetic benchmark tasks, as well as simulators from ecology and epidemiology. Finally, we demonstrate the scalability and efficiency of this approach on the high-dimensional Kolmogorov flow problem. 2 Preliminaries 2.1 Problem setting We target simulators p({\bm{x}}^{0:T}|{\bm{\theta}}) that output time series {\bm{x}}^{0:T}:=({\bm{x}}^{0},...,{\bm{x}}^{T})\in\mathbb{R}^{T\times d} . Many simulators in scientific fields are implemented using (stochastic) differential equations, which inherently satisfy the Markov property. We focus on this class of simulators, where the likelihood takes the following form p({\bm{x}}^{0:T}|{\bm{\theta}})=p({\bm{x}}^{0}|{\bm{\theta}})\prod_{t=0}^{T-1}p({\bm{x}}^{t+1}|{\bm{x}}^{t},{\bm{\theta}}). (1) To simplify the exposition, we constrain the initial condition to be independent of the parameter, p({\bm{x}}^{0}|{\bm{\theta}})=p({\bm{x}}^{0}) , and assume that the simulation transition p({\bm{x}}^{t+1}|{\bm{x}}^{t},{\bm{\theta}}) does not depend on time t . We relax both of these assumptions in Appendix A.2 , and also address the general case of higher-order Markov chains in Appendix A.2.3 . We assume one can sample from the state-transition function {\bm{x}}^{t+1}\sim\mathcal{T}({\bm{x}}^{t+1}|{\bm{x}}^{t},{\bm{\theta}}) , but not evaluate its probability density. 2.2 Amortized methods for simulation-based inference Neural Posterior Estimation (NPE): Neural Posterior Estimation (NPE; Papamakarios & Murray (2016) ; Lueckmann et al. (2017) ; Greenberg et al.

Read the complete text