The Ensemble Inverse Problem: Applications and Methods
Zhengyan Huan, Camila Pazos, Martin Klassen, Vincent Croft, Pierre-Hugues Beauchemin, Shuchin Aeron · 2026
Read The Ensemble Inverse Problem: Applications and Methods by Zhengyan Huan, Camila Pazos, Martin Klassen, Vincent Croft, Pierre-Hugues Beauchemin, Shuchin Aeron (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22029.txt.
Introduction
Zhengyan Huan and co-authors introduce a new statistical problem they call the Ensemble Inverse Problem. Inverse problems work backward from effects to causes. Here the goal is not one hidden state but a whole ensemble. A population of possibilities, distributed according to a prior pushed forward through a known process.
Recovering the full distribution matters when uncertainty itself is the answer, as in forecasting, imaging, and simulation-based science. Their 2026 preprint defines the problem and develops methods for it, with applications in view. Framing ensemble inversion cleanly could unify tricks now scattered across fields, from weather prediction to medical imaging. Where ensembles are already the working language of uncertainty.
Catalog record
| CREATOR | Zhengyan Huan, Camila Pazos, Martin Klassen, Vincent Croft, Pierre-Hugues Beauchemin, Shuchin Aeron |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22029
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Ensemble Inverse Problem: Applications and Methods Zhengyan Huan, Camila Pazos, Martin Klassen, Vincent Croft, Pierre-Hugues Beauchemin, Shuchin Aeron Abstract We introduce a new multivariate statistical problem that we refer to as the Ensemble Inverse Problem (EIP). The aim of EIP is to invert for an ensemble that is distributed according to the pushforward of a prior under a forward process. In high energy physics (HEP), this is related to a widely known problem called unfolding, which aims to reconstruct the true physics distribution of quantities, such as momentum and angle, from measurements that are distorted by detector effects. In recent applications, the EIP also arises in full waveform inversion (FWI) and inverse imaging with unknown priors. We propose non-iterative inference-time methods that construct posterior samplers based on a new class of conditional generative models, which we call ensemble inverse generative models. For the posterior modeling, these models additionally use the ensemble information contained in the observation set on top of single measurements. Unlike existing methods, our proposed methods avoid explicit and iterative use of the forward model at inference time via training across several sets of truth-observation pairs that are consistent with the same forward model, but originate from a wide range of priors. We demonstrate that this training procedure implicitly encodes the likelihood model. The use of ensemble information helps posterior inference and enables generalization to unseen priors. We benchmark the proposed method on several synthetic and real datasets in inverse imaging, HEP, and FWI. The codes are available at https://github.com/ZhengyanHuan/The-Ensemble-Inverse-Problem--Applications-and-Methods . 1 Introduction Let x\in\mathbb{R}^{d} be a random variable with a prior distribution p(x) . We make an observation y of the truth x via a forward model : y=F(x)+n(x), (Fwd-Model) where F is a forward (measurement) operator and n(x) represents an additive noise, which can in general depend on x . Within this setup, we consider the following problem that we refer to as the Ensemble Inverse Problem (EIP). We are given a dataset \mathcal{D}=\{\mathcal{D}_{1},\cdots,\mathcal{D}_{M}\} consisting of multiple truth-observation pairs arising from sampling observations via ( Fwd-Model ) from M prior distributions p_{m},m\in[1:M] . \mathcal{D}_{m}=\{(x^{m,j},y^{m,j})\}_{j=1}^{N_{m}}\overset{i.i.d.}{\sim}p_{m}(x)p(y|x), (1) where (x^{m,j},y^{m,j}) denotes the j -th truth-observation pair in \mathcal{D}_{m} , and the size of \mathcal{D}_{m} is N_{m} . The pair (x^{m,j},y^{m,j}) is independently and identically distributed (i.i.d.) according to the joint distribution p_{m}(x)p(y|x) , and the conditional distribution p(y|x) is determined via ( Fwd-Model ) and is the same for all datasets \{\mathcal{D}_{1},\cdots,\mathcal{D}_{M}\} . We assume that we only have access to \mathcal{D} and no direct knowledge about ( Fwd-Model ). Problem statement (EIP-I for the prior): Given training data \mathcal{D} , and given a new set of observations \mathcal{Y}=\{y^{1},\cdots,y^{N}\} obtained from an unknown prior p(x) and the same (as \mathcal{D} , but unknown) forward model, generate samples x^{1},\cdots,x^{N^{\prime}}|\mathcal{Y} such that for a given \lambda>0 , \rho(\hat{p}(x|\mathcal{Y}),p(x))<\lambda, where \hat{p}(x|\mathcal{Y})=\lim_{N^{\prime}\rightarrow\infty}\frac{1}{N^{\prime}}\sum_{n=1}^{N^{\prime}}\delta_{x^{n}|\mathcal{Y}} is the limiting empirical measure corresponding to the generated samples. \rho(\cdot,\cdot) denotes a discrepancy measure between distributions, such as the Kullback-Liebler divergence, total Variation [ 11 ] , or Wasserstein distance [ 32 ] , and the Dirac delta function \delta_{x^{n}} denotes the probability density of a distribution concentrated at the n -th generated sample x^{n} . In other words, the aim of EIP-I is to generate samples whose distribution comes close to the prior distribution that lead to the observations. For practical utility that will become clear in the exposition later, we restrict the EIP-I problem further to learn to generate samples via posterior sampling, given observations from a prior. (a) Forward process (b) EIP-II’s solution (c) An incorrect posterior Figure 1 : Consider a forward process in Fig. 1(a) , Fig. 1(b) shows EIP-II’s solution, with its integration corresponding to EIP-I’s solution. Fig. 1(c) shows an incorrect posterior; however, the integration of this incorrect posterior can lead to the correct prior. Problem statement (EIP-II for the posterior): Given training data \mathcal{D} , and given a new set of i.i.d. observations \mathcal{Y}=\{y^{1},\cdots,y^{N}\} obtained from an unknown prior p(x) and the same (as \mathcal{D} ) but unknown forward model, for any given y , generate conditional samples x^{1},\cdots,x^{N^{\prime}}|y,\mathcal{Y} such that for a given \lambda>0 , \rho(\hat{p}(x|y,\mathcal{Y}),p(x|y))<\lambda, where \hat{p}(x|y,\mathcal{Y})=\lim_{N^{\prime}\rightarrow\infty}\frac{1}{N^{\prime}}\sum_{n=1}^{N^{\prime}}\delta_{x^{n}|y,\mathcal{Y}} , and p(x|y)=\frac{p(x)p(y|x)}{p(y)} . It is evident that the integration of the solution to EIP-II yields a good approximation of the solution to EIP-I. However, the integration of posteriors that are not the solution to EIP-II can still be the solution to EIP-I. We refer the readers to the Gaussian example in Sec. 3 in [ 9 ] and our example in Fig. 1 . Owing to the success of the generative models in modeling complex distributions with provable theoretical guarantees [ 20 , 10 , 2 ] , in this paper, we aim to solve EIP-II by modeling the posterior via generative models. Where does EIP arise? An important application of EIP arises in the high-energy physics (HEP) domain, where one unfolds to remove detector effects [ 16 , 3 ] . A point of distinction in our problem statement and the traditional unfolding setup is that EIP-I & II do not make explicit use of the forward model at inference time. The primary reason to deviate from such a setting is that typically forward models are computationally expensive to simulate. So EIP-I & II provide for an avenue where this model is implicit in the dataset \mathcal{D} . In the context of unfolding, EIP-II setting has recently been considered directly in [ 28 ] using conditional generative models. Another domain where EIP-II arises naturally is the seismic full waveform inversion (FWI) problem [ 14 ] , where one wants to recover the subsurface velocity maps with an unknown prior from the received seismic data. EIP-II also exists in the inverse imaging problem setting, where one wants to recover a corrupted image with an unknown prior [ 12 , 22 ] . A set of recent works has considered EIP-like problems arising in contexts of Large-Language Models and the In-Context Learning [ 17 , 30 , 1 ] . In [ 17 , 1 ] the main problem is to understand if given pairs of measures whether there exists a transformer architecture that can map a given input to its corresponding output, thus learning a measure to measure map. The setting of [ 30 ] also comes close to EIP. [ 30 ] proposes to use a transformer to infer the hidden parameters in a Poisson forward process, provided with a set of observations. We now summarize related work in terms of the methods that have been proposed in the literature and which can potentially be used to address the EIP problem. Method Requirements Objective Iterative Tuneable Regularization Designed to recover unseen priors Non-ML IBU ( Fwd-Model ) p(x) Yes Yes Yes SVD Unfolding ( Fwd-Model ) p(x) Partial Yes Yes Measure decomposition ( Fwd-Model ) p(x|y) Yes Yes Yes Thoretical Measure-to-measure interpolation \mathcal{D} p(x) No No No ML-based OmniFold \mathcal{D} or ( Fwd-Model ) p(x) Yes Yes Yes GANs ( Fwd-Model ) p(x) No No Yes DPnP \{x^{j}\}_{j=1}^{N} and ( Fwd-Model ) p(x|y) No No No Ambient diffusion \{y^{j}\}_{j=1}^{N} and ( Fwd-Model ) p(x|y) No No No cINN ( Fwd-Model ) p(x|y) No No No SBUnfold \mathcal{D} p(x|y) No No