Neural Backward Filtering Forward Guiding

Gefan Yang, Frank van der Meulen, Stefan Sommer · 2026

Read Neural Backward Filtering Forward Guiding by Gefan Yang, Frank van der Meulen, Stefan Sommer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-23030.txt.

Introduction

Gefan Yang, Frank van der Meulen, and Stefan Sommer infer hidden processes that evolve along trees. Observations may exist only at the leaves, as with species traits at the tips of an evolutionary tree. Exact smoothing for nonlinear dynamics is intractable, and particle methods weaken in high dimensions.

Their neural framework, NBFFG, guides sampling forward using a backward filtering pass learned by a network. It handles both jump transitions and smooth diffusions in one scheme. Better tree inference helps biology, epidemiology, and other fields with branching data. Sparse, leaf-only observations define the difficulty: everything between the root and the tips must be inferred, not seen.

Catalog record

CREATORGefan Yang, Frank van der Meulen, Stefan Sommer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-23030

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Neural Backward Filtering Forward Guiding Gefan Yang, Frank van der Meulen, Stefan Sommer Abstract Inference in non-linear continuous stochastic processes on trees is challenging, particularly when observations are sparse (leaf-only) and the topology is complex. Exact smoothing via Doob’s h h -transform is intractable for general non-linear dynamics, while particle-based methods degrade in high dimensions. We propose Neural Backward Filtering Forward Guiding (NBFFG), a unified framework for both discrete transitions and continuous diffusions. Our method constructs a variational posterior by leveraging an auxiliary linear-Gaussian process. This auxiliary process yields a closed-form backward filter that serves as a “guide”, steering the generative path toward high-likelihood regions. We then learn a neural residual–parameterized as a normalizing flow or a controlled SDE–to capture the non-linear discrepancies. This formulation allows for an unbiased path-wise subsampling scheme, reducing the training complexity from tree-size dependent to path-length dependent. Empirical results show that NBFFG outperforms baselines on synthetic benchmarks, and we demonstrate the method on a high-dimensional inference task in phylogenetic analysis with reconstruction of ancestral butterfly wing shapes. 1 Introduction Stochastic processes defined on tree structures are fundamental for modeling hierarchical dependencies in complex systems. Applications range from tracing phylogenetic evolution in biology ( Felsenstein 1981 ; Huelsenbeck et al. 2003 ) , modeling the state spaces of spin glasses in statistical physics ( Bovier 2017 ) , to analyzing cascading diffusion in social networks ( Kempe et al. 2003 ) . In these settings, a central inferential challenge is the smoothing problem: reconstructing the latent trajectories of internal hidden states given partially available observations, e.g., only at leaves or final outcomes. Theoretically, exact Bayesian inference in this context is characterized by Doob’s h -transform, which conditions the generative process on future observations via a harmonic h -function. Computing this h -function can be done by “collecting evidence” or “passing messages” from leaves to the root, which yields the concept of “belief propagation” or “sum-product message passing”. While this backward pass is analytically tractable for simple Linear-Gaussian models, it becomes computationally prohibitive for general non-linear dynamics. Current approaches to this intractable problem often rely on stochastic simulation methods like Sequential Monte Carlo (SMC) or Markov Chain Monte Carlo (MCMC). However, particle-based methods suffer from weight degeneracy, particularly for the smoothing problem and as the hierarchy deepens. MCMC schemes may face prohibitive mixing times in deep trees because the vanishing information signal between the root and distant leaves results in a nearly flat posterior surface, forcing the sampler into an inefficient random walk across a vast state space. To overcome these limitations, we introduce Neural Backward Filtering Forward Guiding (NBFFG), a deep variational framework that amortizes the cost of inference. Our core insight is to approximate the intractable posterior by ”warm-starting” it with a tractable proxy. We first construct a guided process where Doob’s h -transform is replaced by a computationally cheap approximation. This acts as a coarse ”guide”, steering the generative process towards high-likelihood regions. We then learn a neural residual—parameterized as a normalizing flow or controlled stochastic differential equation (SDE) to capture the fine-grained non-linear discrepancies, significantly reducing the complexity compared to learning the full dynamics from scratch. Our contributions are summarized as follows: • We propose a novel method for smoothing both discrete and continuous processes on directed trees, combining analytical linear guidance with learnable neural residuals to ensure robust inference across diverse dynamics. • We introduce a path-wise subsampling scheme and a transductive amortization strategy. This reduces training costs from tree size to path size, and allows a single shared network to generalize across deep hierarchies. • We demonstrate the method’s versatility by recovering analytical ground truths in linear models, resolving mode collapse in multimodal non-linear systems where baseline methods are challenged, and successfully reconstructing high-dimensional ancestral butterfly morphologies in a real-world phylogenetic application. 2 Related Work Smoothing of state-space models For Linear Gaussian State-space Model (LG-SSM), the Kalman smoother, also known as the Rauch-Tung-Striebel (RTS) smoother ( Rauch et al. 1965 ) yields exact marginal smoothing distributions via a forward-backward recursion, see for instance, ( Sarkka 2023 ) [Chapter 12]. Sampling from the smoothing distribution in LG-SSMs is achieved by forward filtering-backward sampling, introduced firstly by ( Carter & Kohn 1994 ) and ( Frühwirth-Schnatter 1994 ) . ( Pearl 1988 ) generalized this forward-backward recursions to a tree, which is known as “belief propagation” or “sum-product message passing”. This algorithm consists of a backward “collect evidence” phase and a subsequent forward ”distribute evidence” phase. Extensions to richer tree models include ( Chou et al. 1994 ; Bardel & Desbouvries 2012 ; Desbouvries et al. 2006 ) . Sampling methods Particle-based methods offer a robust framework for inference in nonlinear, non-Gaussian models. Briers et al. (2010) established a principled two-filter smoothing formulation, while Whiteley (2014) introduced ”twisting” to mitigate weight degeneracy. Subsequent works have refined this by iteratively approximating optimal twists ( Guarniero et al. 2017 ) or framing twisting as a stochastic control problem ( Heng et al. 2020 ) . Recently, learning-based approaches have integrated neural networks to approximate optimal proposals and Doob’s h -transforms ( Paige & Wood 2016 ; Chopin et al. 2023 ) . Notably, methods like SI \chi O and NAS- \chi embed SMC into reweighted wake-sleep objectives to achieve low-variance gradient estimation ( Lawson et al. 2022 ; Lawson et al. 2023 ) . Smoothing of diffusions Also known as the diffusion bridge problem, this task is commonly addressed via Monte Carlo sampling using ”guided proposals” ( Delyon & Hu 2006 ; Schauer et al. 2017 ) , a concept recently extended to directed acyclic graphs (DAGs) by ( van der Meulen & Sommer 2026 ) . Alternatively, learning-based methods employ techniques such as score matching ( Heng et al. 2025 ) , adjoint processes ( Baker et al. 2025 ) , self-consistency objectives ( Howard et al. 2025 ) , or neural guidance ( Yang 2025 ) . Our work builds directly upon ( van der Meulen & Sommer 2026 ) , which formulates the proposal distribution over tree topologies, and ( Yang 2025 ) , which introduces a learnable objective for approximating the posterior. We unify and extend these frameworks to enable scalable, high-dimensional inference on complex tree structures. 3 Preliminaries 3.1 Probabilistic models on tree diagrams Let \mathcal{G}=(\mathcal{V},\mathcal{E}) be a directed rooted tree with vertex set \mathcal{V} and edge set \mathcal{E} . The set \mathcal{V} contains a distinct fixed root \mathbf{0} and a set of non-root vertices \mathcal{V}^{+}:=\mathcal{V}\setminus\{\mathbf{0}\} . For any vertex v , let \mathrm{pa}(v) and \mathrm{ch}(v) denote the parent and the set of children of v , respectively (if existent). Since \mathcal{G} is a tree rooted at \mathbf{0} , every vertex v\in\mathcal{V}^{+} has exactly one parent, while \mathrm{pa}(\mathbf{0})=\emptyset . We denote a directed edge from \mathrm{pa}(v) to v as (\mathrm{pa}(v),v)\in\mathcal{E} . The notation u\rightsquigarrow v indicates that v is reachable from u\in\mathcal{V} (including the case u=v ). Let \mathcal{L}\subset\mathcal{V} denote the set of leaves (vertices without children). For a vertex v , we define the set of descendant leaves \mathcal{L}_{v} as \mathcal{L}_{v}:=\{l\in\mathcal{L}:v\rightsquigarrow l\} . We consider a generative model defined on a directed tree \mathcal{G}=(\mathcal{V},\mathcal{E}) rooted at \mathbf{0} . To each vertex v\in\mathcal{V} , a continuous random vector X_{v} taking

Read the complete text