Di-BiLPS: Denoising induced Bidirectional Latent-PDE-Solver under Sparse Observations

Zhonghao Li ∗, Chaoyu Liu ∗, Qian Zhang · 2026

Read Di-BiLPS: Denoising induced Bidirectional Latent-PDE-Solver under Sparse Observations by Zhonghao Li ∗, Chaoyu Liu ∗, Qian Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13790.txt.

Introduction

Zhonghao Li, Chaoyu Liu and Qian Zhang propose Di-BiLPS, a unified neural frame handling forward and inverse partial differential equation problems under very sparse readings. Di-BiLPS mixes a variational autoencoder squeezing big inputs into a compact latent space, plus a latent spread module shaping doubt, and paired learning lining codes. Tests on several partial differential equation benchmarks show Di-BiLPS always reaches state-of-the-art performance under very sparse inputs, as low as 3 percent. It greatly cuts compute cost.

Catalog record

CREATORZhonghao Li ∗, Chaoyu Liu ∗, Qian Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54642
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13790

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Di-BiLPS: Denoising induced Bidirectional Latent-PDE-Solver under Sparse Observations Zhonghao Li ∗, Chaoyu Liu ∗, Qian Zhang Abstract Partial differential equations (PDEs) are fundamental for modeling complex natural and physical phenomena. In many real-world applications, however, observational data are extremely sparse , which severely limits the applicability of both classical numerical solvers and existing neural approaches. While neural methods have shown promising results under moderately sparse observations, their inference efficiency at high resolutions is limited, and their accuracy degrades substantially in the extremely sparse regime. In this work, we propose the Di-BiLPS , a unified neural framework that effectively handle both forward and inverse PDE problems under extremely sparse observations. Di-BiLPS combines a variational autoencoder to compress high-dimensional inputs into a compact latent space, a latent diffusion module to model uncertainty, and contrastive learning to align representations. Operating entirely in this latent space, the framework achieves efficient inference while retaining flexible input–output mapping. In addition, we introduce a PDE-informed denoising algorithm based on a variance-preserving diffusion process, which further improves inference efficiency. Extensive experiments on multiple PDE benchmarks demonstrate that Di-BiLPS consistently achieves SOTA performance under extremely sparse inputs (as low as 3%) , while substantially reducing computational cost. Moreover, Di-BiLPS enables zero-shot super-resolution , as it allows predictions over continuous spatial–temporal domains. Codes are available at https://github.com/Maxwell-996/Di-BiLPS . † † affiliationnotice: Equal contribution Figure 1 : Overview of the architecture of Di-BiLPS : (a) Compression module via a pre-trained VAE ( left ), (b) Diffusion module with proposed PDE-Guided denoising algorithm( middle ), and (c) Contrastive learning module ( right ). Proposed design leverages module (a) to extract informative and robust representations from extremely sparse inputs and performs high-speed denoising algorithm within the compressed latent space. 1 Introduction In the natural sciences, a wide range of physical, chemical, and biological processes can be modeled by partial differential equations (PDEs) ( 36 ; 46 ) . In both academic research and industrial applications, numerical methods for PDEs are primarily concerned with simulating system states (the forward problem) and inferring unknown properties or parameters from experimental or observational data (the inverse problem). Conventional numerical solvers are typically hand-crafted and restricted to specific classes of PDEs, requiring customization for each new formulation. This task-specific nature often results in limited generality, reduced flexibility, and significant computational overhead, especially when dealing with complex geometries or repeated simulations across varying conditions. To fill the gap, a number of learning-based approaches ( 24 ; 27 ) are proposed to learn the mappings between coefficient space and state space directly. These approaches differ mainly in how the solution operators are parameterized, leading to a variety of neural architectures, including graph-based methods ( 19 ) , physics-informed networks ( 33 ) , and convolution-based models ( 42 ) . While neural PDE methods significantly improve generality and computational efficiency, they typically rely on access to dense observations of coefficients or system states to learn accurate solution operators. In real-world applications, however, such complete observations are rarely available. Instead, measurements are often extremely sparse across both spatial and temporal domains, which poses substantial challenges for accurate and reliable modeling. Under such extreme sparsity (e.g., observation rates below 3%), neither classical numerical solvers nor state-of-the-art neural PDE models ( 48 ; 12 ) remain effective. This gap highlights the need for models that can robustly operate under severely limited observational data. To this end, several diffusion-based ( 13 ; 38 ) and graph-based ( 51 ; 18 ) methods have been proposed in recent years. However, these methods often suffer from high computational costs during inference, particularly when applied to densely discretized domains. Furthermore, for PDEs exhibiting drastic variations ( 5 ; 30 ) , interpolation-based methods are generally inadequate to reduce the reliance on dense discretization. To address this limitation, several latent neural PDE methods ( 21 ; 23 ) have been proposed to learn solution mappings within compressed latent spaces. Motivated by the aforementioned challenges, we propose Di-BiLPS , a unified and computationally efficient framework for learning and inference of PDEs under extreme data sparsity. As illustrated in Fig. 1 , Di-BiLPS consists of three key components: (i) a contrastive learning module that aligns representations between sparse and full observations; (ii) a pre-trained variational autoencoder that encodes inputs into a compact latent space; and (iii) a latent diffusion model that enables bidirectional inference for PDE solutions within the latent domain. Our main contributions can be summarized as follows: (1) We propose Di-BiLPS , a scalable neural framework that jointly addresses forward and inverse PDE problems under extremely sparse observations. By reformulating PDE learning in a compressed latent space, Di-BiLPS achieves improved computational efficiency and enhanced input–output flexibility compared to existing methods. (2) We develop a PDE-informed denoising algorithm based on a variance-preserving diffusion process, which effectively integrates sparse observations with physical constraints to enable accurate bidirectional inference. (3) Extensive experiments on five PDE benchmark datasets demonstrate that Di-BiLPS consistently outperforms state-of-the-art baselines in both prediction accuracy and computational efficiency. Benefitting from the nature of GINO, Di-BiLPS supports zero-shot resolution generalization, enabling inference on unseen spatial resolutions without retraining. (4) We show that the proposed contrastive alignment and latent compression modules provide effective representations under extreme sparsity, suggesting their applicability to a broader class of latent neural PDE frameworks. 2 Related Work Diffusion informed Operator Learning: In the context of operator learning, diffusion models were first introduced for high-fidelity flow field reconstruction ( 38 ) and were subsequently extended to address ill-posed sparse prediction problems ( 13 ) . In addition, governing-equation-driven denoising strategies have been explored to accelerate the solution of PDE-based diffusion models ( 10 ; 13 ) . ECI sampling ( 6 ) also presents a novel zero-shot framework that adapts pre-trained flow-matching models to strictly satisfy physical hard constraints without gradient computations or fine-tuning for PDE-related scientific generation tasks. Compared with other machine learning approaches, diffusion models exhibit an inherent ability to capture rich high-frequency components ( 50 ; 15 ) , making them particularly well suited for problems characterized by complex high-frequency dynamics, such as the Navier–Stokes equations ( 31 ) . Further discussions on related work are provided in Appendix A . 3 Preliminaries 3.1 Problem Setup Our study considers two categories of partial differential equations (PDEs): static PDEs and time-dependent(dynamic) PDEs. Static PDEs, such as Darcy flow and Poisson equations, describe equilibrium states of physical systems and are characterized by time-invariant parameters and solutions. These equations typically govern phenomena like fluid flow in porous media, heat conduction at steady state, and electrostatic potential distributions. In contrast, time-dependent PDEs model the evolution of physical systems over time, such as Navier–Stokes equations for fluid dynamics. These PDEs incorporate temporal derivatives and require initial conditions in addition to boundary conditions. By addressing both static and dynamic PDEs, our framework aims to provide a unified solution approach capable of handling a broad class of forward and inverse problems arising in computational physics, engineering, and scientific machine learning. Static systems are governed by time-independent coefficients and boundary conditions. They are typically defined by a function as follows: \displaystyle F(P;A,U)\!=\!0\mathrm{~in~}\Omega\subset\mathbb{R}^{d},U(P)=g(P)\mathrm{~on~}\partial\Omega. (1) where \Omega is a bounded spatial domain, P\in\Omega denotes a spatial coordinate, A\in\mathcal{A} represents the PDE coefficient, and

Read the complete text