Observation-Aligned Mask Priors for Learning Physical Dynamics from Authentic Occlusions
Chiyuan Ma, Zihan Zhou, Tianshu Yu · 2026
Read Observation-Aligned Mask Priors for Learning Physical Dynamics from Authentic Occlusions by Chiyuan Ma, Zihan Zhou, Tianshu Yu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16818.txt.
Introduction
Ma, Zhou and Yu propose Observation-Aligned Mask Priors, a framework for learning physical fields from incomplete, authentically occluded observations. Real occlusions are structured and often missing not at random, unlike set masks. They pretrain a Bayesian Flow Network on binary masks to capture real occlusion patterns, then guide sampling with a normalized cross-entropy objective to generate sample masks. Guided-observed mask overlap defines context, with remaining observed entries as query targets. On three ocean datasets, the method beats strong diffusion baselines on error and signal quality.
Catalog record
| CREATOR | Chiyuan Ma, Zihan Zhou, Tianshu Yu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 108339 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.16818
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Observation-Aligned Mask Priors for Learning Physical Dynamics from Authentic Occlusions Chiyuan Ma, Zihan Zhou, Tianshu Yu Abstract Learning physical dynamics directly from incomplete observations is challenging because authentic occlusions are structured, sample-dependent, and often missing not at random, whereas existing methods typically rely on heuristic masking rules or predefined mask distributions. We propose Observation-Aligned Mask Priors, a framework that learns the distribution of authentic observation masks and uses it to construct context-query partitions for training from incomplete data. Specifically, we pretrain a Bayesian Flow Network (BFN) on binary observation masks to capture real occlusion topologies, then guide BFN sampling with a globally normalized cross-entropy objective to generate sample-specific masks aligned with each sparse observation. The intersection between the guided mask and the observed mask defines the context, and the remaining observed entries become query targets for a diffusion-based reconstruction model. We show that this intersection-based partitioning gives every valid observed dimension a strictly positive probability of being queried, preventing zero-query dead zones and local generative collapse. Experiments on three real-world oceanographic datasets with authentic satellite occlusions, across resolutions up to 256 × \times 256, show consistent improvements over strong diffusion baselines in MSE and PSNR. These results demonstrate that learning mask priors from authentic occlusions is an effective alternative to heuristic masking for learning from incomplete physical observations without access to fully observed fields. † † footnotetext: † Corresponding author. 1 Introduction Learning physical dynamics from observational data is a central goal of scientific machine learning, with broad impact on ocean monitoring [ 3 , 26 ] , weather analysis [ 5 , 18 ] , and environmental forecasting [ 15 , 1 ] . In these applications, however, the underlying physical field is almost never observed on a complete spatial grid [ 8 ] . Measurements arrive through authentic occlusions caused by cloud cover, sensor swath gaps, orbital trajectories, and geographic boundaries [ 19 ] , yielding observation masks that are structured, sample-dependent, and often missing not at random (MNAR). These masks are not generic corruption that can be approximated by random dropout; they are part of the sensing process itself. A central challenge is therefore to learn physical dynamics directly from incomplete observations, without requiring access to fully observed fields, while respecting the topology of real-world occlusions. Existing Bottleneck. Recently, a promising direction is to train directly on incomplete data through context-query partitioning [ 34 ] . Instead of supervising a model with complete ground truth, one splits the observed region into a visible context and a withheld query region, and trains the model to reconstruct the query from the context. This removes the unrealistic requirement of fully observed supervision, but it introduces a new bottleneck: the success of learning now depends critically on how the context-query partition is constructed. In fact, the seminal study [ 34 ] shows that a spatial dimension can only be learned if it has a strictly positive probability of being assigned to the query region; otherwise its expected gradient vanishes and the model may output arbitrary values there. Existing approaches typically instantiate this partition using heuristic masking rules [ 34 , 9 , 25 ] , such as independent pixel dropout, regular block masking, or hand-designed saliency heuristics. While convenient, these strategies implicitly assume a predefined mask distribution and are poorly matched to authentic physical occlusions, whose geometry is shaped by clouds, coastlines, and sensing constraints. When missingness is structured and potentially MNAR, the mismatch between heuristic masking and real observational topology becomes a fundamental obstacle. Our Solution. The key idea is to stop assuming the mask distribution and instead learn it from data. Although the missingness mechanism of real observations is analytically unknown, its spatial structure is encoded in the observation masks themselves. We therefore propose Observation-Aligned Mask Priors , a framework that learns a generative prior over authentic observation masks and uses it to drive context-query partitioning. Specifically, we pretrain a Bayesian Flow Network (BFN) [ 13 ] on binary observation masks to capture realistic occlusion topologies. During training of the physical reconstruction model, we then guide BFN sampling with a globally normalized cross-entropy objective so that the sampled mask is aligned with the current sparse observation rather than generated unconditionally. The intersection between the guided mask and the actual observation mask defines the context region, while the remaining observed entries become the query region. In this way, the partition is both data-driven and sample-specific: it respects the learned prior over authentic occlusions while remaining anchored to what is truly observed in the current sample. Theoretical & Empirical Value. This design yields both theoretical and practical benefits. On the theory side, we show that intersection-based partitioning gives every valid observed dimension a strictly positive probability of being queried. We first establish this property when masks are independently sampled from the learned prior, and then prove that the guarantee is preserved under our observation-aligned guided partitioning strategy. This eliminates zero-query dead zones that would otherwise cause local generative collapse and structural information deficiency. On the practical side, the resulting partitions focus learning on meaningful missing regions and substantially improve reconstruction quality under authentic structured missingness. Across three real-world oceanographic datasets [ 19 ] with genuine satellite occlusions—Black Sea CHL, Baltic Sea NANO, and Global Ocean SSS—and across resolutions up to 256 \times 256, our method consistently outperforms strong diffusion-based baselines in MSE and PSNR, demonstrating that learning occlusion priors from data is a viable alternative to heuristic masking when complete physical fields are unavailable. More related works are discussed in Appendix A . We present our contributions as follows: • From heuristic masks to learned occlusion priors. We introduce Observation-Aligned Mask Priors , a new framework that replaces handcrafted context-query partitioning rules with a learned generative prior over authentic observation masks, and aligns this prior to each input sample through guided mask generation. • Strict positivity, not just empirical coverage. We provide theoretical guarantees showing that our intersection-based partitioning strategy assigns every valid observed dimension a strictly positive query probability, both under mask-prior sampling and under observation-aligned guidance, thereby preventing zero-query dead zones and local collapse. • Real gains under authentic occlusions. We validate the framework on three challenging real-world oceanographic datasets with genuine structured missingness and show consistent improvements over diffusion baselines across multiple spatial resolutions, without ever requiring fully observed training fields. 2 Preliminaries In realistic physical science applications, training datasets typically only consist of partial observations \bm{u}_{\text{obs}}=\bm{M}\odot\bm{u}_{0} , where \bm{M} is a binary observation mask. To learn complete physical dynamics directly from incomplete data, previous work [ 34 ] introduced a context-query partitioning framework. Learning Dynamics via Context-Query Partitioning. During training, each incomplete sample is strategically partitioned into an observable context mask \bm{M}_{\text{ctx}}\subset\bm{M} and a non-request mask \bm{M}_{\text{qry}}\subseteq\bm{M} . The model is trained to reconstruct the query region conditioned solely on the context region: \mathcal{L}(\bm{u}_{\text{obs}},\bm{M}_{\text{ctx}},\bm{M}_{\text{qry}})=||\bm{M}_{\text{qry}}\odot(\bm{u}_{\bm{\phi}}(\bm{M}_{\text{ctx}}\odot\bm{u}_{\text{obs}},\bm{M}_{\text{ctx}})-\bm{u}_{\text{obs}})||^{2}. (1) By penalizing reconstruction error exclusively on the withheld region, the network is forced to abandon naive local pixel memorization and infer the missing region. Theoretical Foundation of Global Prediction. The success of this framework fundamentally depends on the context-query splitting strategy. Theoretical analysis establishes that minimizing Eq. ( 1 ) leads to an optimal prediction (\bm{u}_{\phi})_{i} for a specific feature dimension i