Composing Diffusion Priors with Explicit Physical Context via Generative Gibbs Sampling

Weizhou Wang, Jonathan Weare, Aaron R. Dinner · 2026

Read Composing Diffusion Priors with Explicit Physical Context via Generative Gibbs Sampling by Weizhou Wang, Jonathan Weare, Aaron R. Dinner (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10642.txt.

Introduction

Weizhou Wang and two colleagues combine trained diffusion models with physics rules for science sampling. Trained diffusion models give strong learned priors, but each often covers only part of a system. Outside forces such as solvents, ions, and fields can reshape the full result. Their 2026 paper presents Generative Gibbs for Physics-Aware Sampling, or GG-PA. GG-PA joins partial priors with explicit physical context, with no retraining.

The frame treats the mix as inference over a joint target in a larger state space. Its Gibbs sampler turns exact as diffusion time nears zero, and stays exact at finite times when interactions are quadratic. Replica exchange over diffusion time speeds mixing. Tests on a double-well system, a lattice model, and peptide systems show GG-PA recovers context shifts and joint behavior no single prior shows.

Catalog record

CREATORWeizhou Wang, Jonathan Weare, Aaron R. Dinner
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE101 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.10642

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Composing Diffusion Priors with Explicit Physical Context via Generative Gibbs Sampling Weizhou Wang, Jonathan Weare, Aaron R. Dinner Abstract Pretrained diffusion models provide powerful learned priors, but in scientific sampling the target distribution often depends on physical context that is not fully represented by one generative model. We introduce Generative Gibbs for Physics-Aware Sampling (GG-PA), a training-free framework that formulates the composition of learned partial priors and explicit physical context as inference over a joint target distribution in an augmented state space. We derive a Gibbs sampler for this joint target, show that it is asymptotically exact as the diffusion time approaches zero, and prove that in settings with quadratic interactions it remains exact at finite diffusion times. We further introduce replica exchange over diffusion time to accelerate mixing. Experiments on a double-well system, a ϕ 4 \phi^{4} lattice model, and atomistic peptide systems show that GG-PA recovers context-induced distribution shifts and emergent collective behavior in interacting systems using partial priors without retraining. These results demonstrate GG-PA as a practical approach for combining pretrained generative priors with explicit physical context. 1 Introduction Pretrained diffusion models are increasingly attractive as priors for scientific sampling [ 1 , 2 , 3 ] . In many applications, however, a learned prior describes only a selected subset of the degrees of freedom rather than the full-system state. This occurs when the model is trained on the coordinates of an isolated subsystem, such as a protein backbone or a molecular fragment, so that environmental and inter-component effects become implicit. Yet it is often desirable to account for interactions beyond those known during training. Solvents, ions, external fields, and other subsystems represented by separate pretrained priors can all substantially reshape the equilibrium ensemble and give rise to collective behavior absent from any individual prior [ 4 , 5 , 6 , 7 , 8 ] . A target distribution will generally not be correctly sampled when not matched by the prior training distribution [ 9 , 10 , 11 ] . While one can improve transferability of generative models by including all relevant variables during training and/or finetuning them on context-labeled data [ 12 ] , these strategies are only feasible when the uses of the models can be anticipated during training and appropriate data are available. Consequently there is much interest in inference-time approaches such as guidance [ 13 , 14 ] , posterior sampling [ 15 , 16 ] , or MCMC-based correction [ 17 , 18 , 19 , 20 ] . These approaches can be viewed as posterior sampling under a learned diffusion prior. However, because they are typically formulated in terms of the variables of the generative model, the added contexts must be expressed in terms of those variables. In scientific settings, degrees of freedom that are not represented explicitly by the prior must be marginalized into an effective (free) energy term [ 21 ] , which is often intractable for high-dimensional environments and redundant when other subsystems are already well modeled either by pretrained priors over their own degrees of freedom or existing force fields [ 22 , 23 , 24 , 25 ] . Thus the challenge we consider is not conditional generation under a single prior but inference-time composition of partial learned priors with explicit system-level context. We address this challenge with Generative Gibbs for Physics-Aware Sampling (GG-PA) , an approach for composing multiple pretrained diffusion priors with explicit physical context during inference. GG-PA maintains an explicit representation of the full system and couples it to the pretrained priors through projections onto the prior variables. Sampling alternates between two types of updates. In a parallel denoising step , each prior updates its variables conditioned on the current full-system state. In a context-aware aggregation step , the full-system state updates under the explicit physical context and soft restraints to the prior variables. This mixed-modeling formulation allows diffusion priors to govern only selected subsets of variables, supports modular composition of multiple priors, and leaves the remaining degrees of freedom explicit throughout sampling. GG-PA defines a family of joint distributions of the prior and full-system variables indexed by diffusion time t . Here, t denotes the forward-diffusion noise level; that is, larger t corresponds to addition of more noise. In the limit t\to 0 without noise, we show that we recover the desired composed distribution, establishing asymptotic correctness under the stated factorization assumptions. We further show that GG-PA remains exact at finite diffusion times when the interactions between pretrained and/or physical models are quadratic. This result clarifies the practical role of diffusion time. Small t enforces strong consistency with the pretrained priors but can make the system stiff and lead to poor mixing. Larger t relaxes the coupling and improves exploration, but it weakens fidelity to the priors. To balance these effects, we introduce replica exchange over diffusion time [ 26 , 27 , 28 , 29 ] , which admits a tractable swap criterion for the joint target and allows high-noise replicas to explore rapidly while allowing low-noise replicas to preserve fidelity. We evaluate GG-PA on three systems of increasing complexity. A two-dimensional (2D) double-well system provides a numerically tractable and easily visualizable benchmark that we use to analyze the effect of the diffusion time t and, in turn, demonstrate the mixing benefits of replica exchange. A Ginzburg-Landau \phi^{4} model on a 2D lattice tests whether copies of a pretrained prior can be composed at sampling time to recover collective many-body behavior absent from the training distribution [ 30 ] . We then probe atomistic molecular models, where the context is supplied by molecular dynamics [ 31 ] . Across these cases, GG-PA recovers context-induced distribution shifts, enables zero-shot composition from partial priors, and remains effective in atomistic systems. Our contributions are threefold. First, we formulate composition of partial diffusion priors with physical context as inference over an explicit full-system state and the variables associated with the pretrained priors, bypassing the intractable marginalization required by standard posterior sampling. Second, we derive the GG-PA sampler and characterize its correctness through asymptotic recovery as t\to 0 , exact finite- t sampling in settings with quadratic interactions, and replica exchange over diffusion time for improved mixing. As a special case, the finite- t result yields a covariance correction for existing split Gibbs samplers. Third, we demonstrate modular multi-prior composition numerically in systems with and without quadratic interactions. 2 Related Work 2.1 Inference-time conditioning and composition for diffusion priors A growing body of work adapts pretrained diffusion priors at inference time through guidance [ 1 , 14 , 16 , 32 , 33 ] , score composition [ 34 ] , posterior sampling [ 15 , 16 ] , and Monte Carlo corrections [ 18 , 19 , 20 , 35 ] . These methods typically express the new task as a posterior or composition over the variables of the prior(s), with additional information entering as a tractable likelihood or energy on those variables. By contrast, in GG-PA, pretrained priors cover only selected degrees of freedom, and additional variables and interactions remain explicit. Rather than requiring all context to be expressed through the prior variables, GG-PA composes one or more partial learned priors with

Read the complete text