Discrete Spatial Diffusion: Intensity-Preserving Diffusion Modeling

Javier E. Santos, Agnese Marcato, Roman Colman, Nicholas Lubbers, Yen Ting Lin · 2025

Read Discrete Spatial Diffusion: Intensity-Preserving Diffusion Modeling by Javier E. Santos, Agnese Marcato, Roman Colman, Nicholas Lubbers, Yen Ting Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01917.txt.

Introduction

Image generators built on diffusion start from noise and clean it up step by step, but they treat brightness as a smooth scale. Javier Santos and four co-authors note in 2025 that many scientific quantities are not smooth at all: particle counts and material amounts must be conserved exactly. Their framework, Discrete Spatial Diffusion, moves particles around instead of fading values, so totals never change.

The method still handles image making, class guided samples, and filling in missing parts, all while holding the total fixed. Tests on porous rock and battery electrode scans produced realistic structures that passed transport and performance checks. The authors offer the framework for science workflows where conservation is not optional. It keeps the flexibility of diffusion inside strict physical limits.

Catalog record

CREATORJavier E. Santos, Agnese Marcato, Roman Colman, Nicholas Lubbers, Yen Ting Lin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-01917

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Discrete Spatial Diffusion: Intensity-Preserving Diffusion Modeling Javier E. Santos, Agnese Marcato, Roman Colman, Nicholas Lubbers, Yen Ting Lin Abstract Generative diffusion models have achieved remarkable success in producing high-quality images. However, these models typically operate in continuous intensity spaces, diffusing independently across pixels and color channels. As a result, they are fundamentally ill-suited for applications involving inherently discrete quantities—such as particle counts or material units—that are constrained by strict conservation laws like mass conservation, limiting their applicability in scientific workflows. To address this limitation, we propose Discrete Spatial Diffusion (DSD), a framework based on a continuous-time, discrete-state jump stochastic process that operates directly in discrete spatial domains while strictly preserving particle counts in both forward and reverse diffusion processes. By using spatial diffusion to achieve particle conservation, we introduce stochasticity naturally through a discrete formulation. We demonstrate the expressive flexibility of DSD by performing image synthesis, class conditioning, and image inpainting across standard image benchmarks, while exactly conditioning total image intensity. We validate DSD on two challenging scientific applications: porous rock microstructures and lithium-ion battery electrodes, demonstrating its ability to generate structurally realistic samples under strict mass conservation constraints, with quantitative evaluation using state-of-the-art metrics for transport and electrochemical performance. 1 Introduction Diffusion-based generative models have emerged as powerful tools for high-quality image generation [ 66 , 36 , 69 ] . Typically, these models inject noise into the images, then learn to reverse this noise-adding process to recover meaningful structure. In most frameworks, this is based on an Itô Stochastic Differential Equation (SDE) with Gaussian noise. While effective for many vision tasks, these approaches inherently assume continuous pixel intensities, which can cause difficulty when dealing with the discrete nature of many datasets. Tasks beyond vision, such as those in the physical sciences have many applications which require discrete physical quantities, such as particle counts in a simulation, or phases in materials microstructure. Conservation of total quantities is critical for scientific applications, and so generative modeling which can operate under constrained, discrete pixel intensities would enable scientifically grounded and physically consistent synthesis. Such a capability might also prove useful within vision tasks, such as inpainting and super-resolution. Scientific and engineering studies of the natural world using computational techniques often involve discrete variables in space and/or time. On microscopic scales, everyday materials exhibit extremely complex structural patterns which encode the history of their formation, and play a large role in how the material functions on a macroscopic level. An important and wide-reaching field of study is materials microstructure, which is used in materials design [ 35 ] , forensic analysis, hydrology [ 7 ] , energy storage [ 65 ] , and even medicine, such as in studies of bone structure [ 53 ] . For example, crystal grain shapes can give rise to complex stress patterns which affect the yield strength of a metal [ 10 ] . Materials microstructures are frequently represented by a small number of discrete phases that describe their underlying chemical structures. In sandstone, for example, the overall arrangement of nanocrystals is highly disordered, and gives rise to complex pore structures, through which subsurface water flows. This microstructure has an enormous influence on the rate of transport of fluids and contaminants [ 6 ] . Microstructure of electrodes is also known to have an immense impact on the characteristics of electrochemical devices [ 58 ] . Small changes in thermodynamic properties can cause drastic changes in microstructure, such as in stainless steels [ 79 ] , requiring the study of microstructure as a function of phase contents. Furthermore, gathering real-world data is often complex and expensive; decades of work have been applied to computational modeling of the generation and consequences of microstructure prior to the widespread popularization of machine learning [ 72 ] . While diffusion models have been constructed for microstructure [ 52 , 37 , 47 , 46 , 80 , 4 , 25 ] , they have not handled exact porosity (intensity) constraints. In this work, we introduce Discrete Spatial Diffusion (DSD), a discrete-state Markov chain-based diffusion framework in which the forward process redistributes discrete units of intensity in space (Fig. 1 c). Unlike previous diffusion models, DSD exactly preserves total intensity throughout both the forward and reverse phases, ensuring that global properties—such as mass fractions—are exactly conserved by representing them in terms of conserved particles. We demonstrate that DSD enables scientific applications and can extend the capabilities of conventional image processing tasks, like image generation and inpainting in discrete domains. By directly modeling discrete transitions, DSD enables generative modeling under conservation laws, allowing models that specialize for constrained conditions in scientific applications and beyond. 2 Background Among the body of literature on generative diffusion models, originating from the pioneering work of Sohl-Dickstein et al. [66] , the most relevant to our work fall into two broad categories: (1) those employing discrete-state Markov chains to introduce noise in the forward process [ 39 , 3 , 11 , 63 , 70 , 51 , 64 ] , and (2) those incorporating spatial dynamics into the forward diffusion process [ 5 , 61 , 39 ] . Generative diffusion modeling based on discrete-state Markov chains has become an active area of research in recent years. Early work, such as Hoogeboom et al. [39] , Austin et al. [3] , introduced discrete-state and discrete-time Markov chains as an alternative to the Gaussian noise used in conventional diffusion models [ 66 , 36 , 69 ] . Campbell et al. [11] generalized these formulations to a continuous-time framework, providing a more rigorous theoretical foundation for discrete-state generative diffusion modeling. Santos et al. [63] employed operator algebraic analysis to formally establish the existence of the reverse-time dynamics and derived the stochastic generator for arbitrary discrete-state Markov processes. Similar formulations were independently developed by Sun et al. [70] and Lou et al. [51] , with an emphasis on defining and estimating score functions for discrete-state systems. The Markov process operates in intensity space in all the aforementioned diffusion models, treating each pixel as an independent stochastic process (Fig. 1 (a): Gaussian; Fig. 1 (b): Discrete). This study focuses on a spatially correlated process for generative modeling for two reasons: (1) for structured images, it is more natural to incorporate spatial correlations into the generative process, and (2) spatially decorrelated noise makes it difficult to preserve total intensity. A spatially correlated approach has been explored for continuous systems. Cold Diffusion [ 5 ] introduced a deterministic blurring transformation, where image degradation follows a predefined forward process, and reconstruction is learned as an inverse mapping. However, lacking a probabilistic latent distribution (as in VAEs [ 42 ] ), Cold Diffusion is not a true generative model. Inverse Heat Dissipation Model (IHDM, Rissanen et al. [61] ) uses the heat equation as a corruption model. Since the heat equation is deterministic and reversible (except that the homogeneous solution at t\rightarrow\infty is singular), a naïve inversion would again result in deterministic reconstructions. Uncorrelated Gaussian noise was added to the heat equation to overcome this limitation, relaxing the deterministic process into a probabilistic Itô diffusion. Later, Blurring Diffusion Model (BDM, Hoogeboom and Salimans [38] ) recognized that IHDM could be recast as a

Read the complete text