A Probabilistic Framework for Solving High-Frequency Helmholtz Equations via Diffusion Models Journal: Journal of Computational Physics Yicheng Zou, Samuel Lanthaler, Hossein Salahshoor Abstract Deterministic neural operators perform well on many PDEs but can struggle with the approximation of high-frequency wave phenomena, where strong input-to-output sensitivity makes operator learning challenging, and spectral bias blurs oscillations. We argue for adopting a probabilistic approach for approximating waves in high-frequency regime, and develop our probabilistic framework using a score-based conditional diffusion operator. After demonstrating a stability analysis of the Helmholtz operator, we present our numerical experiments across a wide range of frequencies, benchmarked against other popular data-driven and machine learning approaches for waves. We show that our probabilistic neural operator consistently produces robust predictions with the lowest errors in L 2 L^{2} , H 1 H^{1} , and energy norms. Moreover, unlike all the other tested deterministic approaches, our framework remarkably captures uncertainties in the input sound speed map propagated to the solution field. We envision that our results position probabilistic operator learning as a principled and effective approach for solving complex PDEs such as Helmholtz in the challenging high-frequency regime. 1 Introduction Helmholtz equation is a class of elliptic PDEs that arise in modeling time-harmonic wave propagation with a wide range of applications in applied sciences from geophysics to medical fields such as imaging and therapeutic via ultrasound [ 2 , 26 , 41 , 39 , 40 , 28 ] . Solving Helmholtz equation in high-frequency regimes in heterogeneous media require very fine computational grids that often renders the problem as computationally prohibitive [ 13 , 10 , 4 , 15 , 24 , 16 , 54 ] . This, in turn, motivates learning-based surrogates that remarkably reduce computational cost via fast inference while aiming to preserve fidelity. Among these, operator learning targets mappings between function spaces rather than pointwise inputs and outputs, with representative approaches including DeepONet and the Fourier Neural Operator (FNO), as well as physics-tailored extensions for wave physics and elasticity [ 35 , 32 , 52 , 31 , 57 , 12 , 50 ] . However, high-frequency wavefields in heterogeneous media expose two persistent limitations of deterministic operators: (i) operator spectral bias , wherein models preferentially capture low-frequency content and oversmooth oscillatory structure, degrading phase accuracy and interference patterns critical to acoustics and seismics [ 18 , 29 , 48 ] ; and (ii) sensitivity to small perturbations in inputs (e.g., sound speed, geometry, or frequency), which can induce multi-modality or sharply varying responses that point-estimate predictors neither represent nor calibrate [ 27 , 30 , 7 ] . Probabilistic learning offers an alternative to deterministic (single-output) surrogates by modeling a distribution over solutions, thereby capturing multi-modality and input sensitivity [ 43 , 45 , 47 , 1 , 34 ] . Conditional diffusion model enable a concrete tool to examine probabilistic operator learning [ 42 , 25 , 6 , 33 , 46 , 49 ] , and we aim to employ it for high-frequency acoustics governed by the Helmholtz equation. We instantiate a conditional diffusion operator that maps problem inputs (sound-speed map, source mask, positional encodings) to the complex frequency-domain wavefield and evaluate it across low to high frequencies, comparing against strong deterministic baselines (FNO, HNO, and a backbone-matched U-Net). Our study revolves around two questions central to high-frequency prediction: (Q1) can a probabilistic operator preserve stable quantities—e.g., energies in sub-regions—more reliably than deterministic surrogates; and (Q2) can it produce calibrated uncertainty that faithfully reflects sensitivity to input perturbations? Although the underlying forward map is deterministic, practical indeterminacy at high frequencies makes single-output surrogates brittle. Our probabilistic formulation though remarkably learns a conditional distribution over solutions, using its mean for accuracy and its dispersion to encode epistemic sensitivity. In this paper, we use conditional diffusion models as probabilistic learning machines to: (i) learn fine-features in solutions fields of Helmholtz equation which are hard to capture, if at all possible, by any deterministic model, and (ii) to learn the push-forward of uncertainties in coefficient fields, reflected in our sensitivity study. Across all tested frequencies, diffusion achieves the lowest errors in L^{2} , H^{1} , and energy norm. We also demonstrate that diffusion model can predict the statistics of amplitudes in the far-field. Our sensitivity analysis further show that diffusion robustly mirrors the ground-truth variability and produces calibrated uncertainty, whereas deterministic operators are systematically under-dispersed and miss small-variance modes. Taken together, our results show that probabilistic operator learning is a promising approach for approximating high-frequency solutions of PDEs. 2 Related Work Operator learning for Helmholtz Neural operators promise fast surrogates for PDEs at scale, but Helmholtz problems expose their core weakness: preserving high-frequency structure. Fourier Neural Operators can efficiently model elastic waves at low frequencies and tend to smooth oscillations—an instance of spectral bias [ 52 , 31 , 8 ] . To alleviate this spectral bias, several Helmholtz-specific designs have emerged. Helmholtz Neural Operators (HNO) is one important example which operates in the frequency domain, exchanging time stepping for per-frequency solves and delivering substantial memory/runtime benefits while retaining accuracy on elastic wavefields [ 56 , 57 ] . Complementary efforts build analytic structure into the surrogate: Neumann–series neural operators target large wavenumbers to improve stability and error [ 12 ] , while multi-scale architectures inject resolution where spectral bias hurts most [ 50 ] . We have utilized HNO in our investigations as a benchmark to compare our results with. Diffusion models for PDE solution fields Diffusion models approach the problem from a different angle: rather than a single point estimate, they learn a distribution over solutions. Many efforts have aimed at developing physics-informed diffusion by introducing residual penalties and priors in training/sampling so that the generated fields satisfy governing equations [ 6 , 55 , 53 ] . Conditional diffusion, in particular, has shown strong fidelity on approximating solutions of PDEs [ 42 , 22 , 23 ] . Several studies have also investigated the partial observations scenarios, aiming to infer from sparse or indirect data [ 25 , 11 , 20 , 21 , 9 ] . Moreover, the concept of statistical learning in turbulence 19 has rendered probabilistic approaches such as conditional diffusion models a promising pathway for modeling turbulent fluids, which has recently been investigated [ 37 , 36 ] . There has also been a wide range of efforts on function-space diffusion models defining priors directly on continuous fields to achieve discretization-agnostic learning and transfer across resolutions [ 38 , 33 , 49 , 5 ] . 3 Theoretical Framework This section is devoted to the underlying theory for our framework. After describing the general setting, we focus on the Helmholtz problem, and delineate the input-sensitivity of the Helmholtz solution in the high-frequency regime. This, in turn, motivates our adoption of probabilistic learning via conditional score-based diffusion, which we subsequently describe in the last subsection. 3.1 Probabilistic operator learning for PDEs Consider a boundary–value problem on an open, connected domain \Omega\subset\mathbb{R}^{d} with boundary \partial\Omega , \mathcal{L}_{\kappa}\,u\;=\;f\quad\text{in }\Omega,\qquad\mathcal{B}\,u\;=\;g\quad\text{on }\partial\Omega, (1) where \mathcal{L}_{\kappa} is a differential operator depending on coefficient fields \kappa (e.g., sound speed, density), f is a source term, and g encodes boundary data. Under standard well-posedness assumptions, ( 1 ) induces a solution operator \mathcal{S}:\;\mathcal{Z}\to\mathcal{Y},\qquad z:=(\kappa,f,g)\in\mathcal{Z}\;\mapsto\;u=\mathcal{S}(z)\in\mathcal{Y}, (2) for suitable function spaces (e.g., \mathcal{Z}\subset L^{\infty}\times L^{2}\times H^{1/2} , \mathcal{Y}\subset H^{1} ). Classical solvers approximate \mathcal{S} per query by discretizing ( 1 ) and computing u_{h}\approx u , which is expensive in many-query regimes (varying z across geometries, coefficients, and frequencies). Operator learning seeks a data-driven surrogate \widehat{\mathcal{S}}_{\theta}:\mathcal{Z}\to\mathcal{Y} trained from pairs \{(z_{i},u_{i})\}_{i=1}^{N} with u_{i}=\mathcal{S}(z_{i}) , solving \displaystyle\theta^{\star} \displaystyle\in\arg\min_{\theta}\;\frac{1}{N}\sum_{i=1}^{N}\mathcal{L}\!\bigl(\widehat{\mathcal{S}}_{\theta}(z_{i}),\,u_{i}\bigr), (3) \displaystyle\mathcal{L}(a,b):=\|a-b\|_{\mathcal{Y}}, where \|\cdot\|_{\mathcal{Y}} is the norm in the solution space. Popular deterministic architectures (e.g., Fourier Neural Operators (FNOs) [ 32 ] , DeepONets [ 35 ] ) realize \widehat{\mathcal{S}}_{\theta} via learned integral kernels or spectral multipliers and return a single prediction \widehat{u}_{\theta}=\widehat{\mathcal{S}}_{\theta}(z) for input z . A probabilistic operator instead models the conditional law of the solution: for each z\in\mathcal{Z} , it represents a conditional distribution \mathbb{P}(u\mid z) and enables sampling u\sim p_{\vartheta}(\cdot\mid z) . We parameterize a conditional generator T_{\vartheta} and draw samples using a latent Gaussian \eta\sim\mathcal{N}(0,I) , u\;=\;T_{\vartheta}(\eta;z)\;\sim\;p_{\vartheta}(\,\cdot\,\mid z), (4) where p_{\vartheta}(\,\cdot\,\mid z)=T_{\vartheta,\#}\mathcal{N}(0,I) is the push-forward of the reference Gaussian under the learned generator. The specific choice of T_{\vartheta} and its training objective depends on the probabilistic family, and in this paper we focus on conditional diffusion models, while other instantiations include conditional normalizing flows and function-space priors. [ 33 , 46 , 49 , 42 , 25 , 14 ] . 3.2 High-frequency Helmholtz and why probabilistic helps We consider the Helmholtz equation c^{2}\nabla^{2}u+k^{2}u=0, (5) with inhomogeneous sound map c=c(x) . The Helmholtz equation underpins time-harmonic wave modeling in acoustics, elasticity, and scattering. Despite its ubiquity, its numerical solution is still facing many challenges. The reader is referred to 17 for a detailed description of the challenges in solving Helmholtz equation. In a nutshell, Helmholtz operator is neither Hermitian symmetric nor coercive, and is poorly conditioned, which makes it hard to solve via iterative methods. With these difficulties in place, in the high wavenumber regime additionally requires resolving short wavelengths and controlling dispersion (”pollution“) errors, which, collectively renders approximating high frequency solutions of Helmholtz a difficult problem. These difficulties have motivated studies on using neural operators for Helmholtz [ 52 , 31 , 8 , 56 , 57 ] . Two obstacles for deterministic operators are aggravated in the high-frequency regime of the Helmholtz equation: (i) spectral bias , where neural networks preferentially fit low-frequency content and oversmooth oscillations, degrading phase/interference fidelity; and (ii) input sensitivity , where tiny coefficient perturbations induce large phase shifts in the solution. Let S:\mathcal{Z}\!\to\!\mathcal{Y} map a sound-speed field c to the complex wavefield u=S(c) . Linearizing around a baseline c_{0} gives with recourse to Fréchet differentiability and using the operator norm of the differential: \delta u\;\approx\;DS[c_{0}]\,(\delta c),\qquad L(c_{0})\;:=\;\|DS[c_{0}]\|_{\mathrm{op}},\qquad\text{so}\;\;\frac{\|\delta u\|}{\|u_{0}\|}\;\lesssim\;L(c_{0})\,\frac{\|\delta c\|}{\|c_{0}\|}, (6) with u_{0}:=S(c_{0}) , where L(c_{0}) is the Lipchitz constant. The growth of L(c_{0}) with frequency can be made explicit by a standard geometric-optics, also known as WKB approximation, argument. Let us examine a one-dimensional model, since it carries the key ideas with least complexities. Helmholtz equation in dimension one Consider the 1D variable-coefficient Helmholtz equation u^{\prime\prime}(x)+k^{2}n(x)^{2}u(x)=0,\qquad n(x):=\frac{1}{c(x)},\quad x\in[0,\ell], (7) in the high-frequency regime k\gg 1 . Using the WKB ansatz u(x)=a(x)e^{ik\phi(x)} and retaining the leading-order phase (i.e. k^{2} terms), one obtains the travel time \tau(x)=\int_{0}^{x}\!ds/c(s) and the leading approximation u(x)\;\approx\;A_{0}\,\exp\!\Big(\pm ik\!\int_{0}^{x}\!\frac{ds}{c(s)}\Big). (8) Now perturb c=c_{0}+\delta c with \|\delta c\|_{\infty}/\|c_{0}\|_{\infty}\ll 1 . Since n=1/c , we have \delta n(x)=-\delta c(x)/c_{0}(x)^{2}+\mathcal{O}(\delta c^{2}) , hence the travel-time perturbation satisfies \delta\tau(x)\;=\;\int_{0}^{x}\delta n(s)\,ds\;=\;-\int_{0}^{x}\frac{\delta c(s)}{c_{0}(s)^{2}}\,ds+\mathcal{O}(\delta c^{2}). (9) Substituting into ( 8 ) (and neglecting subleading amplitude changes) yields a phase-dominated relative error, \frac{\delta u(x)}{u_{0}(x)}\;\approx\;\exp\!\big(\pm ik\,\delta\tau(x)\big)-1,\qquad\Big|\tfrac{\delta u(x)}{u_{0}(x)}\Big|\;\lesssim\;k\int_{0}^{x}\frac{|\delta c(s)|}{c_{0}(s)^{2}}\,ds. (10) If c_{0} is approximately constant along the path (or locally bounded below by c_{0,\min} ), this simplifies to \Big|\tfrac{\delta u(x)}{u_{0}(x)}\Big|\;\lesssim\;\underbrace{\frac{k\,x}{c_{0}}}_{=:L(k,x,c_{0})}\,\frac{\|\delta c\|_{\infty}}{c_{0}}\;\leq\;\underbrace{\frac{k\,\ell}{c_{0}}}_{=:L(k,\ell,c_{0})}\,\frac{\|\delta c\|_{\infty}}{c_{0}}. (11) Thus, even tiny coefficient errors can produce order-one wavefield errors once k\ell\gg 1 , i.e., after sufficient phase accumulation. Extension to higher dimensions The same mechanism carries to d\geq 2 : under geometric-optics assumptions (single dominant ray, no caustics), the solution at a receiver \boldsymbol{r} admits the ray form u(\boldsymbol{r})\;\approx\;A(\boldsymbol{r})\,\exp\!\Big(\pm ik\!\int_{\gamma(\boldsymbol{r})}\!\frac{ds}{c(s)}\Big), (12) where \gamma(\boldsymbol{r}) is the ray from the source to \boldsymbol{r} with length \ell(\boldsymbol{r}) . A perturbation c=c_{0}+\delta c induces an accumulated phase shift \delta\phi(\boldsymbol{r})\;\approx\;-\,k\!\int_{\gamma(\boldsymbol{r})}\!\frac{\delta c(s)}{c_{0}(s)^{2}}\,ds,\qquad\frac{\delta u(\boldsymbol{r})}{u_{0}(\boldsymbol{r})}\;\approx\;e^{\,\pm i\,\delta\phi(\boldsymbol{r})}-1, (13) so the effective sensitivity grows with k and the travel distance \ell(\boldsymbol{r}) , and is smallest near the source—precisely the scaling formalized in Eqs. (6)–(7). If the induced phase perturbation \delta\phi(\boldsymbol{r}) can be treated as random (reflecting unresolved input variability or modeling error), then the MSE-optimal deterministic predictor collapses oscillations by vector-averaging on the unit circle: \hat{u}_{\mathrm{MSE}}(\boldsymbol{r})=\mathbb{E}[u(\boldsymbol{r})\,|\,z]\;\approx\;u_{0}(\boldsymbol{r})\,\mathbb{E}\!\big[e^{\,i\delta\phi(\boldsymbol{r})}\big]\;\approx\;u_{0}(\boldsymbol{r})\,e^{-\tfrac{1}{2}\mathrm{Var}[\delta\phi(\boldsymbol{r})]}. (14) The exponential attenuation produces amplitude shrinkage, blurred interference, and loss of high-frequency contrast—exactly when the sensitivity factor scales like L(k,\ell)\propto k\ell . A probabilistic operator instead models the conditional law p_{\vartheta}(u\,|\,z) by internalizing phase ambiguity and input sensitivity rather than collapsing them into a single output. Drawing samples \{u^{(s)}\}_{s=1}^{S}\sim p_{\vartheta}(\cdot\,|\,z) allows: (i) preserving oscillations and multi-modality at prediction time (via samples representing uncertain phase modes, not just a learned mean); (ii) quantifying calibrated uncertainty that tracks sensitivity; and (iii) reporting stable functionals where phase cancels. For example, the energy E(u)\;=\;\int_{\Omega}\!\Big(\|\nabla u(\boldsymbol{r})\|^{2}+\tfrac{k^{2}}{c_{0}(\boldsymbol{r})^{2}}\,|u(\boldsymbol{r})|^{2}\Big)\,d\boldsymbol{r} (15) can be estimated in a Bayes-optimal way for energy risk by \hat{E}=\mathbb{E}[E(u)\,|\,z]\approx\tfrac{1}{S}\sum_{s=1}^{S}E(u^{(s)}) , which remains stable even when \mathbb{E}[u\,|\,z] is attenuated by phase dispersion. Practically, p_{\vartheta}(u\,|\,z) lets us decouple fragile quantities (phase, pointwise fields) from stable ones (energy, band-limited summaries), deliver coverage diagnostics for sensitivity-aware calibration, and choose decision rules matched to the evaluation metric—yielding robustness exactly where deterministic surrogates struggle. 3.3 Conditional diffusion model for probabilistic learning In this subsection, we describe our adopted conditional diffusion models for probabilistic learning of wavefields. Let us denote the Helmholtz solution as u_{0} , our objective is to approximate the conditional law p_{\theta}(u_{0}\mid z) given the PDE inputs, where u_{0}\in\mathbb{C}^{H\times W} and z=[\,c,\,m,\,\mathrm{PE}_{x},\,\mathrm{PE}_{y}\,] concatenates the sound-speed map c , a binary source mask m , and sinusoidal positional encodings (we are assuming a 2D square domain for the sake of simplicity). This is achieved through noising and denoising process. For the first step, a forward noising chain progressively corrupts u_{0} to u_{T} as q(u_{t}\mid u_{t-1})=\mathcal{N}\!\bigl(u_{t};\sqrt{\alpha_{t}}\,u_{t-1},(1-\alpha_{t})I\bigr),\quad q(u_{t}\mid u_{0})=\mathcal{N}\!\bigl(u_{t};\sqrt{\bar{\alpha}_{t}}\,u_{0},(1-\bar{\alpha}_{t})I\bigr), (16) with schedule \{\beta_{t}\}_{t=1}^{T}\subset(0,1) , \alpha_{t}=1-\beta_{t} , and \bar{\alpha}_{t}=\prod_{s\leq t}\alpha_{s} . Then, for the next step we use a time-indexed Gaussian family to approximate the reverse conditionals \displaystyle p_{\theta}(u_{t-1}\mid u_{t},\mathrm{z}) \displaystyle=\mathcal{N}\!\bigl(u_{t-1};\,\mu_{\theta}(u_{t},t,\mathrm{z}),\,\sigma_{t}^{2}I\bigr), (17) \displaystyle\mu_{\theta}(u_{t},t,\mathrm{z}) \displaystyle=\frac{1}{\sqrt{\alpha_{t}}}\!\left(u_{t}-\frac{\beta_{t}}{\sqrt{1-\bar{\alpha}_{t}}}\,\varepsilon_{\theta}(u_{t},t,\mathrm{z})\right), where a U - Net with time embeddings parametrizes the noise predictor \varepsilon_{\theta} . We note that the conditioning z is never noised. The learning objective aligns with conditional denoising score matching is: \mathcal{L}(\theta)=\mathbb{E}_{u_{0},z,t,\varepsilon}\Big\|\varepsilon-\varepsilon_{\theta}\!\big(u_{t},t,z\big)\Big\|_{2}^{2},\qquad u_{t}=\sqrt{\bar{\alpha}_{t}}\,u_{0}+\sqrt{1-\bar{\alpha}_{t}}\,\varepsilon,\ \ \varepsilon\sim\mathcal{N}(0,I), (18) During the inference, we generate S ancestral samples by iterating u_{T}\!\sim\!\mathcal{N}(0,I) through t=T\!\to\!1 to obtain \{u_{0}^{(s)}\}_{s=1}^{S}\sim p_{\theta}(\cdot\mid z) . 4 Details of datasets and training In this section we delineate the details of data generation and diffusion model training. Data generation For a fixed frequency, we synthesize a dataset comprised of 10000 pairs of sound speed maps and Helmholtz solution, i.e. \{c_{j}(x),u_{j}(x)\}_{j=1}^{10000} . Each c_{j} is generated using a family of Gaussian random fields (GRFs; see A.1 ) where GRF parameters are randomly chosen from a range of amplitudes and correlation lengths. Out of the 10000 synthesized data, we allocate 8190, 1020, and 500 respectively for training, validation, and testing. Figure 1 : Conditional diffusion for Helmholtz. Forward diffusion (top): the wavefield u_{0} is progressively noised by a fixed schedule to a Gaussian field u_{T} . Reverse denoising (bottom): sampling starts from pure Gaussian u_{T} and is conditioned on the inputs z comprised of sound-speed map c , as well as source mask and positional encodings that are not shown. A time-indexed U-Net (“Trained Score Net”) predicts noise and removes it iteratively over T\!\approx\!1000 steps to produce samples u_{0}^{(s)} that approximate the conditional distribution of solutions. The dataset is generated with recourse to the Helmholtz PDE solver J-Wave , which is a powerful spectral method based solver developed via JAX [ 44 ] . In particular, for each sound speed map c_{j} , we solve the Helmholtz equation: \Bigl(\nabla^{2}\;+\;\tfrac{\omega^{2}}{c_{j}(x)^{2}}\Bigr)u_{j}\;=\;F, (19) where u_{j} is the complex pressure field at angular frequency \omega=2\pi f in a square domain with a 256\times 256 Cartesian grid, F is a masked source term with a disk mask of radius r_{s}{=}10 in terms of the grid points, and perfectly matched layers (PML) is implemented in the boundaries to eliminate the effects of boundary reflections. We repeat the aforementioned to generate six datasets for six different frequencies, ranging from 1.5{\times}10^{5} to 2.5{\times}10^{6} Hz. Without loss of generality, and to reflect a concrete application, both frequencies and sound speed ranges are chosen to reflect modeling ultrasonic waves in tissues. During the learning process, we expand the input to include normalized c , source mask, and sinusoidal positional encodings, with the wavefield solutions as target. Conditional diffusion for Helmholtz operator Unlike existing application of Diffusion models in time-dependent PDEs, such as PDE–DIFF [ 42 ] , we learn a solution operator that corresponds to steady state waves, which means there is no temporal stacking and each training example is a single instance at a fixed frequency. We adopt the conditional denoising formulation, where only the target wavefield is noised, while the inputs are kept clean and given as conditioning. The backbone score net is a 2D U - Net with five down/up stages (widths [48,96,192,384,768] ), three residual blocks per stage, LayerNorm, SiLU, and circular padding (Fig. 1 ). A sinusoidal time embedding is passed through an MLP ( 128\!\to\!256\!\to\!64 ) to produce a 64-D context vector. The conditioning tensor C is used two ways: (i) concatenated to the input image stack, and (ii) mapped (via a linear layer) from the 64-D context to the current block’s channel width to generate FiLM scale/shift (\gamma,\beta)\in\mathbb{R}^{f} , applied as y=\gamma\odot h+\beta . Lastly, the network predicts a single output channel (wavefield amplitude). See Figure 1 for an overview of the training/sampling pipeline and the FiLM-conditioned U-Net. For further details, the reader is referred to A ). 5 Results We organize our experimental results into three parts: (i) error analysis , where we quantify the performance of our probabilistic framework and compare it against existing neural-operator baselines; (ii) sensitivity analysis , where we examine how uncertainty in the sound-speed field propagates to variability in the predicted wavefields; and (iii) preliminary 3D results , where we extend the method to fully 3D Helmholtz problems and evaluate an enhanced diffusion backbone based on a U-shaped vision transformer (UViT). For clarity and worst-case visualization, we present sensitivity results primarily at the highest frequency f=2.5\times 10^{6}\,\mathrm{Hz} ; additional frequencies and extended panels are provided in the Appendix. Table 1 : Relative errors across frequencies. Diffusion reports mean \pm std over K{=}10 samples. Frequency (Hz) Metric U-Net FNO HNO Diffusion 1.5e5 L^{2} 0.040 0.167 0.115 0.027 \pm 0.004 H^{1} 0.071 0.219 0.164 0.045 \pm 0.004 Energy 0.022 0.114 0.071 0.016 \pm 0.003 2.5e5 L^{2} 0.077 0.190 0.153 0.028 \pm 0.001 H^{1} 0.121 0.278 0.219 0.044 \pm 0.001 Energy 0.026 0.086 0.075 0.013 \pm 0.002 5e5 L^{2} 0.083 0.176 0.133 0.018 \pm 0.002 H^{1} 0.122 0.223 0.189 0.035 \pm 0.002 Energy 0.036 0.105 0.069 0.013 \pm 0.005 1e6 L^{2} 0.101 0.306 0.177 0.025 \pm 0.005 H^{1} 0.150 0.352 0.254 0.040 \pm 0.007 Energy 0.033 0.091 0.082 0.017 \pm 0.008 1.5e6 L^{2} 0.464 0.363 0.398 0.046 \pm 0.011 H^{1} 0.639 0.434 0.557 0.070 \pm 0.015 Energy 0.249 0.103 0.162 0.026 \pm 0.015 2.5e6 L^{2} 0.767 0.412 0.802 0.095 \pm 0.019 H^{1} 1.000 0.494 0.996 0.135 \pm 0.028 Energy 0.514 0.141 0.590 0.036 \pm 0.016 5.1 Error analysis We have investigated different diffusion frameworks with different noise scheduling, where we ablate diffusion samplers (computed once per setting) across step budgets N_{t}\!\in\!\{10,50,100,1000\} : DDPM with both linear and cosine noise schedules, DDIM (cosine), and SDE (cosine). Among the samplers we tested, DDPM with a cosine noise schedule achieves the highest accuracy at our largest step budget ( N_{t}=1000 ). We therefore adopt DDPM as our default sampler and provide the full ablation details—showing that DDPM consistently outperforms the alternatives—in B . To compare our results against deterministic frameworks, we have adopted Fourier Neural Operator (FNO) and the more recent Helmholtz Neural Operator (HNO), and trained them on the identical datasets used for the diffusion models (details of FNO and HNO can be found in A ). We have computed and interrogated FNO, HNO, and backbone U - Net results as baseline deterministic approaches against our probabilistic framework. Table 1 summarizes the relative L^{2} and H^{1} errors for six different frequencies, ranging from low 150 kHz to 2.5 MHz. Since often in practice one is interested in energy, we have also quantified the relative energy errors defined as \mathcal{E}_{\text{energy}}(\hat{u},u)=|E(\hat{u})-E(u)|/E(u) with E(u)=\int_{\Omega}(\|\nabla u\|^{2}+\tfrac{k^{2}}{c(x)^{2}}|u|^{2})\,dx . (a) ( f=1.5\times 10^{5} Hz) (b) ( f=5\times 10^{5} Hz) (c) ( f=1\times 10^{6} Hz) (d) ( f=2.5\times 10^{6} Hz) (e) Prediction vs. Ground Truth Residual (Pred - GT) Figure 2 : Qualitative comparisons across selected frequencies. Each row shows, left-to-right, Sound Map (c), Ground Truth (GT), U-Net, FNO, HNO, Diffusion, followed by the comparison to GT. We note that diffusion results are obtained by drawing K=10 samples per test input, and mean \pm std are reported. Our results demonstrate that diffusion models consistently yield smaller errors, and as frequency is ramped up, our probabilistic approach exhibits an order of magnitude lower errors compared to the best of three deterministic approaches. Notably, at 2.5 MHz, relative L^{2} error for diffusion model is 0.095\pm 0.019 , while the same quantity is computed for U-Net, FNO, and HNO as 0.767, 0.412, and 0.802, respectively. We further illustrate the computed wavefield solutions for a randomly chosen sound speed map. Figure. 2 shows the ground truth (GT), U-Net, FNO, HNO, and Diffusion results and their corresponding errors at a subset of four frequencies (see C.2 for more results). We observe that the Diffusion model outperforms the other deterministic approaches in capturing wave patterns and fine features of solutions. Figure 3 : 2D spectral power comparison at f=2.5\times 10^{6} Hz. Example Fourier power spectra |F(k_{x},k_{y})|^{2} for GT and each model on a single test sample. To make these observations more quantitative, we also analyze the 2D Fourier power spectra of the predicted wavefields. For a fixed high frequency (e.g., f=2.5\times 10^{6}\,\text{Hz} ), we compute the 2D FFT of GT and each model prediction and visualize the corresponding power |F(k_{x},k_{y})|^{2} over the full (k_{x},k_{y}) domain. As illustrated in Fig. 3 , the deterministic baselines (in particular the U - Net backbone and HNO) exhibit clear spectral bias: they oversmooth or misallocate energy at large wavenumbers, deviating substantially from the ground-truth spectrum. In contrast, the Diffusion model closely tracks the GT power spectrum across both low and high spatial frequencies, indicating that it captures the full range of oscillatory content rather than collapsing toward low- k modes. 5.2 Sensitivity analysis To quantify how uncertainty in the sound-speed map is pushed forward to uncertainty in the wavefield, we probe the solution map along controlled perturbation paths in coefficient-function space (Fig. 4 ). We first select a reference medium c_{0} (the red point) and draw D{=}100 GRF realizations \{c^{(d)}\}_{d=1}^{D} that define distinct perturbation directions/endpoints (black points). For each direction d , we construct a linear homotopy c^{(d)}(s)\;=\;(1-s)c_{0}+s\,c^{(d)},\qquad s\in[0,1], (20) discretized into S{=}100 interpolation steps. In the geometric view of Fig. 4 , each dashed ray is one path from c_{0} toward a GRF endpoint, and the concentric contour circles represent fixed interpolation radii (e.g., s=0.3,0.5,0.7,1.0 ), i.e., increasing deviation from the baseline. Figure 4 : Illustration of coefficient-function space and interpolation paths. The red point denotes the reference (baseline) medium c_{0} . The surrounding black points \{c^{(d)}\}_{d=1}^{D} indicate distinct GRF directions/realizations in coefficient space. For each direction d , we define a linear homotopy (dashed ray) c^{(d)}(s)=(1-s)c_{0}+s\,c^{(d)} , which traces a path from the center c_{0} toward the endpoint c^{(d)} . The concentric contour circles visualize fixed interpolation levels s\in\{0.3,0.5,0.7,1.0\} : moving outward corresponds to increasing deviation from c_{0} , with s=1.0 reaching the full GRF realization. For every coefficient realization c^{(d)}(s) , we evaluate the model prediction u_{M}(\cdot;\,c^{(d)}(s)) at 8 probe pixels: 4 near the source region and 4 far near the PML boundary. For small s , the initial slope along each dashed path provides a local, directional measure of sensitivity, \left.\frac{d}{ds}u(\cdot;\,c^{(d)}(s))\right|_{s=0}\;\approx\;DS[c_{0}]\,[c^{(d)}-c_{0}], (21) which directly connects to the high-frequency scaling |\delta u/u_{0}|\lesssim(k\,r/c_{0})\,(\|\delta c\|/c_{0}) (Sec. 3 ). As s increases (moving outward across the contour circles), the medium departs further from c_{0} , and the responses increasingly reflect accumulated phase error and interference variability rather than purely local linear behavior. Placing probes both near and far allows a direct examination of the distance-to-source dependence L\propto k\,r/c_{0} . We utilize two complementary visualizations: first, sampling along a fixed direction d to show rate-of-change along a single path, and second, kernel density estimate (KDE) across directions at fixed s to estimate the pushforward variability of u under random coefficient perturbations. Hence, we interrogate sensitivity locally near c_{0} (at s{=}0 and s{=}0.1 ) and at finite amplitudes (around s\approx 1 ) within one unified experimental design. At the highest frequency ( 2.5{\times}10^{6} Hz), sampling plot reveals a clear separation: at the near-source probe, both diffusion model and majority of deterministic models can follow the ground-truth trajectory u^{\star}(s,d^{\star};y,x) across the entire path, matching both amplitude and phase; but at the near-boundary probe the discrepancy amplifies—only diffusion reproduces the rapid, non-monotone oscillations and turning points of the complex trajectory, while most deterministic models drift or flatten, consistent with the boundary oversmoothing in Figure 2 ( Figure 5 ). In the density plot view, at s{=}0 all inputs satisfy c^{(d)}(0)=c_{0} , so the solver produces a single spike; deterministic models also produce a spike but it is biased relative to the solver’s value, whereas diffusion yields a narrow yet non-degenerate predictive distribution that covers the ground-truth spike—reflecting the fact that at high frequency the map c\!\mapsto\!u is effectively one-to-many (phase ambiguity, discretization/model mismatch, and measurement noise make several wavefields plausible for the same inputs). We turn this stochasticity to our benefit as diffusion model learns p(u\mid x) rather than a single point, quantifying the push-forward distribution instead of committing to a potentially biased mean ( Figures 6 , 7 and 8 ). At s{=}1 , only diffusion captures the ground truth’s broad amplitude distribution across directions, again consistent with the qualitative boundary behavior ( Figures 6 , 7 , 8 and 2 ). We also note that for all sensitivity plots we use one diffusion sample per input to expose the predicted distribution rather than its mean. Near source Near boundary Figure 5 : Sampling along a coefficient path \mathbf{d{=}1} (all 4 near vs. all 4 far). For each pair of media, we linearly interpolate the sound speed c_{s}=(1-s)c_{0}+s\,c_{1} with s\in[0,1] and track the wavefield amplitude at fixed probe pixels. Left column: near-source probes. Right column: near-boundary probes. Near source Near boundary Figure 6 : Kernel density estimates across directions for \mathbf{s{=}0} (all 4 near vs. all 4 far). Left column: near the source. Right column: near the boundary. Near source Near boundary Figure 7 : Kernel density estimates across directions for \mathbf{s{=}0.1} (all 4 near vs. all 4 far). Left column: near the source. Right column: near the boundary. Near source Near boundary Figure 8 : Kernel density estimates across directions for \mathbf{s{=}1} (all 4 near vs. all 4 far). Left column: near the source. Right column: near the boundary. 5.3 Preliminary Extensions to 3D Helmholtz Our framework is readily extendable to three-dimensional problem, which we explore in this subsection. The computational challenges arising in three dimensions demand a more efficient diffusion framework. We thus leverage Vision Transformers as the backbone of our diffusion model to demonstrate the superiority of our probabilistic approach, qunatified by our error analysis. Figure 9 : Architecture of the conditional UViT backbone used in our diffusion model. 5.3.1 Network backbone – UViT After establishing our main results in 2D, we next extend the framework to 3D Helmholtz wavefields. A key methodological change in this transition is the backbone used within the diffusion model: whereas many prior diffusion-based surrogates rely on U - Net-style CNN backbones, we adopt a U-shaped vision transformer (UViT) to better capture long-range spatial dependencies and global interference patterns that become more pronounced in 3D. Due to the substantially higher data and computational complexity in 3D, we treat these experiments as preliminary : in this section we focus on error analysis only, and defer a full sensitivity study (as in 2D) to future work. Our UViT backbone, illustrated in Fig. 9 , is a U-shaped vision transformer inspired by 36 and adapted here for Helmholtz wavefields. The network processes multi-scale feature maps in an encoder–decoder hierarchy. At each resolution level, it applies stacks of residual blocks (blue), optionally interleaved with self-attention blocks (red) at selected scales. The downsampling and upsampling paths are linked by skip connections, as in a standard U - Net, to preserve fine-scale information while enabling global context aggregation. Table 2 : 3D Helmholtz errors on 64^{3} grids. Relative L^{2} , H^{1} , and energy errors (mean \pm std, clamped to \leq 1 ) over N=500 test samples for our frequencies. Diffusion–UViT consistently outperforms Diffusion–UNet and the vanilla U-Net. Frequency (Hz) Metric Diffusion–UNet Diffusion–UViT U-Net only 5\times 10^{5} L^{2} 0.030 \mathbf{0.013} 0.180 H^{1} 0.050 \mathbf{0.019} 0.287 Energy 0.041 \mathbf{0.019} 0.102 1.0\times 10^{6} L^{2} 0.032 \mathbf{0.011} 0.295 H^{1} 0.049 \mathbf{0.016} 0.455 Energy 0.037 \mathbf{0.012} 0.170 1.5\times 10^{6} L^{2} 0.063 \mathbf{0.016} 0.874 H^{1} 0.091 \mathbf{0.024} 1.000 Energy 0.101 \mathbf{0.014} 0.752 2.5\times 10^{6} L^{2} 0.159 \mathbf{0.078} 0.967 H^{1} 0.229 \mathbf{0.112} 1.000 Energy 0.178 \mathbf{0.049} 0.793 Conditioning on the diffusion time \sigma and the latent code z_{n} (green arrows in Fig. 9 ) is implemented via feature-wise affine modulation. Specifically, (z_{n},\sigma) are embedded by Fourier encoders \mathrm{FE}_{z} and \mathrm{FE}_{\sigma} , then mapped by linear layers to scale and shift vectors (a,b) . Within each residual block, these parameters modulate the normalized features through a FiLM-style transformation a\odot v+b , where v denotes the current feature map. Residual blocks consist of GroupNorm (GN), pointwise nonlinearities f , and convolutional layers C , as indicated on the right of Fig. 9 . Attention blocks use standard multi-head self-attention with query–key–value projections (Q,K,V) and a softmax operator, applied to flattened spatial tokens at the corresponding resolution. Overall, this backbone combines the locality and multiscale structure of a U - Net with the long-range interactions and flexible conditioning of transformers, making it a strong architectural choice for diffusion modeling of 3D Helmholtz wavefields. 5.3.2 3D results Having introduced the UViT backbone as our primary architectural upgrade for diffusion-based operators, we now evaluate these models on fully 3D Helmholtz problems. We consider 64^{3} grids and four frequencies, 5\times 10^{5} , 10^{6} , 1.5\times 10^{6} , and 2.5\times 10^{6}\,\mathrm{Hz} . We start from 5\times 10^{5}\,\mathrm{Hz} because, in the 2D experiments, all models already performed comparably well at lower frequencies (e.g., 1.5\times 10^{5} and 2.5\times 10^{5}\,\mathrm{Hz} ), whereas performance gaps became pronounced only as frequency increased. Focusing the 3D study on 5\times 10^{5}\,\mathrm{Hz} and above therefore emphasizes the more challenging, high-frequency regime where phase errors and interference effects are amplified. In this setting, we compare three models: a diffusion model with a U - Net backbone ( Diffusion–UNet ), a diffusion model with a UViT backbone ( Diffusion–UViT ), and a deterministic U - Net trained to predict the wavefield directly. We retain both diffusion variants to isolate the impact of the backbone architecture and directly assess the benefit of moving from a convolutional U - Net backbone to a transformer-based UViT backbone within the same probabilistic (diffusion) framework. (a) GT (full) (b) D-UNet (full) (c) D-UViT (full) (d) U-Net (full) (e) GT (thresholded) (f) D-UNet (thresholded) (g) D-UViT (thresholded) (h) U-Net (thresholded) Figure 10 : Example 3D Helmholtz wavefield visualization using volume rendering from a fixed viewpoint: top row shows the full 3D visualization; bottom row uses a threshold to focus on center region to elaborate the differences. Across all models, relative L^{2} , H^{1} , and energy errors increase with frequency, consistent with the 2D setting. However, Diffusion–UViT achieves the lowest errors at every frequency, substantially outperforming both Diffusion–UNet and the deterministic U - Net. The qualitative 3D renderings in Fig. 10 corroborate these quantitative trends: the deterministic U - Net prediction remains overly concentrated near the domain center, whereas both diffusion models better recover wave structure toward the boundaries. Among them, Diffusion–UViT yields the sharpest boundary reconstruction and the most faithful global interference pattern. 6 Conclusion This paper presents a novel probabilistic machine-learning framework for solving the deterministic Helmholtz equation in high-frequency regimes. Using conditional diffusion models as probabilistic operators, we show that learning a distribution over wavefields yields substantially improved accuracy and robustness compared to deterministic neural operators, particularly as frequency increases. Across all tested frequencies, diffusion achieves lower L^{2} , H^{1} , and energy errors, with the performance gap widening markedly in the highest-frequency cases (Table 1 ). Qualitative comparisons further show that diffusion preserves interference patterns and far-field structure that deterministic surrogates systematically smooth away (Fig. 2 ). These results follow from the sensitivity structure of the Helmholtz equation at high frequency. As shown in Sec. 3 , small perturbations in the sound-speed field accumulate into phase errors that scale with k and distance from source, rendering the solution map sharply varying in high k and far-field. In this regime, point-estimate surrogates trained with mean-squared error effectively average over phase variability, leading to attenuation of oscillations and loss of phase coherence even when the training data contain fully resolved solutions, as obtained in our U-Net, FNO, and HNO predictions. By contrast, diffusion models represent a conditional distribution over solutions rather than committing to a single output. This distinction becomes particularly important for quantities that remain stable under phase variability. In our experiments, energy-type functionals are consistently predicted with high accuracy by diffusion, even at frequencies where deterministic surrogates deteriorate significantly. Averaging energies over samples provides a reliable estimator precisely when pointwise complex fields become fragile. The sensitivity experiments reinforce this interpretation. Along controlled perturbation paths in coefficient function space, diffusion tracks solver trajectories more faithfully, including non-monotone behavior induced by accumulated phase error, while deterministic models often flatten or drift away from the reference solution. When aggregating across perturbation directions, diffusion captures the widening pushforward variability of the solver response, whereas deterministic operators systematically miss components of the solution variability. Although the Helmholtz equation defines a deterministic map, these results demonstrate that high-frequency prediction in heterogeneous media is effectively one-to-many under unresolved variability and discretization mismatch, and that modeling a conditional law provides a more faithful surrogate. An important direction to improve our framework is to reduce its computational cost. Achieving the highest accuracy requires many diffusion steps, which increases inference time relative to deterministic operators - though still at a fraction of the cost of direct solvers. Building upon the framework here, we envision accelerating the inference as a natural future work via flow matching training [ 3 ] , improved ODE/SDE solvers [ 51 ] , or latent or patchwise diffusion. Beyond efficiency, extending the framework to more complex geometries, multi-source configurations, and fully three-dimensional propagation will further test its robustness. Our preliminary 3D results already suggest that combining probabilistic operators with architectures capable of capturing long-range interactions can substantially improve fidelity in this setting. Funding This research was in part supported by the internal funding provided by the Duke University. CRediT authorship contribution statement Yicheng Zou: Conceptualization, Methodology, Software, Data curation, Formal analysis, Investigation, Visualization, Writing – original draft. Samuel Lanthaler: Methodology, Formal analysis, Supervision, Writing – review & editing. Hossein Salahshoor: Conceptualization, Methodology, Formal analysis, Supervision, Funding acquisition, Project administration, Writing – review & editing. Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. Data availability Code and scripts to reproduce all figures and tables are available at: https://github.com/YichengZou626/Diffusion-Model-for-High-Frequency-Helmholtz . The datasets generated for this study, model training, and post-processing pipelines are documented in the repository. Appendix A Method Details A.1 Gaussian random fields We synthesize heterogeneous acoustic media by sampling stationary Gaussian random fields (GRFs) on the simulation grid and mapping them to sound speed. Specifically, we construct a mean-zero GRF in the Fourier domain by filtering complex white noise with an exponential spectral envelope and then applying an inverse real FFT (see Algorithm 1 ). This yields families of coefficient fields with controllable smoothness and correlation length, providing ground-truth dataset across frequencies for the Helmholtz operator-learning benchmarks in the main text. Algorithm 1 Sampling heterogeneous sound-speed fields via spectral GRFs 1: Grid size (N_{x},N_{y}) ; background speed c_{\mathrm{bg}} ; scale \sigma_{c} ; bounds [c_{\min},c_{\max}] 2: Sample hyperparameters: \alpha\sim\mathcal{U}(0.5,\,2.5) , \;\ell\sim\mathcal{U}(0.35,\,0.7) 3: Construct frequency grids k_{x}=\mathrm{fftfreq}(N_{x}) , k_{y}=\mathrm{rfftfreq}(N_{y}) ; form mesh K=\sqrt{k_{x}^{2}+k_{y}^{2}} 4: Define spectral envelope \lambda\leftarrow\exp\!\big(-(\ell\,K)^{\alpha}\big) 5: repeat 6: Draw complex white noise \eta\leftarrow\eta_{\mathrm{r}}+i\,\eta_{\mathrm{i}} , with \eta_{\mathrm{r}},\eta_{\mathrm{i}}\stackrel{{\scriptstyle\text{i.i.d.}}}{{\sim}}\mathcal{N}(0,1) 7: Spectral field \hat{u}\leftarrow\lambda\odot\eta 8: Realization u\leftarrow\mathrm{irfft2}(\hat{u};\,N_{x},N_{y}) ;   mean–center: u\leftarrow u-\mathrm{mean}(u) 9: Map to sound speed: c(x)\leftarrow c_{\mathrm{bg}}+\sigma_{c}\,u(x) 10: until c_{\min}