A Joint Diffusion Approach to Multi-Modal Inference in Inertial Confinement Fusion
Michael Jones, Justin Kunimune, Daniel Casey, Bogdan Kustowski, Eugene Kur, Kelli Humbird · 2026
Read A Joint Diffusion Approach to Multi-Modal Inference in Inertial Confinement Fusion by Michael Jones, Justin Kunimune, Daniel Casey, Bogdan Kustowski, Eugene Kur, Kelli Humbird (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21006.txt.
Introduction
Michael Jones and five co-authors fuse simulation and experiment to read fusion shots. Their 2026 paper concerns inertial confinement fusion, or ICF. A mix of physics-based simulation and experiments was key to reaching ignition in ICF. Both sides produce mixed outputs: scalars and images. Only part of the simulated data is available in real shots. That gap makes inference about a shot hard.
The authors propose a joint diffusion approach to multi-modal inference. Diffusion models can fill in missing views in a principled way. Trained across both data worlds, the model can infer hidden values. Better inference helps physicists tune the next shot. The work joins plasma physics with machine learning.
Catalog record
| CREATOR | Michael Jones, Justin Kunimune, Daniel Casey, Bogdan Kustowski, Eugene Kur, Kelli Humbird |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21006
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Joint Diffusion Approach to Multi-Modal Inference in Inertial Confinement Fusion Michael Jones, Justin Kunimune, Daniel Casey, Bogdan Kustowski, Eugene Kur, Kelli Humbird Abstract A combination of physics-based simulation and experiments has been critical to achieving ignition in inertial confinement fusion (ICF). Simulation and experiment both produce a mixture of scalar and images outputs, however only a subset of simulated data are available experimentally. We introduce a generative framework, called JointDiff, which enables predictions of conditional simulation input and output distributions from partial, multi-modal observations. The model leverages joint diffusion to unify forward surrogate modeling, inverse inference, and output imputation into one architecture. We train our model on a large ensemble of three-dimensional Multi-Rocket Piston simulations and demonstrate high accuracy, statistical robustness, and transferability to experiments performed at the National Ignition Facility (NIF). This work establishes JointDiff as a flexible generative surrogate for multi-modal scientific tasks, with implications for understanding diagnostic constraints, aligning simulation to experiment, and accelerating ICF design. Introduction Inertial confinement fusion (ICF) has emerged as a leading approach for controlled nuclear fusion 41 , 3 , providing fundamental plasma physics insights and a potential pathway toward alternative energy. Scientific progress in ICF relies on a close interplay between simulation and experiment, in which each is iteratively refined based on data from the other. Machine learning models can enhance this interplay by acting as fast surrogates for simulations and by identifying input conditions that reproduce observed experimental outputs 4 , 25 , 14 , 37 . In practice, however, each implosion experiment yields a distinct and limited set of diagnostics, whereas simulations produce a richer and more uniform set of outputs. Moreover, these outputs are multi-modal – a combination of scalars and images – making it challenging to learn flexible conditional distributions based only on the available subset of diagnostics 24 . Multi-modal generative models have become powerful tools across scientific domains, enabling advances in biomolecular structure prediction, medical diagnostics, and materials design 1 , 40 , 39 . These models capture complex relationships across heterogeneous data types and often employ generative decoders such as denoising diffusion probabilistic models (DDPMs) 15 , 36 to generate high-quality samples. Multi-modal prediction is typically achieved either by combining data into a shared latent space prior to diffusion 5 , 26 or by aligning pre-existing latent representations using contrastive learning techniques 32 . While contrastive approaches allow the reuse of pre-trained models without exhaustive retraining, they may fail to capture subtle inter-modal dependencies by not explicitly modeling the full joint distribution 10 . An alternative strategy is to train a generative model directly on the joint distribution of multi-modal data. This approach has gained traction in domains such as generative biology, where diffusion models jointly update continuous atom positions and discrete atom types 11 , 31 , 8 . It has further been shown that joint diffusion is feasible and theoretically well-founded in arbitrary state spaces 16 , 33 , however the application of joint diffusion models as physics-based surrogates have been under-explored. We propose JointDiff, a model architecture and training scheme that leverages joint diffusion as a generative surrogate model for ICF. We train our model on a large ensemble of 3D Multi-Rocket Piston (RP) simulations 9 and demonstrate accuracy in forward and inverse modeling tasks as well as imputation of missing outputs. We show that JointDiff produces meaningful conditional distributions from partial multi-modal observations, enabling tunable uncertainty quantification and investigation of input sensitivity to missing diagnostics, with demonstrated transferability to experiments at the National Ignition Facility (NIF). Figure 1 : JointDiff is generative surrogate for forward, inverse, and imputation tasks. Simulations (upper row) produce a complete set of multi-modal outputs given a complete set of inputs. Surrogate models are trained to replace simulations and perform the forward or inverse predictions tasks. Experiments (bottom row) produce incomplete sets of outputs, and inputs to the capsule are unknown. In addition to forward and inverse surrogate capabilities, JointDiff predicts conditional distribution of inputs and outputs given partial multi-modal observations. Deep learning models have previously been applied as multi-modal ICF surrogates 4 , 25 and techniques such as Markov Chain Monte Marlo (MCMC) have been used to reconstruct simulations inputs from experimental outputs 14 , 24 , 37 , however implementing MCMC with multi-modal data is sensitive to choice of priors, computationally intensive, and may fail to converge. DDPMs have been applied as surrogates for Particle-in-cell (PIC) simulations 27 , which are crucial to understand fundamental plasma interactions during ICF implosions, and preliminary work showed that DDPMs can model 2D radiation hydrodynamics simulations outputs with single-channel images 21 . In this work, we generalize this framework to 3D simulation data using an multi-modal U-net based architecture amenable to arbitrary image views, images channels, and scalars inputs and outputs (Figure 2 ). We evaluate JointDiff on three core prediction tasks: (1) surrogate modeling (simulation inputs \rightarrow outputs), (2) inverse modeling (outputs \rightarrow inputs), and (3) imputation of missing outputs (partial outputs \rightarrow complete outputs and inputs). Each task (shown in Figure 1 ) addresses a critical component of the ICF design process – accelerating simulations for new input condition, inferring inputs for previous experiments, and enriching available outputs – leading to the development of higher-yield and more robust experiments. We perform round-trip consistency tests to demonstrate that the learned distributions remain stable and self-consistent even when a large fraction of simulation data is masked. Finally, we validate our approach using recent ICF experiments performed at the NIF, which contain only partial scalar and image diagnostics relative to simulations. Without fine-tuning on experimental data, JointDiff’s round-trip predictions closely reconstruct most experimental observables. We also note discrepancies in specific scalar and image features which provide insight into limitations of the underlying RP physics model. Together, these results show that JointDiff is a robust and flexible framework for predicting conditional distributions in ICF, and, more broadly, in scientific domains characterized by partial multi-modal observations. Figure 2 : Architecture of the JointDiff model. Outputs images contain primary (green) and down-scattered (pink) neutron intensities, which are encoded as separate image channels. Trapezoids represents data encoders and decoders, which are convolutional networks for images and fully connected networks for scalars data. Gray and blue boxes correspond to discrete masks which inform the model if true or noisy data is provided for each modality and are embedded by a fully connected network. Diffusion time is encoded by a sin/cos positional embedding. The time, mask, and input/output embeddings are concatenated to the image embeddings at each convolution step. Individual decoders predict noise to be removed at diffusion time t for each image and set of input and output scalars. Results Joint diffusion enables multi-modal conditional prediction To predict conditional distributions given multi-modal (scalar and image) data, we use a joint diffusion objective 16 , 32 . During training, noise is gradually added to both scalars and images and a single architecture learns to “denoise” both modalities at the same time. We apply random masking over inputs and outputs such that the models learns the distribution of outputs given inputs (forward model) as well of inputs given outputs (inverse model). Output masks are varied individually over scalars and images, enabling prediction of inputs and