Parameter conditioned interpretable U-Net surrogate model for data-driven predictions of convection-diffusion-reaction processes

Michael Urs Lars Kastor, Jan Rottmayer ∗, Anna Hundertmark, Nicolas Ralph Gauger · 2026

Read Parameter conditioned interpretable U-Net surrogate model for data-driven predictions of convection-diffusion-reaction processes by Michael Urs Lars Kastor, Jan Rottmayer ∗, Anna Hundertmark, Nicolas Ralph Gauger (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22654.txt.

Introduction

Michael Urs Lars Kastor, Jan Rottmayer, Anna Hundertmark, and Nicolas Ralph Gauger built a U-Net surrogate that predicts cancer-cell dynamics under set parameters. Their 2026 preprint pairs a careful solver, written in C++, with a data-driven model. The target system mixes diffusion, flow, and reaction on a flat domain of cell types.

The solver gives trusted runs; the surrogate gives fast ones, tuned by the parameters. Fast, faithful forecasts let teams scan many drug or growth cases. The model keeps its logic open to inspection. The work serves the math side of cancer research.

Catalog record

CREATORMichael Urs Lars Kastor, Jan Rottmayer ∗, Anna Hundertmark, Nicolas Ralph Gauger
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22654

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Parameter conditioned interpretable U-Net surrogate model for data-driven predictions of convection-diffusion-reaction processes Michael Urs Lars Kastor, Jan Rottmayer ∗, Anna Hundertmark, Nicolas Ralph Gauger Abstract We present a combined numerical and data-driven workflow for efficient prediction of nonlinear, instationary convection-diffusion-reaction dynamics on a two-dimensional phenotypic domain, motivated by macroscopic modeling of cancer cell plasticity. A finite-difference solver, implemented in C++, is developed using second-order spatial discretizations and a step-size controlled Runge-Kutta time integrator. A mesh refinement study confirms the second-order convergence for the spatial discretizations error. Based on simulated input-output pairs and corresponding parameterizations for the diffusion, advection, and reaction mechanisms, we train a parameter-conditioned U-Net surrogate to approximate the fixed-horizon solution map. The surrogate incorporates Feature-wise Linear Modulation (FiLM) for parameter conditioning, coordinate encoding to incorporate spatial location information, and residual blocks to enable multiscale representation learning in combination with the U-Nets skip connections. The trained model achieves low prediction error on held-out test data and provides favorable prediction times due to the GPU based parallelization. Generalization is analyzed using a factorial test dataset, separating initial conditions from parameter conditioning. The results reveal that approximation difficulty varies primarily with the conditioning vector (i.e., the induced PDE regime), rather than with the initial conditions. Keywords : convection-diffusion-reaction PDE model, finite-difference method, U-Net, surrogate modelling, parameter conditioning, data-driven approach 1 Introduction In this study, we combine a robust numerical solver and a deep neural network (DNN) surrogate model to predict the solutions of nonlinear, instationary convection-diffusion-reaction partial differential equations (PDE) based on simulation data. The chosen PDE model can be applied to or generalized for a broad spectrum of applications, including, among others, fluid dynamics coupled to diffusion processes or chemical reactions. However, the investigations of this study are motivated by the macroscopic modeling of cancer cell phenotypic dynamics in terms of cell populations, for which the studied PDE model is applied. In this context, it should be emphasized that the description of the phenotypic plasticity of cancer cells (i.e., their the ability to change phenotype in response to the environment) and uncovering its underlying mechanisms remain areas of intense research activity and research interest. Many different strategies are currently applied to study this phenomenon. To the best of our knowledge, the key mechanisms responsible for changes in the phenotype of cancer cells, leading to therapy resistance, have not yet been fully uncovered. This is partly due to the difficulties associated with the high dimensionality of cell transcriptomic data and the loss of biological information when working with low dimensional representations instead. Radig et al. [ 30 ] and Colson et al. [ 5 ] each highlight a few of the many different approaches to describe cancer cell plasticity. [ 30 ] focuses on comparing different deep learning tools working directly on single-cell transcriptomic datasets and concludes that the description of the cell response in this lightly processed representation could be unattainable. This suggests that it is probably not advisable to work directly with single-cell transcriptomic data, but rather with a representation in a reduced space. In contrast to the deep learning approaches, [ 5 ] highlights methods utilizing lower dimensional representations, e.g., classes of phenotypes or phenotype-spaces with reduced dimensionality, including approaches via stochastic and ordinary differential equations (to be found in, e.g., [ 17 , 15 ] ) and partial-(integro)-differential equations (P(I)DE), see [ 4 , 3 , 1 , 42 ] for more details. In this context, we refer to the approach outlined by Chrisholm et al. [ 4 ] , describing phenotypic plasticity with a PIDE model in a two-dimensional phenotypic space with survival and proliferation potential as the two dimensions. In their PIDE they account for non-genetic instability represented by a diffusion term, for selection via population dynamics represented by a nonlinear reaction term (including an integral term) and for drug-induced shift mechanisms represented by a convection term. Based on a suitable low-dimensional phenotypic representation of real biological data and the macroscopic P(I)DE model under consideration, data-driven approaches for fitting the model to the processed observation data can be applied to identify the model parameters and thus the driving mechanisms of phenotype change. In this work we follow similar macroscopic modeling approach as in Chrisholm et al. [ 4 ] in a two dimensional phenotypic space, but constrain the model to a convection-diffusion-reaction PDE with parametrized coefficient functions. We develop and validate a numerical solver implemented in C++ based on the second order finite-difference method for spatial discretization and third order Runge-Kutta method with step-size-control for temporal discretization. Although this solver provides accurate numerical results, the repeated PDE evaluations required for envised parameter identification tasks result in a high computational load. To mitigate this bottleneck, aiming for a fast prediction of the PDE solutions, a data-driven surrogate model is introduced. Neural network surrogates are especially attractive because modern machine learning frameworks such as PyTorch [ 27 , 2 ] and JAX [ 9 ] provide efficient GPU/TPU based parallelism and automatic differentiation. This enables fast inference and gradient-based sensitivities for later parameter inference tasks. There have been several competing approaches for PDE operator surrogates using neural networks. Physics-Informed Neural Networks (PINNs) [ 31 ] have been proposed introducing the physics and dynamics directly into the learning objective of the neural network and have become extremely popular in recent years with various adaptations as summarized in Sophiya et al. [ 35 ] . Despite their conceptual appeal, several limitations of PINNs have been documented, particularly in regimes relevant to convection–diffusion–reaction systems. First, PINNs require repeated evaluation of PDE residuals and, depending on the formulation, higher-order derivatives via automatic differentiation, which can lead to substantial computational overhead and memory consumption, especially for time-dependent and multi-dimensional problems [ 31 ] . Second, the optimization landscape is often ill-conditioned and PINNs may exhibit slow convergence and sensitivity to loss balancing between data, boundary conditions, and residual terms, and they can fail to resolve sharp gradients, boundary layers, or transport-dominated features without careful sampling and problem-specific stabilization [ 40 , 14 ] . These difficulties become more pronounced for stiff dynamics or multiscale solutions, where naive collocation strategies and standard network parameterizations may underfit high-frequency components and yield overly smooth predictions [ 14 ] . Consequently, while PINNs offer a flexible, mesh-free framework, their reliability and training cost can be limiting when accurate surrogate evaluations must be produced repeatedly over a broad parameter range. Given that the present work targets a data-rich setting with large sets of high-fidelity numerical solutions generated by a validated solver, an alternative and often more effective strategy is supervised, field-to-field surrogate modeling. In this approach, the neural network is trained to approximate the input–output map (U_{0},\mathbf{c})\mapsto U_{T} directly from simulation pairs, avoiding repeated residual evaluation during training and enabling highly efficient inference. Encoder–decoder convolutional architectures with skip connections, such as U-Net [ 34 ] , are particularly well suited to this task because they represent solution fields on fixed grids and capture multiscale spatial structure through hierarchical feature extraction. U-Net-type models have therefore become common baselines for surrogate modeling of PDE-governed dynamics on structured domains, including in fluid and transport problems [ 33 , 16 , 38 ] . In the present setting, this choice is

Read the complete text