Deep Adaptive Model-Based Design of Experiments

Arno Strouwen, Sebastian Micluța-Câmpeanu · 2026

Read Deep Adaptive Model-Based Design of Experiments by Arno Strouwen, Sebastian Micluța-Câmpeanu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16146.txt.

Introduction

Strouwen and Micluţa-Câmpeanu make experiment design for dynamic systems run in real time. Classic adaptive design re-solves costly inference between each step. Their blend pairs Deep Adaptive Design with differentiable models. A neural policy, trained offline, picks each next experiment. Transformer policies respect the time shape of dynamic systems. Contrastive training extends to cover nuisance parameters cleanly. Four test systems rise in complexity across the study. A fed-batch bioreactor and a DC motor bookend the set. Live deployment closes the demo chain.

Catalog record

CREATORArno Strouwen, Sebastian Micluța-Câmpeanu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49399
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.16146

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Deep Adaptive Model-Based Design of Experiments Thanks: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. This is the extended version; a six-page conference paper has been submitted to the 2026 IEEE Conference on Decision and Control (CDC). Code: https://github.com/arno-papers/CDC2026 . Arno Strouwen, Sebastian Micluța-Câmpeanu Abstract Model-based design of experiments (MBDOE) is essential for efficient parameter estimation in nonlinear dynamical systems. However, conventional adaptive MBDOE requires costly posterior inference and design optimization between each experimental step, precluding real-time applications. We address this by combining Deep Adaptive Design (DAD), which amortizes sequential design into a neural network policy trained offline, with differentiable mechanistic models. For dynamical systems with known governing equations but uncertain parameters, we extend sequential contrastive training objectives to handle nuisance parameters and propose a transformer-based policy architecture that respects the temporal structure of dynamical systems. We demonstrate the approach on four systems of increasing complexity: a fed-batch bioreactor with Monod kinetics, a Haldane bioreactor with uncertain substrate inhibition, a two-compartment pharmacokinetic model with nuisance clearance parameters, and a DC motor for real-time deployment. On the Monod bioreactor, the adaptive policy reduces posterior RMSE by about 30% versus the best static design; on the DC motor, it evaluates in 24 ​ μ 24~\mu s per step versus 7.4 ​ ms 7.4~\mathrm{ms} for non-amortized adaptive design, enabling real-time deployment. I Introduction Model-based design of experiments (MBDOE) is a cornerstone methodology for efficient parameter estimation in nonlinear dynamical systems ( Franceschini and Macchietto 2008 ; Walter and Pronzato 1997 ) . By leveraging mechanistic knowledge of the system, MBDOE selects experimental conditions that maximize information about unknown parameters, enabling precise estimation with fewer experiments than naive approaches. Bayesian optimal experimental design (BOED) provides a principled framework for this problem ( Lindley 1956 ) , selecting designs that maximize the expected information gain (EIG). In sequential settings, adaptive strategies that use past observations to guide future decisions are particularly powerful, but conventional adaptive BOED requires costly posterior inference and design optimization between each experimental step. The EIG objective is doubly intractable ( Rainforth et al. 2018 ) , creating a computational bottleneck that precludes real-time applications. Deep Adaptive Design (DAD) ( Foster et al. 2021 ) addresses this bottleneck by amortizing sequential design into a neural network policy trained offline. iDAD ( Ivanova et al. 2021 ) extended this to implicit (likelihood-free) models. However, for the mechanistic models central to MBDOE, explicit likelihoods are available via differentiable simulation ( Rackauckas et al. 2020 ) . This allows us to use the sequential Prior Contrastive Estimation (sPCE) bounds of the original DAD framework, which require explicit likelihoods, and to differentiate end-to-end through the simulator for low-variance gradient estimates. In this paper, we combine DAD with differentiable mechanistic models to enable real-time adaptive MBDOE for dynamical systems with known governing equations and uncertain parameters. Our contributions are: • We formulate adaptive MBDOE for dynamical systems where the model structure is known, training the policy end-to-end by differentiating through the ODE solver and observation model. • We extend the sPCE bound to handle nuisance parameters, enabling targeted inference by marginalizing over nuisance parameters such as measurement noise. • We retain the transformer-based policy architecture from DAD and adapt it to dynamical systems by making temporal order explicit through positional encoding, rather than treating design-outcome pairs as permutation invariant. • We demonstrate the methodology on four examples: a Monod bioreactor, a Haldane bioreactor illustrating adaptation to target parameters, a pharmacokinetic model illustrating nuisance adaptation together with a brief architecture ablation, and a DC motor for real-time deployment; on the Monod bioreactor the adaptive policy reduces posterior RMSE by about 30% relative to the best static design, and on the DC motor it evaluates in 24~\mu s per step versus 7.4~\mathrm{ms} for non-amortized adaptive design. II Model We consider dynamical systems of the form: \displaystyle\frac{dx}{dt} \displaystyle=f(t,x,\theta_{T},\theta_{N},u(t)),\quad x(0)=x_{0}(\theta_{N}), (1) \displaystyle y_{k}\mid x(t_{k}),\theta_{N} \displaystyle\sim\mathcal{N}(g(x(t_{k})),\,\Sigma(x(t_{k}),\theta_{N})),\quad k=1,\ldots,K, where x(t)\in\mathbb{R}^{n} is the state vector, u(t)\in\mathbb{R}^{m} is a controllable input vector, and y_{k}\in\mathbb{R}^{q} is the observation vector at measurement time t_{k} . We partition parameters as \theta=(\theta_{T},\theta_{N}) , where \theta_{T} are the target parameters of interest and \theta_{N} are nuisance parameters (e.g., measurement noise scale, uncertain initial conditions). Some components of the initial state x_{0} may depend on \theta_{N} . The observation noise covariance \Sigma(x(t_{k}),\theta_{N})\in\mathbb{R}^{q\times q} may depend on the state (e.g., proportional noise). We assume a fixed experimental schedule with known measurement times 0<t_{1}<\cdots<t_{K} and piecewise-constant inputs, u(t)=u_{k} for t\in[t_{k-1},t_{k}) . The design goal is to choose the input profile u(t) (equivalently, the sequence u_{1:K} ) to maximize the information gained about \theta_{T} . We instantiate this framework on a well-mixed fed-batch bioreactor ( Versyck et al. 1997 ) , with state x=(C_{s},C_{x},V) , input u=Q_{in} , and kinetic parameters \theta_{T}=(\mu_{\max},K_{s}) . We consider a 14 -hour experiment with measurements collected every hour, so K=14 and t_{k}=k\,\mathrm{h} for k=1,\ldots,K (with t_{0}=0\,\mathrm{h} ). We choose a feed rate Q_{in,k} that is held constant on [(k-1)\,\mathrm{h},k\,\mathrm{h}) . The dynamics are: \displaystyle\frac{dC_{s}}{dt} \displaystyle=-\frac{\mu(C_{s};\theta_{T})}{Y_{xs}}C_{x}+\frac{Q_{in}}{V}(C_{s,\text{in}}-C_{s}), (2) \displaystyle\frac{dC_{x}}{dt} \displaystyle=\mu(C_{s};\theta_{T})C_{x}-\frac{Q_{in}}{V}C_{x}, \displaystyle\frac{dV}{dt} \displaystyle=Q_{in}, where C_{s} is substrate concentration, C_{x} is biomass concentration, V is reactor volume, Q_{in} is the controllable feed rate, and Y_{xs}=0.777 and C_{s,\text{in}}=50 are the known yield coefficient and feed substrate concentration, respectively. The specific growth rate \mu follows Monod kinetics: \mu(C_{s};\theta_{T})=\frac{\mu_{\max}C_{s}}{K_{s}+C_{s}}, (3) where \mu_{\max} and K_{s} are unknown, with independent uniform priors \mu_{\max}\in[0.3,0.5] and K_{s}\in[0.3,0.6] . We measure substrate concentration (so q=1 and g(x)=C_{s} ), with observations y_{k}\sim\mathcal{N}(C_{s}(t_{k}),\,\sigma^{2}) . The initial substrate concentration and volume are known: C_{s,0}=3.0 and V_{0}=7.0 . The nuisance parameters are \theta_{N}=(\sigma,C_{x,0}) : the initial biomass C_{x,0}\sim\text{Uniform}(0.10,0.50) varies between batches due to different inocula, and the noise scale \sigma\sim\text{Uniform}(0.05,0.15) is unknown but constant across measurements. Both are treated as unknown and marginalized during training. The goal is to design a sequence of feed rates Q_{in,1},\ldots,Q_{in,K} that maximizes information about \mu_{\max} and K_{s} from noisy C_{s} measurements. III Information-Theoretic Criterion In Bayesian experimental design, we begin with a prior p(\theta) encoding our uncertainty about parameters \theta=(\theta_{T},\theta_{N}) and seek an input u such that the posterior on the target parameters p(\theta_{T}|y,u) is as concentrated as possible. The standard measure of concentration is entropy: H(\theta_{T}|y,u)=-\int p(\theta_{T}|y,u)\log p(\theta_{T}|y,u)\,d\theta_{T}. (4) Since the outcome y is unknown at the design stage, we average over all possible observations weighted by their marginal likelihood p(y|u)=\int p(y|\theta,u)\,p(\theta)\,d\theta : u^{\star}=\argmin_{u}\int H(\theta_{T}|y,u)\,p(y|u)\,dy. (5) This is equivalent to maximizing the targeted expected information gain (EIG), the mutual information between target parameters and observations ( Lindley 1956 ) : \mathcal{I}(u)=I(\theta_{T};y|u)=H(\theta_{T})-\E_{p(y|u)}[H(\theta_{T}|y,u)]. (6) The EIG is intractable to compute in general because p(y|u) requires integrating over the full parameter space. Similarly, obtaining the posterior p(\theta_{T}|y,u) requires the partial marginal likelihood p(y|\theta_{T},u)=\int p(y|\theta_{T},\theta_{N},u)\,p(\theta_{N}|\theta_{T})\,d\theta_{N} , which integrates over the nuisance parameters. The formulation above is a static design: all inputs u_{1:K} are chosen upfront by maximizing the EIG over the full trajectory. In sequential experiments, however, the design should adapt to past observations. We therefore optimize over policies —decision rules \pi_{k}(h_{k-1}) that map the experimental history h_{k-1}=((u_{1},y_{1}),\ldots,(u_{k-1},y_{k-1})) to the next input u_{k} . This policy formulation is equivalent to the usual nested adaptive criterion. See Appendix C for a formal proof. Once

Read the complete text