Toward Actionable Digital Twins for Radiation-Based Imaging and Therapy: Mathematical Formulation, Modular Workflow, and an OpenKBP-Based Dose-Surrogate Prototype

Hsin-Hsiung Huang, and Bulent Soykan · 2026

Read Toward Actionable Digital Twins for Radiation-Based Imaging and Therapy: Mathematical Formulation, Modular Workflow, and an OpenKBP-Based Dose-Surrogate Prototype by Hsin-Hsiung Huang, and Bulent Soykan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26820.txt.

Introduction

Huang and Soykan lay out a modular framework for digital twins in radiation imaging and therapy. The twin joins patient data, models, solvers, calibration, and decision steps. It updates a hidden patient state and tracks uncertainty through each choice. As a test case, the authors rebuild an OpenKBP dose prediction pipeline in PyTorch. Their 3D U-Net predicts dose for 100 test patients in about half a second each. A full three-fraction loop runs in 10.3 seconds.

Catalog record

CREATORHsin-Hsiung Huang, and Bulent Soykan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26568
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26820

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Toward Actionable Digital Twins for Radiation-Based Imaging and Therapy: Mathematical Formulation, Modular Workflow, and an OpenKBP-Based Dose-Surrogate Prototype Hsin-Hsiung Huang, and Bulent Soykan Abstract Digital twins for radiation-based imaging and therapy are most useful when they assimilate patient data, quantify predictive uncertainty, and support clinically constrained decisions. This paper presents a modular framework for actionable digital twins in radiation-based imaging and therapy and instantiates its reproducible open-data component using the Open-access Knowledge-Based Planning (OpenKBP) benchmark. The framework couples PatientData, Model, Solver, Calibration, and Decision modules and formalizes latent-state updating, uncertainty propagation, and chance-constrained action selection. As an initial implementation, we build a GPU-ready PyTorch/MONAI reimplementation of the OpenKBP starter pipeline: an 11-channel, 19.2M-parameter 3D U-Net trained with a masked loss over the feasible region and equipped with Monte Carlo dropout for voxel-wise epistemic uncertainty. To emulate the update loop on a static benchmark, we introduce decoder-only proxy recalibration and illustrate uncertainty-aware virtual-therapy evaluation using DVH-based and biological utilities. A complete three-fraction loop including recalibration, Monte Carlo inference, and spatial optimization executes in 10.3 s. On the 100-patient test set, the model achieved mean dose and DVH scores of 2.65 and 1.82 Gy, respectively, with 0.58 s mean inference time per patient. The OpenKBP case study thus serves as a reproducible test bed for dose prediction, uncertainty propagation, and proxy closed-loop adaptation, while future institutional studies will address longitudinal calibration with delivered-dose logs and repeat imaging. I Introduction The idea of a digital twin emerged in aerospace and engineered systems as a virtual counterpart that remains linked to its physical system through data, modeling, and prediction [ 4 ] . In medicine, the concept is especially compelling because patient care already generates a rich digital record of images, treatment plans, delivery logs, and clinical outcomes. Radiation-based imaging and therapy are particularly well suited to this paradigm because they combine repeated measurement, model-based prediction, and decisions that must be revised under strict safety constraints. In this setting, a useful digital twin is not merely a static simulator. It must assimilate new patient information over time, represent uncertainty in its predictions, and support actions such as plan evaluation, adaptation, or treatment selection. Radiation oncology already provides two ingredients needed for such systems. First, deep learning has advanced dose prediction and knowledge-based planning, with the Open-access Knowledge-Based Planning (OpenKBP) AAPM Grand Challenge providing a standardized benchmark for volumetric dose surrogates and DVH-based evaluation [ 2 , 1 ] . Second, digital-twin thinking has matured in oncology and medical imaging, including recent patient-specific forecasting frameworks and MRI-based response models [ 9 , 5 ] . Together, these developments suggest a timely opportunity to connect reproducible AI-based dose modeling with the updating and decision logic expected of an actionable digital twin. That connection remains incomplete. Most published dose-prediction models are still one-shot feed-forward predictors. They estimate a reference dose distribution from anatomy and structure masks, but they do not explicitly maintain a patient state, incorporate new observations during treatment, or express uncertainty in a way that can guide decisions. A clinically meaningful radiation-therapy digital twin therefore requires more than predictive accuracy alone. It requires a formal updating mechanism, uncertainty propagation from voxels to clinically interpretable summaries, and a decision layer that can compare candidate actions under safety and deliverability constraints. Open datasets are indispensable for reproducibility, yet they rarely contain the longitudinal measurements needed for a full bidirectional clinical twin. This paper addresses that tension by using OpenKBP for reproducible dose-surrogate development, uncertainty-aware evaluation, and proxy sequential updating, while reserving true longitudinal validation for future institutional studies with delivered-dose logs and repeat imaging. Within that scope, we develop an actionable digital-twin framework organized around PatientData, Model, Solver, Calibration, and Decision. The open-data implementation uses an OpenKBP-style 3D U-Net trained with a masked loss over the feasible region, stochastic inference through Monte Carlo dropout for voxel-wise epistemic uncertainty, and a proxy sequential calibration step based on decoder-only transfer learning. These components are coupled to a virtual-therapy decision module that evaluates candidate actions using DVH-based summaries and uncertainty-aware biological utilities. The result is both a mathematical formulation of an actionable digital twin and a reproducible prototype showing how uncertainty and updating can be embedded in a benchmark dose-prediction workflow. II Background and Related Work II-A Updateable patient models and modular twins Across engineering and biomedical settings, digital twins are virtual counterparts linked to their physical systems through data assimilation, prediction, and decision support [ 4 ] . In oncology, recent examples span MRI-based patient-specific digital twins for chemotherapy optimization [ 9 ] and modular frameworks such as TumorTwin [ 5 ] . These lines of work collectively motivate the present focus on updating, uncertainty-aware prediction, and actionability. II-B Radiation-therapy surrogates and open benchmarks OpenKBP enables fair comparison of dose-prediction methods for knowledge-based planning using standardized voxel-wise and DVH-based metrics [ 2 , 1 ] . Attention-aware 3D U-Net variants have also been evaluated on the benchmark and show that architectural refinements can improve emphasis on clinically relevant anatomy in head-and-neck IMRT dose prediction [ 7 ] . Our work builds on this benchmark tradition but moves beyond static prediction by integrating uncertainty, proxy recalibration, and a decision layer. III Model of an Actionable Digital Twin III-A Latent state, observations, and updating Let x_{t} denote the latent patient state at time t , including anatomy, targets and organs-at-risk, accumulated dose summaries, and latent response or toxicity parameters. Let y_{t} denote observations, including CT or CBCT, delivered dose logs, biomarkers, and outcomes, and let u_{t} denote clinical actions such as plan parameters, adaptation triggers, and imaging schedules. A generic state-space model is \displaystyle x_{t+1} \displaystyle=f(x_{t},u_{t};\theta)+w_{t}, (1) \displaystyle y_{t} \displaystyle=h(x_{t};\phi)+v_{t}, (2) where \theta denotes transition or calibration parameters, \phi denotes observation-model parameters, and w_{t} and v_{t} represent process and observation uncertainty. For notational simplicity, we treat \phi as fixed or pre-specified during online updating and maintain the belief state over (x_{t},\theta) . Accordingly, \displaystyle b_{t}(x,\theta)\triangleq p(x_{t}=x,\theta_{t}=\theta\mid y_{1:t},u_{1:t-1};\phi). (3) The Bayesian filtering update is \displaystyle b_{t}(x_{t},\theta) \displaystyle\propto p(y_{t}\mid x_{t};\phi) \displaystyle\quad\times\int p(x_{t}\mid x_{t-1},u_{t-1};\theta)\,b_{t-1}(x_{t-1},\theta)\,dx_{t-1}. (4) In practice, ( 4 ) can be approximated by ensemble, particle, or maximum a posteriori (MAP) updates. A generic MAP calibration step is \displaystyle(\hat{x}_{t},\hat{\theta}_{t}) \displaystyle=\arg\min_{x,\theta}\;\|y_{t}-h(x;\phi)\|_{\Sigma_{v}^{-1}}^{2} \displaystyle\quad+\|x-f(\hat{x}_{t-1},u_{t-1};\theta)\|_{\Sigma_{w}^{-1}}^{2}+R(\theta), (5) where \Sigma_{v} and \Sigma_{w} are error covariances and R(\theta) encodes priors or stability. III-B Dose surrogate, uncertainty, and DVH metrics For radiation therapy, the predictive target is the 3D dose distribution d(\mathbf{r}) over voxels \mathbf{r} . Let I_{t} denote the planning CT and let S_{t} denote ROI masks. A dose surrogate is defined as \displaystyle\hat{d}_{t}=g_{\psi}(I_{t},S_{t}), (6) where \psi denotes neural-network parameters. For OpenKBP, g_{\psi} is trained to predict the reference plan dose using the masked objective \displaystyle\psi^{\star}=\arg\min_{\psi}\sum_{i=1}^{N}\left\|M_{i}\odot\big(g_{\psi}(I_{i},S_{i})-d_{i}\big)\right\|_{1}, (7) where M_{i} is the feasible dose mask [ 2 , 1 ] . Predictive uncertainty is approximated by stochastic inference, \displaystyle\hat{d}_{t}^{(k)}=g_{\psi}(I_{t},S_{t};\xi_{k}),\qquad k=1,\ldots,K, (8) with predictive mean and voxel-wise variance \displaystyle\bar{d}_{t} \displaystyle=\frac{1}{K}\sum_{k=1}^{K}\hat{d}_{t}^{(k)}, (9) \displaystyle\sigma_{t}^{2}(\mathbf{r}) \displaystyle=\frac{1}{K-1}\sum_{k=1}^{K}\left(\hat{d}_{t}^{(k)}(\mathbf{r})-\bar{d}_{t}(\mathbf{r})\right)^{2}, (10) where Monte Carlo dropout serves as an efficient approximate Bayesian mechanism for epistemic uncertainty extraction [ 3 ] . Let \Omega_{r} denote the voxel set for ROI r and let \mathbf{m}(d) collect DVH-derived metrics. The benchmark-aligned dose and DVH scores are \displaystyle S_{\text{dose}}(\hat{d},d) \displaystyle=\frac{1}{|\Omega|}\sum_{\mathbf{r}\in\Omega}\left|\hat{d}(\mathbf{r})-d(\mathbf{r})\right|, (11) \displaystyle S_{\text{DVH}}(\hat{d},d) \displaystyle=\frac{1}{L}\sum_{\ell=1}^{L}\left|\mathcal{M}_{\ell}(\hat{d})-\mathcal{M}_{\ell}(d)\right|, (12) where \mathcal{M}_{\ell} enumerates the benchmark DVH summaries [ 2 ]

Read the complete text