PR 3D ICTR : A modular AI framework for medical 3D image-based detection and outcome prediction

Daniel C. MacRae, Luuk van der Hoek, Robert van der Wal, Suzanne P.M. de Vette · 2026

Read PR 3D ICTR : A modular AI framework for medical 3D image-based detection and outcome prediction by Daniel C. MacRae, Luuk van der Hoek, Robert van der Wal, Suzanne P.M. de Vette (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03203.txt.

Introduction

MacRae and colleagues release PR3DICTR, a modular open framework for building prediction models from 3D medical images. Built on PyTorch and MONAI, it standardizes training while letting users plug in their own architectures and methods, and it handles any binary or event-based 3D classification task. A basic task needs just two lines of code to start.

Catalog record

CREATORDaniel C. MacRae, Luuk van der Hoek, Robert van der Wal, Suzanne P.M. de Vette
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35010
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.03203

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PR 3D ICTR : A modular AI framework for medical 3D image-based detection and outcome prediction Daniel C. MacRae, Luuk van der Hoek, Robert van der Wal, Suzanne P.M. de Vette Abstract Three-dimensional medical image data and computer-aided decision making, particularly using deep learning, are becoming increasingly important in the medical field. To aid in these developments we introduce PR3DICTR : P latform for R esearch in 3D I mage C lassification and s T andardised t R aining. Built using community-standard distributions (PyTorch and MONAI), PR3DICTR provides an open-access, flexible and convenient framework for prediction model development, with an explicit focus on classification using three-dimensional medical image data. By combining modular design principles and standardization, it aims to alleviate developmental burden whilst retaining adjustability. It provides users with a wealth of pre-established functionality, for instance in model architecture design options, hyper-parameter solutions and training methodologies, but still gives users the opportunity and freedom to “plug in” their own solutions or modules. PR3DICTR can be applied to any binary or event-based three-dimensional classification task and can work with as little as two lines of code. 1 Introduction In recent years, three-dimensional (3D) multi-modal medical imaging has become increasingly important for diagnosis and treatment of patients [ 23 ] . These scans provide both anatomical and functional information that can guide treatment selection and predict outcomes such as survival, risk of (surgical) complications or treatment failure [ 26 , 24 ] . While clinicians traditionally rely on guidelines built on discrete clinical variables (e.g., TNM staging) and semantic or manually derived imaging features (e.g., “hypo-dense lesions” or aortic diameter measurements), advanced image processing and artificial intelligence (AI) now enable automated extraction of features directly from full 3D scans [ 2 , 27 , 12 , 9 , 28 ] . Deep learning (DL) models, such as convolutional neural networks (CNNs, Figure 1 ) and transformers, have shown great potential for capturing intricate patterns in medical imaging data and associating them with clinical outcomes [ 12 , 28 ] . However, their development often requires substantial computational resources and technical expertise, leading to diverse and often non-standardized workflows both across and even within research groups [ 22 ] . Consequently, there remains a need for simple, standardized, and modular tools that make working with 3D image-based deep learning model development more accessible. Figure 1 : Example of a binary classification deep learning model workflow using 3D medical imaging. When researchers begin developing machine learning or deep learning models in Python, a wide range of frameworks are available. For maximum flexibility, PyTorch offers a powerful foundation and the tools to develop diverse deep learning applications, from large language models to financial forecasting models [ 21 ] . Within the medical imaging domain, the Medical Open Network for Artificial Intelligence (MONAI) builds on PyTorch to provide specialized tools for 2D and 3D medical data, while maintaining much of PyTorch’s flexibility [ 5 ] . In contrast, no-code frameworks such as Ludwig allow users to define models via configuration files rather than custom code, specifying inputs, architectures, and outputs directly [ 19 ] . Overall, existing solutions tend to be either too broad to be readily applied to specific medical imaging classification tasks or too narrowly focused to be adaptable to the requirements of individual outcome prediction models. There remains a need for a balanced framework that combines simplicity, modularity, and standardization for classification modelling with 3D medical data. We address these needs in the development of a framework that offers high modularity while retaining simplicity and standardization for deep learning (DL) development projects based on 3D medical imaging data: the PR3DICTR framework ( P latform for R esearch in 3D I mage C lassification and s T andardised tRaining). Through standardizing crucial tasks such as data loading, model training, hyper-parameter optimisation, and model evaluation, we aim to alleviate the development burden and increase consistency for and between scientists. Additionally, the framework incorporates standard solutions for common medical data challenges, including missing value and imbalance handling, regularization using 3D image augmentation, and multi-modality imaging with optional input-specific preprocessing together with tabular data integration. Built in a modular fashion using standard PyTorch and MONAI components, the framework enables users to replace or extend individual workflow elements (such as custom image feature extractors) while providing an end-to-end solution for 3D medical image model development and evaluation that can be readily adapted to new prediction tasks. This paper describes the PR3DICTR framework and its application in an open-source dataset. 2 Methods The overall PR3DICTR workflow is depicted in Figure 2 . The pipeline encompasses 1) data preprocessing, 2) image standardisation, 3) data organisation, 4) configuration setup, 5) model training, and 6) evaluation. These steps are described in detail in the following subsections. The complete code for PR3DICTR can be found at https://github.com/DLinRadiotherapyUMCG/PR3DICTR . Figure 2 : Overall PR3DICTR workflow. An example notebook for steps 1–3 can be found in the repository, and another notebook demonstrates steps 4–6. 2.1 Prerequisite: Data curation Medical imaging data is highly varied, with a multitude of modalities (CT, PET, MRI, radiation dose, etc.), where each individual image modality usually has a different number of slices, intensity ranges and resolution. Deep-learning models typically require a consistent 3D input with fixed dimensions and intensities for effective training and inference. Within this technical note, we distinguish between (1) dataset curation, which converts raw DICOM data into structured NumPy datasets, and (2) input preprocessing, which prepares curated data for model training via cropping, value clipping and normalization. The PR3DICTR framework includes only the latter and assumes that users have already curated their data into a (semi) standardized format, which is outlined in Figure 3 . Data curation consists of three steps: 1. Preprocess clinical/tabular data (Figure 2 , step 1). The PR3DICTR framework requires a CSV file containing clinical data and endpoints for each patient. Three standardised columns are mandatory: PatientID (linking clinical and imaging data), Split (either train_val or test , indicating the set), and at least one column containing labels with which to train the model. Missing labels can be indicated using a missing indicator, for which the default is -1 . During model training and evaluation, any endpoints set to -1 will be ignored (for instance when calculating the loss or evaluation metrics). Furthermore, the CSV file can contain any tabular features to include as a model input (e.g. patient age). 2. Standardise 3D input data (Figure 2 , step 2). The PR3DICTR framework has two requirements for any 3D volumetric data to be used as model input. First, all volumetric data must be of the same dimension (i.e., size). Secondly, volume data is required to be stored as NumPy ( .npy ) files. It is also recommended in this step to crop the volumetric data to the same field-of-view (for example, so that CTs and MRIs for each patient are spatially aligned). 3. Save data into directory structure (Figure 2 , step 3). Once the volumetric data is prepared, it needs to be stored in a fixed folder structure based on the PatientID s. One main data folder should contain subfolders, one per PatientID in the dataset; these subfolders should then contain the

Read the complete text