Submanifold Sparse Convolutional Networks for Automated 3D Segmentation of Kidneys and Kidney Tumours in Computed Tomography

Saúl Alonso-Monsalve, Leigh H. Whitehead, Adam Aurisano, Lorena Escudero Sanchez · 2025

Read Submanifold Sparse Convolutional Networks for Automated 3D Segmentation of Kidneys and Kidney Tumours in Computed Tomography by Saúl Alonso-Monsalve, Leigh H. Whitehead, Adam Aurisano, Lorena Escudero Sanchez (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04334.txt.

Introduction

Saul Alonso-Monsalve, Leigh H Whitehead, Adam Aurisano, and Lorena Escudero Sanchez segment kidneys and kidney tumours in computed tomography scans with submanifold sparse convolutional networks. Precise tumour outlines feed quantitative analysis and precision oncology, but manual tracing is slow specialist work, and full-resolution three-dimensional scans punish dense networks computationally.

Voxel sparsification drives a two-stage design. A low-resolution sparse network finds the region of interest, then a high-resolution sparse network refines the outline inside that crop, cutting memory and inference time. On a public renal cancer dataset with cross-validation, overlap scores for kidneys, masses, tumours, and cysts were competitive with leading challenge entries.

Catalog record

CREATORSaúl Alonso-Monsalve, Leigh H. Whitehead, Adam Aurisano, Lorena Escudero Sanchez
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-04334

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Submanifold Sparse Convolutional Networks for Automated 3D Segmentation of Kidneys and Kidney Tumours in Computed Tomography Saúl Alonso-Monsalve, Leigh H. Whitehead, Adam Aurisano, Lorena Escudero Sanchez Abstract The accurate delineation of tumours in radiological images like Computed Tomography is a very specialised and time-consuming task, and currently a bottleneck preventing quantitative analyses to be performed routinely in the clinical setting. For this reason, developing methods for the automated segmentation of tumours in medical imaging is of the utmost importance and has driven significant efforts in recent years. However, challenges regarding the impracticality of 3D scans, given the large amount of voxels to be analysed, usually requires the downsampling of such images or using patches thereof when applying traditional convolutional neural networks. To overcome this problem, in this paper we propose a new methodology that uses, divided into two stages, voxel sparsification and submanifold sparse convolutional networks. This method allows segmentations to be performed with high-resolution inputs and a native 3D model architecture, obtaining state-of-the-art accuracies while significantly reducing the computational resources needed in terms of GPU memory and time. We studied the deployment of this methodology in the context of Computed Tomography images of renal cancer patients from the KiTS23 challenge, and our method achieved results competitive with the challenge winners, with Dice similarity coefficients of 95.8% for kidneys + masses, 85.7% for tumours + cysts, and 80.3% for tumours alone. Crucially, our method also offers significant computational improvements, achieving up to a 60% reduction in inference time and up to a 75% reduction in VRAM usage compared to an equivalent dense architecture, across both CPU and various GPU cards tested. keywords Computed Tomography, Semantic Segmentation, Submanifold Sparse Convolutional Networks, Tumour Segmentation Introduction Medical imaging is routinely used for cancer diagnosis and treatment monitoring, with Computed Tomography (CT) being one of the most common image modalities used worldwide [ 1 ] . This is indeed the case for renal cancer, one of the deadliest cancers [ 2 ] : when a kidney tumour is suspected, the patient typically undergoes a contrast-enhanced computed tomography (CECT) scan for confirmation [ 3 , 4 ] . Beside diagnosis, the quantitative analysis of CT images and the extraction of downstream measurements such as radiomics [ 5 ] for machine-learning algorithms is proving promising in classifying tumour types, predicting their evolution, and the response of patients to treatment [ 6 , 7 ] . However, the accurate delineation of lesions necessary to perform such analyses is a very time-consuming task that relies on expert radiologists, and currently presents a bottleneck to deploy advanced techniques that would enable personalised treatments [ 8 ] in the clinical setting. Hence the growing interest in the cancer research community to develop methods for automatic tumour segmentation [ 9 , 10 , 11 ] . In particular, deep neural networks based on the U-Net architecture [ 12 ] have shown the most promising results in segmenting tumours and organs in medical images, including CT, achieving some of the state-of-the-art performance in biomedical segmentation challenges [ 13 ] . In practice, however, representing scans as 3D images is computationally infeasible without the application of downsampling. For example, a single CT scan volume with 2D images consisting of 512\times 512 pixels and 100 2D slices would have \sim 26 million voxels, tens of times larger than the number of voxels that can be stored in memory on a typical GPU card. In addition, a dense representation, as used in traditional convolutional neural networks (CNN) for medical imaging [ 14 ] , is inefficient when many voxels convey no useful information for the classification task. In such cases, a sparse representation that stores the position and value of only meaningful voxels is more suitable. Submanifold sparse convolutional neural networks (SSCNs) [ 15 , 16 ] were developed specifically to operate on sparse tensors, solving this problem. In scientific fields such as high-energy physics, where sparse images are common, SSCNs have been shown to outperform standard CNNs [ 17 , 18 , 19 ] . But despite their promising results and advantageous reduction of computing resources, both of great importance in clinical research, SSCNs have not yet been studied in the context of cancer research and only one example of the usage of these networks exists in medical imaging at all, which was recently proposed specifically for the reconstruction of 3D skulls [ 20 , 21 ] . For these reasons, in this paper we studied for the first time the application of SSCNs to the semantic segmentation of tumours in CT images. Although CT images are not naturally sparse, this imaging modality is a suitable use case for SSCNs. This is possible since the intensities stored in voxels in CT are described by the scale of Hounsfield Units (H.U.) that represents radiodensity [ 22 ] , such that different values are indicative of different tissue types. Therefore, by selecting thresholds in the voxel intensities, we can easily discard structures not useful for the tumour segmentation task, such as bones or air. In this paper, we propose a new methodology that deploys the use of voxel sparsification and SSCNs as an alternative for CT segmentations of organs and tumours, and we demonstrate a successful application of this methodology applied to segmenting kidneys and renal tumours in CT images. As demonstrated by our results, not only is this alternative approach able to obtain high accuracy, competitive with other state-of-the-art methods, but it also presents an advantage in terms of resources by requiring less computation time and memory, as will be explained in the rest of this paper. These results will help in the development and adoption of automatic segmentation methods in the clinical setting in a robust and resource-conscious way, which can be extended to other organs and tumour types in the future. Methods The proposed methodology follows a two-stage approach to efficiently segment kidney and tumour structures. The process begins with voxel sparsification, which reduces computational complexity by retaining only the most relevant voxels. Next, a region of interest (ROI) identification step is employed to localise potential areas containing kidney and tumour structures. Finally, a full segmentation stage refines the predictions, generating detailed and accurate segmentations of the target regions. An illustration of these steps can be found in Fig. 1 . Figure 1: Overview of the two-stage segmentation framework utilising Sparse Submanifold Convolutional Networks (SSCNs). In Stage 1 (ROI finder), a low-resolution sparsified image is processed by a sparse 3D U-Net to identify a region of interest (ROI). Such ROIs are then dilated to be conservative and ensure all relevant structures are included, and passed to the next stage and used to crop the original high-resolution image. In Stage 2 (Segmentation), the high-resolution cropped image is fed into another sparse 3D U-Net to obtain the final segmentations. This two-step approach efficiently reduces computational cost while maintaining segmentation accuracy by focusing on relevant anatomical structures. The segmentation outputs includes kidneys, tumours and cysts, independently segmented following the ground truth annotations from the KiTS23 dataset. Dataset For this study, we used publicly available images of renal cancer patients collected for the 2023 Kidney Tumour Segmentation challenge (KiTS23) [ 23 ] . This dataset includes patients

Read the complete text