Disconnect to Connect: A Data Augmentation Method for Improving Topology Accuracy in Image Segmentation
Juan Miguel Valverde, Maja Østergaard, Adrian Rodriguez-Palomo, Peter A. S. Vibe, Nina K. Wittig, Henrik Birkedal, Anders Bjorholm Dahl · 2025
Read Disconnect to Connect: A Data Augmentation Method for Improving Topology Accuracy in Image Segmentation by Juan Miguel Valverde, Maja Østergaard, Adrian Rodriguez-Palomo, Peter A. S. Vibe, Nina K. Wittig, Henrik Birkedal, Anders Bjorholm Dahl (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05541.txt.
Introduction
Juan Miguel Valverde and co-authors improved the topology of image segmentation in 2025 by deliberately breaking the very structures the network must learn. Thin tubes like blood vessels are hard to segment: pixel-wise networks miss a few pixels and the tube snaps. Fixing that with topology losses needs training labels whose connections are exactly right, which faint, low-contrast images rarely allow.
Their method, CoLeTra, augments training by cutting the structures in the image while keeping the original label whole. The network thereby learns to reconnect what the picture shows as broken, even when the labels themselves are imperfect. Readers get a counterintuitive data trick for medical and scientific images: teach continuity by practicing on cuts, and the segmenter stops severing vessels.
Catalog record
| CREATOR | Juan Miguel Valverde, Maja Østergaard, Adrian Rodriguez-Palomo, Peter A. S. Vibe, Nina K. Wittig, Henrik Birkedal, Anders Bjorholm Dahl |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-05541
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Disconnect to Connect: A Data Augmentation Method for Improving Topology Accuracy in Image Segmentation Juan Miguel Valverde, Maja Østergaard, Adrian Rodriguez-Palomo, Peter A. S. Vibe, Nina K. Wittig, Henrik Birkedal, Anders Bjorholm Dahl Abstract Accurate segmentation of thin, tubular structures (e.g., blood vessels) is challenging for deep neural networks. These networks classify individual pixels, and even minor misclassifications can break the thin connections within these structures. Existing methods that focus on improving topology accuracy, such as topology loss functions, require very precise training labels with the correct topology, which is difficult to obtain. Low image resolution and contrast can further complicate the annotation by causing these structures to appear disconnected. We present CoLeTra, a data augmentation method that improves topology accuracy, even on datasets with topologically inaccurate training labels. CoLeTra achieves this by artificially breaking the structures in the images while maintaining the original labels, incorporating to the models the prior knowledge that structures can be continuous even if they appear disconnected. Our extensive experiments, involving different architectures, loss functions, and datasets, demonstrate that CoLeTra leads to segmentations topologically more accurate while often improving the Dice coefficient and clDice. We also release a dataset specifically suited for image segmentation methods with a focus on topology accuracy. CoLetra’s code can be found at https://jmlipman.github.io/CoLeTra . 1 Introduction Despite the remarkable potential of deep learning for image segmentation [ 25 ] , accurate segmentation of thin, tubular structures, such as axons, airways, and blood vessels, remains a significant challenge. This is partly due to the inherent pixel-wise classification nature of standard deep learning models, where small misclassifications that hardly increase the loss, can lead to segmentations with discontinuities, impairing the quantification [ 12 ] . For instance, connected-component analysis of structures with broken connections would misinterpret each fragment as a distinct structure, resulting in overestimating their number. An incorrect number of connected components would then compromise other measurements, such as average length, density, and directionality. Figure 1 : Left: Annotations missing important areas, compromising the structure’s true topology. Right: CoLeTra improves topology accuracy. An important line of research has focused on emphasizing structures’ connectivity with topology loss functions [ 11 , 5 , 12 , 19 , 42 ] . These are loss functions that aim to produce segmentations that match the number of connected components, holes, and cavities of the ground truth, prioritizing topology accuracy over slight improvements in non-topology metrics, such as Dice coefficient. However, these topology loss functions require topologically-precise labels, an often unrealistic requirement in areas such as medical imaging and material science [ 39 ] . Due to the low image resolution and contrast, it is challenging to annotate the images because the tubular structures may appear disconnected (see Figure 1 ). In these cases with topologically-inaccurate labels, the loss functions inadvertently reinforce the absence of a structure that we know should exist based on prior knowledge about connectivity. Furthermore, most topology loss functions rely on persistence homology [ 31 , 45 , 53 , 60 ] , soft-skeletonization [ 42 , 50 ] , or distance transforms [ 40 , 22 ] , which significantly increase the computational resources required by topology losses, limiting their applicability. In this paper, we present CoLeTra, the first, to the best of our knowledge, data augmentation method for improving topology accuracy in image segmentation. CoLeTra uses image inpainting to artificially create images with the appearance of disconnected tubular structures while keeping the ground truth labels as they are (see Figure 2 ), teaching models that structures may be connected even if they appear disconnected. We show with extensive experiments on four datasets, two architectures, and six loss functions that this simple strategy generally leads to segmentations with more accurate topology, i.e . , segmentations with the number of connected components and holes more similar to the ground truth. CoLeTra can be easily incorporated into existing training pipelines, and, importantly, it can be utilized jointly with other methods that consider topology, such as topology loss functions, as well as with other data augmentations. Furthermore, CoLeTra adds only a negligible overhead during the optimization and, unlike other topology-enhancing strategies [ 42 , 11 , 13 ] , it requires no extra GPU memory. Specifically, our contributions are the following: • We present the first data augmentation method for image segmentation specifically designed to and demonstrated to improve topology accuracy. • Our method improves topology accuracy across a wide range of settings, even when optimizing topology loss functions. • We release a dataset ideally suited for evaluating image segmentation methods with an emphasis on topology accuracy. This dataset release aims to foster future research in the field. 2 Related work Topology loss functions Several topology loss functions aim at finding and improving the segmentation around critical points ( i.e . , the pixels that change the topology of the segmentation to the desired one). At the core of most of these loss functions [ 11 , 7 , 5 , 41 , 1 , 8 , 31 , 45 ] , we find persistence homology (PH) [ 6 ] —a tool to analyze topological features. Particularly in image segmentation, PH tracks how connected components, holes, and cavities appear and disappear as all possible thresholds are applied to softmax probability values [ 10 ] . Libraries, such as Gudhi [ 23 ] , facilitate the computation of PH and the finding of critical points that topology loss functions aim to correct. There exist other topology loss functions that find critical points differently [ 13 , 19 ] . However, these and PH-based topology loss functions are very expensive to compute, forcing researchers to find critical pixels on small image patches, thus, disregarding global topology. Our method, in contrast, increases computational time only by a small margin and, as we show, it improves global topology accuracy. In parallel to this trend, other topology loss functions focus on improving the accuracy around the skeleton of tubular structures [ 42 , 40 , 17 ] . These methods rely on skeletonization algorithms (and, some methods, on distance transforms) that must be computed constantly during training. When computed on the CPU [ 40 , 17 ] , these methods increase running time, and, when computed on the GPU via min/max pooling [ 42 ] , these methods increase GPU memory usage. In contrast to these approaches, our method does not require extra GPU memory and it does not rely on computationally-expensive distance transform functions. Prior knowledge via data augmentation Data augmentation can integrate prior knowledge into the models during training by leveraging domain-specific knowledge. In one example, a data augmentation method based on the appearance of local vessel intensity against the surrounding background was developed [ 32 ] . The medical knowledge that tumors can grow in different locations has been incorporated by randomly flipping the images during the optimization [ 27 ] . In another example, intra and inter-rater variability was simulated by applying random deformations to the segmentation mask boundaries [ 15 ] . In other domains, Yang et al. [54] proposed a data augmentation transformation to create defects in metal surfaces accounting for new defect types that only appeared in the test set. Furthermore, recent