Cut to the Mix: Simple Data Augmentation Outperforms Elaborate Ones in Limited Organ Segmentation Datasets Chang Liu, Fuxin Fan, Annette Schwarz, Andreas Maier Abstract Multi-organ segmentation is a widely applied clinical routine and automated organ segmentation tools dramatically improve the pipeline of the radiologists. Recently, deep learning (DL) based segmentation models have shown the capacity to accomplish such a task. However, the training of the segmentation networks requires large amount of data with manual annotations, which is a major concern due to the data scarcity from clinic. Working with limited data is still common for researches on novel imaging modalities. To enhance the effectiveness of DL models trained with limited data, data augmentation (DA) is a crucial regularization technique. Traditional DA (TDA) strategies focus on basic intra-image operations, i.e. generating images with different orientations and intensity distributions. In contrast, the inter-image and object-level DA operations are able to create new images from separate individuals. However, such DA strategies are not well explored on the task of multi-organ segmentation. In this paper, we investigated four possible inter-image DA strategies: CutMix, CarveMix, ObjectAug and AnatoMix, on two organ segmentation datasets. The result shows that CutMix, CarveMix and AnatoMix can improve the average dice score by 4.9, 2.0 and 1.9, compared with the state-of-the-art nnUNet without DA strategies. These results can be further improved by adding TDA strategies. It is revealed in our experiments that CutMix is a robust but simple DA strategy to drive up the segmentation performance for multi-organ segmentation, even when CutMix produces intuitively ‘wrong’ images. Our implementation is publicly available at https://github.com/Rebooorn/mosDAtoolkit for future benchmarks. 1 Introduction In clinics, multi-organ segmentation is a common routine for radiologists in order to perform a multitude of treatments or therapies, i.e. for the treatment planning for radiation therapy [ 9 ] . However, manual delineation of human organs in medical images is a time- and effort-consuming task and automated multi-organ segmentation is thus expected. In recent years, the emerging deep learning (DL) based models have shown strong performance on the task of organ segmentation in some imaging modalities, such as computed tomography (CT) and magnetic resonance scanning (MR) [ 4 , 12 ] . For supervised training routines, the development of a robust DL segmentation model relies on a large-scale image dataset with manual annotation of organs. Along with the state-of-the-art organ segmentation models, many large-scale segmentation datasets are publicly available [ 8 , 5 , 12 ] . However, for research on novel imaging modalities such as dual energy computed tomography (DECT), it remains difficult to gather enough images. For preliminary researches, such as to investigate whether certain imaging modalities will benefit the DL models for organ segmentation, working with a limited segmentation dataset is still common [ 1 ] . It is a reasonable practice to extend the generalizability of limited segmentation dataset using data augmentation (DA), which is a widely known regularization method for DL [ 3 ] . Traditional data augmentation (TDA) strategies include spatial shift or scaling, and intensity scaling. These are effective for regularizing training processes with more diverse training data. Novel approaches, like inter-image and object-level DA strategies are proposed in computer vision and medical imaging research, seeking to reach further than TDA strategies. Mixup [ 14 ] and CutMix [ 13 ] were first proposed to fuse multiple images from the training dataset for image classification tasks. The concept was then adapted into the medical imaging domain, CarveMix [ 16 ] and selfMix [ 17 ] are proposed to manipulate the tumor regions within the dataset onto background images for brain and liver tumor segmentation. PII [ 11 ] is proposed for pathological anomaly detection. ObjectAug [ 15 ] introduces object-level data augmentation using the segmentation mask of the components in the image, to apply augmentation for image classification. ClassMix [ 10 ] and ComplexMix [ 2 ] are proposed in researches of autonomous driving to merge the image and the segmentation mask to generate novel street views. AnatoMix [ 6 ] is recently proposed in particular for augmentation for multi-organ segmentation task. To the best of our knowledge, few investigations have been done for inter-image and object-level DA strategies on multi-organ segmentation task. In this work, we present our investigation on robust DA strategies for multi-organ segmentation in limited dataset. Four established DA strategies have been re-implemented to fit the multi-organ segmentation task: CutMix, ObjectAug, CarveMix and AnatoMix. Figure 1 : Illustration of the concept of CutMix, ObjectAug, CarveMix and AnatoMix. All DA strategies are originally proposed for either image classification or tumor segmentation task. They are re-implemented for the multi-organ segmentation task and further evaluated in this work. 2 Method The aforementioned DA strategies are first re-implemented for multi-organ segmentation tasks and evaluated on two limited organ segmentation tasks, aiming to find a robust DA for multi-organ segmentation. nnUNetv2 is applied to train the segmentation networks [ 4 ] . 2.1 Inter-image and Object-level Data Augmentation Assume the segmentation dataset contains N_{d} cases with \{I_{i},M_{i}|0