Leveraging a Statistical Shape Model for Efficient Generation of Annotated Training Data: A Case Study on Liver Landmarks Segmentation
Denis Krnjaca, Lorena Krames, Werner Nahm · 2026
Read Leveraging a Statistical Shape Model for Efficient Generation of Annotated Training Data: A Case Study on Liver Landmarks Segmentation by Denis Krnjaca, Lorena Krames, Werner Nahm (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13969.txt.
Introduction
Krnjaca, Krames, and Nahm use a statistical shape model to mass-produce labeled training data for liver landmark segmentation. Labeling medical shapes by hand is slow, so the mean shape is labeled just once. The model then stamps those labels onto thousands of new liver shapes. A network trained on 8,800 such shapes scores a mean intersection-over-union near 91 percent on unseen synthetic shapes. On real patient livers, early qualitative checks look promising.
Catalog record
| CREATOR | Denis Krnjaca, Lorena Krames, Werner Nahm |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17013 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.13969
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Leveraging a Statistical Shape Model for Efficient Generation of Annotated Training Data: A Case Study on Liver Landmarks Segmentation Denis Krnjaca, Lorena Krames, Werner Nahm Abstract Anatomical landmark segmentation serves as a critical initial step for robust multimodal registration during computer-assisted interventions. Current approaches predominantly rely on deep learning, which often necessitates the extensive manual generation of annotated datasets. In this paper, we present a novel strategy for creating large annotated datasets using a statistical shape model (SSM) based on a mean shape only manually labeled once. We demonstrate the method’s efficacy through its application to deep-learning-based anatomical landmark segmentation, specifically targeting the detection of the anterior ridge and the falciform ligament in 3D liver shapes. A specialized deep learning network was trained with 8,800 annotated liver shapes generated by the SSM. The network’s performance was evaluated on 500 unseen synthetic SSM shapes, yielding a mean Intersection over Union of 91.4% (87.4% for the anterior ridge and 87.6% for the falciform ligament). Subsequently, the network was applied to clinical patient liver shapes, with qualitative evaluation indicating promising results, highlighting the generalizability of the proposed approach. Our findings suggest that the SSM-based data generation approach alleviates the labor-intensive process of manual labeling while enabling the creation of large annotated training datasets for machine learning. Although our study focuses on liver anatomy, the proposed methodology holds potential for a broad range of applications where annotated training datasets play a pivotal role in developing accurate deep-learning models. 1 Introduction A current problem in research and industry is enhancing the precision of multimodal registration during computer-assisted interventions. Approaches based on an anatomical landmark segmentation [ 4 , 5 , 6 , 7 ] show promising improvements in 2D-3D registration results. However, achieving accurate delineation of these landmarks is still essential for enhancing the precision of the registration and the time-consuming expert manual annotation of the anatomical landmarks (e.g., the anterior ridge of the liver) on the preoperative 3D model is regardless required. Manual annotation furthermore requires special software and is dependent on the annotator. Fortunately, the growing utilization of 3D point cloud acquisition methods, such as laser scanners or LIDAR, has led to an increased focus on developing approaches for processing point clouds [ 13 ] and hence automatizing the segmentation. A variety of deep-learning network architectures for the 3D segmentation of point clouds were introduced lately, with notable examples being the PointNet model and its enhanced version, PointNet++ [ 1 , 2 ] . One limitation of PointNet is its dependence on the equal orientation of point clouds. This requirement poses challenges when dealing with 3D models segmented from CT scans, as variations in anatomy and positions during CT acquisition may not strictly adhere to this condition. Moreover, these deep learning approaches typically require a large annotated training data set. At the same time, statistical shape models (SSM) enable the generation of a diverse set of realistic geometries that capture the variability observed within the cohort used to construct the SSM. In the past, SSMs have been applied to a variety of applications, e.g., for the 3D reconstruction from computer tomography (CT) scans [ 8 ] . Recently, SSMs were used for the generation of training data for classification purposes [ 9 , 10 , 11 , 12 ] . Consequently we propose a method using an SSM to generate an arbitrarily large annotated training dataset of different liver shapes which is then used for anatomical landmark segmentation. The process involves a single manual labeling of desired anatomical landmarks on the mean shape extracted from the SSM. The labels are transferred to all generated shapes. Subsequently, this dataset serves as the training foundation for a deep-learning network tasked with detecting anatomical landmarks on previously unseen shapes. In the presented case study, we utilize a liver SSM to facilitate the dataset generation. Two liver landmarks, the anterior ridge and the falciform ligament, were segmented on the mean shape, and the SPRIN architecture [ 15 ] is chosen for the deep-learning network dedicated to 3D landmark segmentation, owing to its invariant behavior with respect to rotations. Within this work, we state two hypotheses: first, that anatomical consistency exists within shapes generated by the SSM, allowing for the transfer of anatomical landmarks from the mean shape onto the generated shapes and second, that utilizing the labeled synthetic dataset is suitable for training a deep-learning network enables robust segmentation of anatomical landmarks on unseen clinical shapes. 2 Methodology Figure 1: Overview of the proposed method employing an SSM for data generation. The mean shape derived from the SSM is manually labeled once (in this example: red: anterior ridge, blue: falciform ligament). Subsequently, labels are transferred to generated shapes using vertex indices. The annotated dataset is then utilized for training a deep-learning network. The introduced pipeline for 3D point cloud segmentation is illustrated in Fig. 1 . It starts with the one-time manual annotation of the mean shape derived from the SSM. Subsequently, the labels are transferred to the training data generated from the SSM. In this process, the vertex indices, along with their corresponding labels from the mean shape, are seamlessly copied to every generated shape. This step enables the generation of an arbitrary large labeled dataset for the training of a deep-learning network for the segmentation of anatomical landmarks on 3D shapes. 2.1 Case Study The presented case study serves as an illustrative application of the methodologies introduced in this work, focusing on the segmentation of two specific anatomical landmarks on 3D liver shapes. The first landmark, denoted by the blue label in Fig. 1 , corresponds to the anterior ridge, while the second landmark, identified by the red label in Fig. 1 , represents the falciform ligament. These landmarks were selected based on their prior use in 2D-3D registration for computer-assisted interventions in laparoscopic liver surgery [ 4 , 5 ] . An SSM was generated using 48 3D liver shapes, including 20 from the IRCAD dataset [ 16 ] according to the described method from [ 14 ] . With this SSM, it was possible to create a synthetic data set of liver shapes based on an annotated mean shape. Each generated shape is represented as \mathbf{x}=\mathbf{\bar{x}}+{\Lambda}^{\frac{1}{2}}\mathbf{V}\mathbf{a}\textrm{,} (1) where \mathbf{\bar{x}} is the mean shape, \Lambda the eigenvalue, \mathbf{V} the principal components (which is the output from the SSM generation) and \mathbf{a} denotes the parameter vector allowing the linear combinations (realizations) of the principal components. When morphing the mean shape into the realizations, the annotations from the mean shape are equivalently transferred to the synthetic liver shape. For the automatic annotation of the anterior ridge and the falciform ligament, the SO (3) invariant deep-learning network SPRIN [ 15 ] was chosen. The network takes the generated synthetic annotated point clouds from the SSM as input. Each point cloud \mathbf{p} is conceptualized in SPRIN as a discrete empirical probabilistic distribution of input points as \mathbf{p(x)}=\frac{1}{N}\sum_{i}^{N}\delta\mathbf{(x-x_{i})}\textrm{,} (2) where \delta denotes the Dirac delta function, and \mathbf{x_{i}} represents input points. SPRIN is leveraging farthest point sampling and k NN grouping to progressively conduct sparse rotation invariant spherical correlation between every point and its k nearest neighbors. The structure of SPRIN is summarized in the following: The initial two