Continuous and complete liver vessel segmentation with graph-attention guided diffusion Journal: Knowledge-Based Systems
Xiaotong Zhang, Alexander Broersen, Gonnie CM van Erp, Silvia L. Pintea, Jouke Dijkstra* · 2024
Read Continuous and complete liver vessel segmentation with graph-attention guided diffusion Journal: Knowledge-Based Systems by Xiaotong Zhang, Alexander Broersen, Gonnie CM van Erp, Silvia L. Pintea, Jouke Dijkstra* (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-00617.txt.
Description
Abstract Improving connectivity and completeness are the most challenging aspects of liver vessel segmentation, especially for small vessels. These challenges require both learning the continuous vessel geometry and focusing on small vessel detection. However, current methods do not explicitly address these two aspects and cannot generalize well when constrained by inconsistent annotations.
Catalog record
| CREATOR | Xiaotong Zhang, Alexander Broersen, Gonnie CM van Erp, Silvia L. Pintea, Jouke Dijkstra* |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-00617
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Continuous and complete liver vessel segmentation with graph-attention guided diffusion Journal: Knowledge-Based Systems Xiaotong Zhang, Alexander Broersen, Gonnie CM van Erp, Silvia L. Pintea, Jouke Dijkstra* Abstract Improving connectivity and completeness are the most challenging aspects of liver vessel segmentation, especially for small vessels. These challenges require both learning the continuous vessel geometry and focusing on small vessel detection. However, current methods do not explicitly address these two aspects and cannot generalize well when constrained by inconsistent annotations. Here, we take advantage of the generalization of the diffusion model and explicitly integrate connectivity and completeness in our diffusion-based segmentation model. Specifically, we use a graph-attention module that adds knowledge about vessel geometry. Additionally, we perform the graph-attention at multiple-scales, thus focusing on small liver vessels. Our method outperforms five state-of-the-art medical segmentation methods on two public datasets: 3D-ircadb-01 and LiVS . 1 Introduction Figure 1: (a) Vessel trees of nnUNet [ 1 ] , Swin UNETR [ 2 ] , our proposed model and the ground truth. (b) Vessel trees predicted by our method across different steps ( t{=}0 is the final diffusion iteration). Rescaling is the process of recovering the resolution of resized CT images to that of the original CT images. Liver cancer is the fourth leading cause of death according to statistics on cancer-related mortality [ 3 ] . Furthermore, the liver is a frequent site for metastasis of various primary tumors, such as gastrointestinal tumors, breast cancer, lung cancer, and melanoma [ 4 ] . Both primary and secondary liver cancer have multiple treatment options, including surgery, and various interventional oncology liver treatments. The preoperative planning of these treatments can be improved with accurate segmentation of the liver vessels [ 5 , 6 ] . In preoperative planning of liver tumor resection [ 6 ] , visualizing the spatial location between liver vessels and tumors in a 3 D view is essential to reduce surgical risk. Liver vessel segmentation is used primarily to ensure that the main vessels are not located near the planned resection region, thus reducing bleeding. Liver vessels also indicate the boundaries for the Couinaud classification [ 6 ] . Furthermore, it can assist in targeting the correct tumor nutrient supply vessel to decrease the recurrence rate in embolic therapies [ 7 ] . Hence, accurate liver vessel segmentation is essential in liver tumor surgery. However, acquiring automatic liver vessel segmentation is challenging due to the complex anatomy. Automatic liver vessel segmentation is performed on computed tomography (CT) images. Traditionally, methods relied on image filtering [ 8 , 9 ] , active contour models [ 10 , 11 ] , or tracking methods [ 12 , 13 ] . Currently, the leading methods on liver vessel segmentation are based on deep artificial networks [ 14 , 15 , 1 , 2 ] . nnUNet [ 1 ] can extract features automatically from the CT images. However, nnUNet cannot ensure vessel continuity, as shown in Fig. 1 (a). Attention-based methods [ 16 , 17 ] as used in Swin UNETR [ 2 ] improve vessel continuity. Yet, Swin UNETR struggles with horizontally distributed vessel, as seen in Fig. 1 (a). In addition, the performance of the above Convolutional Neural Network (CNN) based methods have the generalization problem, especially when the label annotation styles across data are different [ 18 ] . Thus, ensuring vessel continuity in all directions, localizing small vessels, and improving model generalization for the inconsistent annotation style remains challenging. Here, we address these three challenges: ensuring vessel continuity, segmenting small vessels, and improving generalization. We start from a 2 D diffusion model [ 19 , 20 ] . We opt for a 2 D rather than a 3 D diffusion model to reduce computational requirements. To ensure vessel continuity, we add graph-attention layers [ 21 ] into the diffusion model. Because the graph is sparse, we compensate for this by integrating neighboring features on the graph in a local ensemble module [ 22 ] . The local ensemble module ensures a smooth transition between different nodes [ 22 ] . Secondly, to segment small vessels, we extract features at multiple scales in the nodes of the graph. The effectiveness of these components is shown in Fig. 1 (b). Our contributions are: (i) explicitly incorporating vessel continuity by adding graph-attention conditioning to a diffusion model for liver vessel segmentation; (ii) explicitly focusing on small vessels by relying on multi-scale graph-features when conditioning the diffusion model; (iii) continuous and complete vessel segmentations on two public datasets 3D-ircadb-01 [ 23 ] and LiVS [ 24 ] , compared to existing work. 2 Related Work Liver vessel segmentation. Liver vessel segmentation currently relies on CNN and attention methods. CNN methods either rely on FCN (fully convolutional networks) [ 15 , 25 ] , or follow the UNet architecture [ 14 , 26 ] . Attention methods can be grouped into self-attention [ 16 , 27 ] and graph-attention [ 28 , 17 ] methods. UNet [ 29 ] and its variants are the effective for medical segmentation. However, they struggle with imbalanced data [ 30 ] , such as between the vascular and the liver region. Moreover, their performance is limited by the receptive-field size of the convolutions [ 31 ] . While the data imbalance can be mitigated by improving the Dice loss [ 14 ] , learning long-range dependencies remains a challenge [ 2 ] . To address this, Swin-transformer [ 32 ] uses a transformer architecture, and thus its receptive-field size covers the full input resolution. Similarly, graph-attention networks [ 33 ] capture long-range dependencies by computing node attention-coefficients. Augmenting the UNet by Swin-transformer [ 16 ] , or using the graph-attention to assist the UNet training [ 17 ] is also effective in practice. Here, we also combine the capabilities of CNNs and attention mechanisms. Moreover, we jointly enforce continuity of the vessel-tree segmentations and focus on small vessels. Diffusion models for medical image segmentation. Diffusion [ 19 ] methods showcase promising results for medical image segmentation. These diffusion methods are either non-dynamic conditioning [ 34 ] or dynamic conditioning [ 35 , 36 ] . The non-dynamic models concatenate medical images to the input, and do not adapt this conditioning information over time. Their performance [ 34 , 37 ] is comparable to (or lower than) nnUNet [ 1 ] , which is the standard medical segmentation baseline. On the other hand, dynamic conditioning methods [ 36 ] use an extra encoder to generate time-dependent conditioning information. Similarly to the non-dynamic conditioning models, their accuracy is limited. More recently, MedSegDiff [ 35 ] using a hybrid constrained method, obtains state-of-the-art results. MedSegDiff predicts a weighted combination of a diffusion segmentation and an auxiliary segmentation from the conditioning branch. This combination weakens the contribution of the diffusion model. Here, we build on a 2 D dynamic conditioning diffusion model constrained by a hybrid loss, yet we only predict the diffusion segmentation. Graph-based methods for medical image segmentation. Graphs are one of the most intuitive way to represent complex anatomical structures. Graph-based methods can segment medical tree structures [ 38 , 39 ] , but also non-structural medical data [ 40 ,