GLoG-CSUnet: Enhancing Vision Transformers with Adaptable Radiomic Features for Medical Image Segmentation
Niloufar Eghbali Zarch, Hassan Bagher-Ebadian, Tuka Alhanai, Mohammad M. Ghassemi · 2025
Read GLoG-CSUnet: Enhancing Vision Transformers with Adaptable Radiomic Features for Medical Image Segmentation by Niloufar Eghbali Zarch, Hassan Bagher-Ebadian, Tuka Alhanai, Mohammad M. Ghassemi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-02788.txt.
Introduction
Niloufar Eghbali and co-authors present a 2025 paper on medical image segmentation. Software must outline organs and heart parts in scans so doctors can measure and plan care. Transformer models read wide context well but often miss fine local detail, above all on small data sets.
The team adds learnable filters that sense texture, edges, and borders, drawn from classic radiomics ideas. These filters feed a Swin network, and the design adds only a few dozen new settings. On a multi-organ data set and a heart data set, scores rose by about one point over strong models in the reported tests. The authors note the add-on can join other base models with ease.
Catalog record
| CREATOR | Niloufar Eghbali Zarch, Hassan Bagher-Ebadian, Tuka Alhanai, Mohammad M. Ghassemi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-02788
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GLoG-CSUnet: Enhancing Vision Transformers with Adaptable Radiomic Features for Medical Image Segmentation Niloufar Eghbali Zarch, Hassan Bagher-Ebadian, Tuka Alhanai, Mohammad M. Ghassemi Abstract Vision Transformers (ViTs) have shown promise in medical image semantic segmentation (MISS) by capturing long-range correlations. However, ViTs often struggle to model local spatial information effectively, which is essential for accurately segmenting fine anatomical details, particularly when applied to small datasets without extensive pre-training. We introduce Gabor and Laplacian of Gaussian Convolutional Swin Network (GLoG-CSUnet), a novel architecture enhancing Transformer-based models by incorporating learnable radiomic features. This approach integrates dynamically adaptive Gabor and Laplacian of Gaussian (LoG) filters to capture texture, edge, and boundary information, enhancing the feature representation processed by the Transformer model. Our method uniquely combines the long-range dependency modeling of Transformers with the texture analysis capabilities of Gabor and LoG features. Evaluated on the Synapse multi-organ and ACDC cardiac segmentation datasets, GLoG-CSUnet demonstrates significant improvements over state-of-the-art models, achieving a 1.14% increase in Dice score for Synapse and 0.99% for ACDC, with minimal computational overhead (only 15 and 30 additional parameters, respectively). GLoG-CSUnet’s flexible design allows integration with various base models, offering a promising approach for incorporating radiomics-inspired feature extraction in Transformer architectures for medical image analysis. The code implementation is available on GitHub at: https://github.com/HAAIL/GLoG-CSUnet. I Introduction Medical image semantic segmentation (MISS) is a critical task in healthcare, enabling precise identification and delineation of anatomical structures including organs and lesions. MISS is essential for accurate diagnosis, treatment planning, and disease monitoring [ 1 , 2 ] . The accuracy of MISS is particularly important in applications such as radiotherapy and surgical planning, where precision directly impacts patient outcomes [ 3 , 4 ] . The significance of MISS has driven continuous research into advanced segmentation methods. Initially, convolutional neural networks (CNNs), especially U-shaped architectures with skip-connections like U-Net, demonstrated high effectiveness in medical image segmentation [ 5 , 6 , 7 ] . However, these models struggle with the intrinsic locality of convolution operations, limiting their ability to model global context effectively [ 8 ] . Vision Transformers (ViTs) have recently emerged as powerful alternatives to CNNs for MISS [ 8 ] . The ViT model is designed to capture long-range dependencies within an image by splitting it into patches and treating each patch as a sequence element, similar to how words are processed in natural language processing models [ 9 ] . Unlike CNNs, which focus on local pixel relationships, ViTs use self-attention mechanisms to model global interactions between image patches, making them particularly effective for tasks where understanding global context is crucial [ 10 ] . This ability to model long-range dependencies between image patches allows for more global context awareness, which is particularly useful for segmenting complex structures across medical images [ 9 , 8 ] . I-A Related Works Several studies have explored hybrid approaches to medical image segmentation and report improved performance over traditional CNN-based methods; notable examples include: (i) TransUNet [ 8 ] , which combines CNNs and Transformers, and (ii) Swin-Unet [ 10 ] , a fully Transformer-based model within a CNN-based framework. Inspired by the success of Swin-Unet, several extensions have been proposed to further improve its performance, particularly in terms of local feature extraction and computational efficiency. Wang et al. [ 11 ] , introduced a novel Mixed Transformer Module (MTM), combining Local-Global Gaussian-Weighted Self-Attention (LGG-SA) and External Attention (EA) to capture both local and global dependencies. This model focuses on reducing computational complexity while maintaining high accuracy by emphasizing nearby patches more effectively. Similarly, Liu et al. [ 12 ] extended Swin-Unet by incorporating Convolutional Swin Transformer (CST) blocks, which add convolutional layers within the Transformer architecture to enhance spatial and local feature modeling. This approach addresses one of the limitations of purely Transformer-based models, which often struggle with boundary refinement and local feature extraction. By merging convolutions with multi-head self-attention, CST achieves better segmentation performance, especially on small datasets like those commonly used in medical image segmentation. I-B Challenges and Our Contribution Despite their potential, ViTs have limitations in capturing local spatial information, especially when applied to small datasets without extensive pre-training. This makes it difficult for them to accurately segment fine details such as the boundaries of small organs, which are critical in medical image analysis. Moreover, combining both CNNs and Vision Transformers (ViTs) in hybrid models can lead to significantly large and computationally expensive networks, further presenting a challenge in resource-constrained environments. To address these challenges, we propose GLoG-CSUnet, a novel architecture that enhances ViT-based models by integrating learnable radiomic features, specifically Gabor filters and Laplacian of Gaussian (LoG) filters, into the Transformer framework. Radiomics, the high-throughput extraction of quantitative features from medical images, has demonstrated great potential in improving diagnostic and predictive accuracy across various clinical applications [ 13 , 14 ] . Among radiomic features, Gabor filters are particularly effective at capturing multi-scale and multi-orientation texture information, which is crucial for characterizing complex tissue structures in medical images [ 15 ] . LoG filters, on the other hand, are valuable for improving edge detection and boundary precision, which are key to accurately segmenting anatomical structures [ 14 ] . Our approach leverages the strength of Gabor and LoG filters in extracting these discriminative texture and edge features, which complement the global context modeling capabilities of ViTs. By integrating these adaptive local radiomic features with the transformer architecture, GLoG-CSUnet aims to achieve a better balance between local detail preservation and global context understanding. This integration is particularly beneficial for smaller datasets where extensive pre-training is not feasible, as it enhances the model’s ability to capture fine-grained anatomical details without relying solely on large-scale data for feature learning. Fig. 1: An overview of the GLoG-CSUnet model architecture. (a) Segmentation Pipeline: the image is first processed through the Patch Embedding module, followed by multiple Convolutional Swin Transformer (CST) blocks. (b) Patch Embedding: transforms the input image into a format suitable for processing by the transformer blocks. It includes Gabor and Laplacian of Gaussian (LoG) transformation learning units. The outputs of these units are concatenated and further processed through multiple convolutional layers with Gaussian Error Linear Unit (GELU) activation and layer normalization (LN) to prepare the embedded Patches.(c) LoG Transformation Learning Unit: This unit learns the LoG filter parameters (d) Gabor Transformation Learning Unit: This unit learns the Gabor filter parameters. II Method In this section, we describe the architecture and components of GLoG-CSUnet. An overview of the method is presented in 1 . In addition, we detail the key elements of our approach, including the adaptable Gabor and LoG filters, data preparation, evaluation metrics, and experimental setup. II-A Model Overview GLoG-CSUnet extends the Convolutional Swin-Unet (CSUnet) architecture [ 12 ] , by incorporating adaptive Gabor filters and LoG filters into the segmentation pipeline. The architecture consists of the following main components: • Gabor transformation Layer: Utilizes learnable Gabor filters to extract multi-scale and multi-orientation texture and edge information. These filters dynamically adapt during training to optimize the capture of radiomic features. • LoG transformation Layer: Employs LoG filters to enhance boundary precision through edge detection and improved boundary delineation. The LoG filter parameters are optimized during the training process. • Convolutional