U nit-Based Histopathology T issue S egmentation via Multi-Level Feature Representation

Ashkan Shakarami, Azade Farshad, Yousef Yeganeh, Lorenzo Nicolè, Peter Schüffler, Stefano Ghidoni, Nassir Navab · 2025

Read U nit-Based Histopathology T issue S egmentation via Multi-Level Feature Representation by Ashkan Shakarami, Azade Farshad, Yousef Yeganeh, Lorenzo Nicolè, Peter Schüffler, Stefano Ghidoni, Nassir Navab (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12427.txt.

Introduction

Seven researchers propose a simpler unit for labeling tissue in microscope slides of tumors. Instead of classifying every pixel, their system, called UTS, sorts fixed 32-by-32 tiles of the image. Tile-level labels are faster for experts to produce and cheaper to compute, as long as accuracy holds. A custom transformer model reads each tile at several scales at once, joining fine cell detail with the wider tissue pattern.

The team trained the system to divide breast tissue into invading tumor, non-cancer connective tissue, and fat, tasks that feed into measuring tumor spread and judging surgical margins. On nearly 390,000 tiles from 459 stained regions, the method beat U-Net variants and other transformer baselines. The authors say code and data will be shared, and they frame tile-based reading as a practical route to routine digital pathology.

Catalog record

CREATORAshkan Shakarami, Azade Farshad, Yousef Yeganeh, Lorenzo Nicolè, Peter Schüffler, Stefano Ghidoni, Nassir Navab
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-12427

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

U nit-Based Histopathology T issue S egmentation via Multi-Level Feature Representation Ashkan Shakarami, Azade Farshad, Yousef Yeganeh, Lorenzo Nicolè, Peter Schüffler, Stefano Ghidoni, Nassir Navab Abstract We propose UTS , a unit-based tissue segmentation framework for histopathology that classifies each fixed-size 32 × 32 32\times 32 tile, rather than each pixel, as the segmentation unit. This approach reduces annotation effort and improves computational efficiency without compromising accuracy. To implement this approach, we introduce a Multi- L evel Vi sion T ransformer (L-ViT), which benefits the multi-level feature representation to capture both fine-grained morphology and global tissue context. Trained to segment breast tissue into three categories ( infiltrating tumor , non-neoplastic stroma , and fat ), UTS supports clinically relevant tasks such as tumor-stroma quantification and surgical margin assessment. Evaluated on 386,371 tiles from 459 H&E-stained regions, it outperforms U-Net variants and transformer-based baselines. Code and Dataset will be available at GitHub . Keywords : Unit-Based Segmentation, Histopathology, Vision Transformers, Multi-Level Feature Representation. 1 Introduction Accurate tissue segmentation in histopathological Whole Slide Images (WSIs) is fundamental to digital pathology, enabling computational support for diagnosis, prognosis, and treatment planning [ 1 , 2 , 3 ] . Conventional approaches, such as U-Net [ 4 ] and DeepLab [ 5 ] , rely on pixel-wise segmentation, which requires dense annotations, is prone to noisy outputs, and incurs substantial computational costs—especially at gigapixel resolution [ 6 , 7 ] . Transformer-based architectures such as TransUNet [ 8 ] , Swin-UNet [ 9 ] , and H2G-Net [ 10 ] have enhanced global context modeling and multiscale feature learning (A literature review is provided in Appendix B , which discusses related work in moew detail). However, they remain fundamentally tied to the pixel-wise paradigm, which limits scalability in clinical environments with hardware constraints. We propose UTS , which treats each fixed-size 32\times 32 tile as a semantic unit rather than relying on conventional pixel-wise segmentation. This approach redefines the segmentation primitive to better align with how pathologists interpret tissue on WSI, and enables scalable analysis without the overhead of dense annotation. To operationalize this approach, we introduce L-ViT , a new Multi-Level Vision Transformer architecture designed to capture local and global histological patterns. Unlike pixel-wise segmentation at downsampled resolutions, which averages tissue information across regions, UTS retains high-resolution morphological detail within each 32 \times 32 tile ( subsection 3.5 ). L-ViT incorporates an EfficientNetB3 backbone and fuses multi-scale features through Multi-Level Feature Fusion (MLFF) for hierarchical representation learning. Attention modules, including Dilated Attention and Squeeze-and-Excitation (DAT-SE) and Dilated Convolutional Block Attention Module (D-CBAM), further enhance spatial and channel-level discrimination. By decoupling segmentation from pixel-level granularity and enabling rich context modeling, UTS provides a computationally efficient, interpretable, and clinically aligned framework for whole-slide tissue analysis. 2 UTS UTS, as illustrated in Figure 1 , presents an end-to-end framework for histopathological tissue segmentation, encompassing Data acquisition, preprocessing ( subsection 2.1 ), segmentation ( subsection 2.2 ), and visualization ( subsection 2.3 ). Appendix A also proves theoretical justification of UTS. Figure 1 : UTS Pipeline . (a) Tissue extraction via biopsy or surgery. (b) H&E-stained WSI acquisition through processing, staining, and digitization. (c) SlideTiler preprocessing for WSI or ROI selection and standardized tiling into 32\times 32 pixel tiles. (d) Segmentation using L-ViT to classify tiles into Infiltrating Breast Tumor , Fat Tissue , and Non-neoplastic Stroma , visualized with color-coded overlays. The system also computes tissue composition ratios (e.g., Tumor: 51.71%, Stroma: 12.22%, Fat: 36.07%), enabling automated tumor-stroma quantification based on unit-level classification using fixed-size 32\times 32 tiles. This integrated analysis supports Tumor–Stroma Ratio (TSR) estimation, providing interpretable metrics for prognostic assessment and personalized treatment planning. 2.1 Data Acquisition and Preprocessing UTS begins with the acquisition of H&E-stained WSIs, digitized from tissue samples obtained through biopsy or surgical resection. To prepare these high-resolution WSIs for segmentation, we employ the SlideTiler toolbox [ 11 ] , which facilitates efficient and standardized preprocessing. In this stage, a pathologist selects either ROIs or entire slide areas. SlideTiler then partitions these selections into uniform 32\times 32 pixel tiles. Formally, each WSI or ROI I_{i} is divided into N tiles T_{ij} , i.e., I_{i}=\bigcup_{j=1}^{N}T_{ij} , where each tile (semantic unit) T_{ij} is stored in PNG format. Unlike traditional tools such as QuPath, SlideTiler automates tile generation and preserves diagnostically relevant structures while excluding background and artifacts. This standardized tile-based format reduces preprocessing overhead and aligns with the unit-based segmentation approach of UTS, allowing for seamless downstream processing by the L-ViT segmentation engine ( subsection 2.2 ). The resulting tiles serve as input to the classification model, forming a scalable and annotation-efficient representation of histological content. This tile-level granularity reflects how pathologists often interpret morphology in discrete regions, enabling efficient and interpretable segmentation aligned with clinical workflow. 2.2 Segmentation The core segmentation engine of UTS classifies each 32\times 32 tile into one of three histological classes: infiltrating tumor , non-neoplastic stroma , or fat . This classification approach is powered by L-ViT (detailed in subsubsection 2.2.1 ), a vision transformer architecture adapted for histopathological tile segmentation. The model receives raw image tiles and outputs class probabilities directly, without requiring postprocessing or pixel-level masks. This simplifies annotation, reduces computational overhead, and aligns with how pathologists reason about tissue morphology at the regional level. By integrating the segmentation output over the entire slide or ROI, UTS reconstructs a coarse-grained, semantically meaningful segmentation map that supports downstream clinical tasks such as tumor quantification and tissue composition analysis. 2.2.1 L-ViT Figure 2 illustrates an overview of L-ViT. It adopts EfficientNetB3 as the backbone, taking advantage of its lightweight and efficient design, which offers high flexibility in adapting to varying input sizes and computational constraints through compound scaling [ 12 , 13 ] . L-ViT also integrates the DAT-SE for channel-wise feature recalibration ( subsubsection 2.2.1 ) [ 14 ] and D-CBAM to apply channel and spatial attention ( subsubsection 2.2.1 ) [ 15 ] . In addition, MLFF [ 16 , 17 ] ensures effective integration of features at different stages of the network. L-ViT incorporates Transformer blocks in its final layers to capture long-range dependencies [ 18 ] , as well. The refined feature maps are processed through dense layers, culminating in a softmax layer for multi-class classification. The following subsections provide further details on each component. Figure 2 : Overview of L-ViT. MLFF integrates low-, mid-, and high-level features to enhance classification accuracy by combining local and global context. For component details, refer to DAT-SE ( subsubsection 2.2.1 ), D-CBAM ( subsubsection 2.2.1 ), and VTM ( subsubsection 2.2.1 ). Figure 3 : DAT-SE ( subsubsection 2.2.1 ): Enhances feature representation by recalibrating input maps with channel and spatial attention [ 14 ] . Figure 4 : D-CBAM ( subsubsection 2.2.1 ): Extends CBAM [ 19 , 15 ] by integrating channel and spatial attention for improved feature focus. Figure 5 : VTM Architecture ( subsubsection 2.2.1 ), utilizing Transformer blocks [ 18 ] with Multi-Head Self-Attention, Feed-Forward Networks, and Layer Normalization. DAT-SE. DAT-SE enhances feature representation by applying channel-wise and spatial attention mechanisms, dynamically recalibrating input feature maps to improve their discriminative power [ 14 ] . Given an input feature map \mathbf{X}\in\mathbb{R}^{H\times W\times

Read the complete text