SAC-MIL: Spatial-Aware Correlated Multiple Instance Learning for Histopathology Whole Slide Image Classification
Yu Bai, Zitong Yu, Haowen Tian, Xijing Wang, Shuo Yan, Lin Wang, Honglin Li, Xitong Ling, Bo Zhang, Zheng Zhang, Wufan Wang, Hui Gao, Xiangyang Gong, Wendong Wang · 2025
Read SAC-MIL: Spatial-Aware Correlated Multiple Instance Learning for Histopathology Whole Slide Image Classification by Yu Bai, Zitong Yu, Haowen Tian, Xijing Wang, Shuo Yan, Lin Wang, Honglin Li, Xitong Ling, Bo Zhang, Zheng Zhang, Wufan Wang, Hui Gao, Xiangyang Gong, Wendong Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-03973.txt.
Introduction
SAC-MIL, a method for classifying whole slide histopathology images, the digitised microscope slides used in cancer diagnosis, occupies a 2025 research paper by Yu Bai and thirteen co-authors. A slide is far too large to feed a network at once, so multiple instance learning treats it as a bag of small patches and labels the bag. Patch positions matter, yet many methods ignore them.
One module encodes each patch's actual coordinates in the slide, capturing spatial relationships instead of relying on sequence order. That choice also solves length extrapolation, where test slides produce longer patch sequences than training slides. A second block computes full correlations between all instances with a simple multilayer perceptron design, in time linear in sequence length. Avoiding transformer machinery means no graphics kernels are needed for deployment. On three standard datasets covering lymph node, lung, and breast cancer slides, it reaches leading classification performance.
Catalog record
| CREATOR | Yu Bai, Zitong Yu, Haowen Tian, Xijing Wang, Shuo Yan, Lin Wang, Honglin Li, Xitong Ling, Bo Zhang, Zheng Zhang, Wufan Wang, Hui Gao, Xiangyang Gong, Wendong Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-03973
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SAC-MIL: Spatial-Aware Correlated Multiple Instance Learning for Histopathology Whole Slide Image Classification Yu Bai, Zitong Yu, Haowen Tian, Xijing Wang, Shuo Yan, Lin Wang, Honglin Li, Xitong Ling, Bo Zhang, Zheng Zhang, Wufan Wang, Hui Gao, Xiangyang Gong, Wendong Wang Abstract We propose Spatial-Aware Correlated Multiple Instance Learning (SAC-MIL) for performing WSI classification. SAC-MIL consists of a positional encoding module to encode position information and a SAC block to perform full instance correlations. The positional encoding module utilizes the instance coordinates within the slide to encode the spatial relationships instead of the instance index in the input WSI sequence. The positional encoding module can also handle the length extrapolation issue where the training and testing sequences have different lengths. The SAC block is an MLP-based method that performs full instance correlation in linear time complexity with respect to the sequence length. Due to the simple structure of MLP, it is easy to deploy since it does not require custom CUDA kernels, compared to Transformer-based methods for WSI classification. SAC-MIL has achieved state-of-the-art performance on the CAMELYON-16, TCGA-LUNG, and TCGA-BRAC datasets. The code will be released upon acceptance. Fig. 1: (a) MLP-based methods employ MLPs with vanilla attention (e.g., Sigmoid function) to perform WSI classification. These methods exhibit linear complexity with respect to the instance number but do not explicitly model correlations between instances. (b) Transformer-based methods utilize self-attention mechanisms with quadratic complexity to capture correlations between instances and also encode positional information for each instance. (c) SAC-MIL encodes positional information and performs full instance correlations using MLP layers through channel shifting. For simplicity, not all instance correlations are illustrated. I Introduction Whole Slide Image (WSI) classification plays a critical role in computer-aided diagnosis (CAD) [ 12 ] . WSI classification aims to perform tumor classification of a given slide. However, each slide exhibits an extremely high resolution of approximately 100,000\times 100,000 pixels, making the annotation of tumor regions a time-consuming process. To reduce the dependency on detailed tumor region annotation, recent research commonly adopts Multiple Instance Learning (MIL) approach for Whole Slide Image (WSI) classification [ 14 , 12 , 16 , 2 , 15 , 17 ] . Under the MIL setting, each slide is treated as a ”bag,” and the individual patches within the slide are considered ”instances.” The objective is to perform bag-level classification based on instance-level inputs while utilizing only the bag-level labels. Owing to this advantage, MIL-based approaches have become dominant for WSI classification. MIL-based methods can be broadly categorized into two primary types: Multi-Layer Perceptron (MLP)-based and Transformer-based approaches, as illustrated in Fig. 1 . MLP-based methods [ 16 , 15 , 14 ] employ MLPs augmented with vanilla attention to process all instances simultaneously, achieving linear complexity. Thus, MLP-based methods can efficiently process a large number of instances at a low computational cost, making them particularly suitable for WSI classification tasks where the number of instances often exceeds 10,000 [ 2 ] . However, MLP-based methods generally lack the ability to model full correlations between instances and often ignore the positional information of each instance. To alleviate these issue, Transformer-based methods [ 2 , 17 , 3 , 23 ] utilize the Transformer architecture [ 24 , 18 ] to model full instance correlations and encode positional information through a positional encoding module. However, Transformer-based methods still face certain shortcomings in WSI classification. In WSI classification, the input sequence can be long due to the high resolution of WSIs. When handling such long sequences, the Transformer architecture suffers from high computational cost [ 24 , 18 ] . To reduce computational cost, recent Transformer-based methods have adopted various efficient self-attention mechanisms [ 22 , 2 , 23 , 17 ] . However, custom CUDA kernels require specific GPU architectures, thus limits the deployment under the GPU shortage in clinical settings [ 59 , 60 ] . However, these efficient self-attention mechanisms still face two main challenges: (1) Performance Degradation : Some methods [ 2 , 37 , 22 , 39 , 20 ] compute approximated self-attention instead of full self-attention [ 24 ] , which may lead to performance degradation. (2) Hardware Compatibility : Other methods [ 51 ] compute full self-attention using custom CUDA kernels. However, custom CUDA kernels require specific GPU architectures, thus limiting the deployment under the GPU shortage in clinical settings [ 59 , 60 ] . On the contrary, MLP-based methods do not face the challenges present in Transformer-based methods. Since MLP-based methods exhibit linear computational complexity with respect to the sequence length, MLP layers can be easily adopted to process long sequences without modification. And the simple structure of MLP layers also makes them easy to deploy. However, MLP-based methods lack the ability to encode positional information and perform full instance correlation compared to Transformer-based methods. Therefore, we pose the following question: Can we enable MLP-based methods to encode positional information and perform full instance correlations so that they can have the advantages of Transformer-based methods while eliminating their disadvantages? To achieve this goal, we propose Spatial-Aware Correlated Multiple Instance Learning (SAC-MIL) for WSI classification. The overall architecture of SAC-MIL is illustrated in Fig. 2 . We first divide all instances into multiple regions using FPS [ 32 ] (Farthest Point Sampling) and KNN (K-Nearest Neighbors) to encode the local context. Then, Polar Rotary Position Embedding (PROPE) is introduced to encode the positional information of each instance. Finally, a stack of SAC blocks are used to gradually perform instance correlations, inspired by [ 10 , 9 ] . PROPE adopts spatial coordinates of each instance within the WSI instead of the token index. The token index cannot fully reflect the spatial information of each instance due to the irregular shapes of tissue areas. Additionally, PROPE adopts the polar coordinate system instead of the traditional Cartesian coordinate system [ 6 , 7 ] to encode the positional information of WSIs. This approach ensures that each dimension can obtain full positional information, rather than partial positional information (single axial) as in 2D ROPE [ 6 , 7 , 33 ] . Furthermore, PROPE normalizes the polar coordinates of both training and testing samples to the same range, alleviating the length extrapolation issue [ 57 ] when both sequences have different lengths. SAC blocks adopt a two-step process to perform instance correlations within each region: (1) Partial correlation: Split all instances into multiple folds, shift each fold with an increased step, and perform fold-level correlations using a channel-wise MLP. (2) Full correlation: Reverse each fold to its original position and apply another channel-wise MLP to process sequences of various lengths. The first step performs fold-level correlations so that each fold contains partial features of other instances from the same region. The second step performs instance-level correlations, as each fold now contains all the features of other folds within the same region. After these two steps, full instance correlation is performed within each region. The region size increases exponentially as the number of layers increases. Therefore, the Effective Context Length (ECL) can quickly reach the maximum length. SAC-MIL can encode positional information and perform full instance correlation with linear time complexity. Its simple MLP-style architecture also facilitates easy deployment. The contributions