MOSAIC: A Multi-View 2.5D Organ Slice Selector with Cross-Attentional Reasoning for Anatomically-Aware CT Localization in Medical Organ Segmentation
Hania Ghouse, Muzammil Behzad · 2025
Read MOSAIC: A Multi-View 2.5D Organ Slice Selector with Cross-Attentional Reasoning for Anatomically-Aware CT Localization in Medical Organ Segmentation by Hania Ghouse, Muzammil Behzad (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10672.txt.
Introduction
Hania Ghouse and Muzammil Behzad built in 2025 a tool that picks the useful slices from belly CT scans before organ outlining begins. Full three-dimensional outlining is slow and memory-hungry, and most slices show no target organ. Flat two-dimensional methods are cheaper but miss context and suffer lopsided class counts.
Their selector fuses triplets of slices from three viewing angles and reasons over them with a vision-language model. Only slices with real structural promise pass on to the outlining stage. The filter is consistent across angles, so organs are not lost at the borders. Less junk input means faster, steadier scans analysis.
Catalog record
| CREATOR | Hania Ghouse, Muzammil Behzad |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-10672
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MOSAIC: A Multi-View 2.5D Organ Slice Selector with Cross-Attentional Reasoning for Anatomically-Aware CT Localization in Medical Organ Segmentation Hania Ghouse, Muzammil Behzad Abstract Efficient and accurate multi-organ segmentation from abdominal CT volumes is a fundamental challenge in medical image analysis. Existing 3D segmentation approaches are computationally and memory intensive, often processing entire volumes that contain many anatomically irrelevant slices. Meanwhile, 2D methods suffer from class imbalance and lack cross-view contextual awareness. To address these limitations, we propose a novel, anatomically-aware slice selector pipeline that reduces input volume prior to segmentation. Our unified framework introduces a vision-language model (VLM) for cross-view organ presence detection using fused tri-slice (2.5D) representations from axial, sagittal, and coronal planes. Our proposed model acts as an "expert" in anatomical localization, reasoning over multi-view representations to selectively retain slices with high structural relevance. This enables spatially consistent filtering across orientations while preserving contextual cues. More importantly, since standard segmentation metrics such as Dice or IoU fail to measure the spatial precision of such slice selection, we introduce a novel metric, Slice Localization Concordance (SLC), which jointly captures anatomical coverage and spatial alignment with organ-centric reference slices. Unlike segmentation-specific metrics, SLC provides a model-agnostic evaluation of localization fidelity. Our model offers substantial improvement gains against several baselines across all organs, demonstrating both accurate and reliable organ-focused slice filtering. These results show that our method enables efficient and spatially consistent organ filtering, thereby significantly reducing downstream segmentation cost while maintaining high anatomical fidelity. 1 Introduction Medical organ segmentation lies at the heart of modern diagnostic and therapeutic workflows, enabling precise identification of anatomical structures that are critical for disease detection, treatment planning, and surgical guidance ( Potineni 2025 ) . The unparalleled spatial resolution and cross-sectional imaging capabilities of Computed tomography (CT) scans have made them indispensable for such tasks ( Bhuiyan et al. 2023 ) . However, the computational demands of processing volumetric 3D CT data remain a significant barrier to real-time clinical adoption. While excelling in capturing complex spatial relationships across entire volumes, traditional 3D segmentation methods require substantial computational resources, often rendering them impractical for resource-constrained environments ( Dai et al. 2022 ) . For instance, 3D convolutional neural networks (CNNs) achieve superior accuracy by analyzing the full volumetric context but face challenges in deployment due to their high-memory and processing requirements ( Angelin Beulah S 2025 ) . At the same time the analysis of medical images, particularly CT scans, is essential for various clinical applications, including computer-aided diagnosis, surgical navigation, and radiation therapy ( Liu et al. 2023 ) . In contrast, the conventional 2D approaches in the literature process individual slices sequentially and offer computational efficiency but at the cost of losing inter-slice spatial context ( Zhou et al. 2023 ) . This limitation is particularly problematic in multi organ segmentation, where critical anatomical details often span multiple slices ( Xia et al. 2018b ) . Clinical practitioners and radiologists intuitively mitigate this bottleneck by leveraging three orthogonal views: axial, sagittal, and coronal to triangulate anatomical boundaries and assess the spatial relationships between structures ( Bridge 2016 ) , as illustrated in Figure 1 . (a) Axial Slice (Horizontal View) (b) Coronal Slice (Frontal View) (c) Sagittal Slice (Side View) Figure 1 : Orthogonal anatomical views used in CT imaging. Despite the context-rich spatial information, most automated segmentation studies focus exclusively on axial slices to utilize conventional 2D deep learning models, neglecting sagittal and coronal views that could provide complementary spatial information ( Lindeijer et al. 2023 ) . This narrow focus magnifies the inherent weaknesses of 2D methods, such as their inability to capture 3D structural continuity, leading to suboptimal segmentation accuracy in regions with complex geometries ( Yu et al. 2024 ) . Furthermore, peripheral slices often contain irrelevant structures like muscle, bone, or artifacts, while central slices may lack sufficient anatomical details to guide segmentation ( Al-Ameen and Sulong 2016 ) . Existing 2D frameworks typically process all slices uniformly, wasting computational resources on unwanted regions and failing to prioritize slices with high organ presence ( Bott et al. 2023 ) . This inefficiency is intensified by class imbalancing, as datasets often contain far more non-organ slices than those with target structures, thereby skewing the model performance and hindering the training of robust organ segmentation algorithms ( Tappeiner et al. 2022 ) . To bridge the gap between 2D efficiency and 3D accuracy, advances in 2.5D segmentation aim to integrate adjacent slices (e.g., current, previous, and next), to mimic volumetric context ( Zhang et al. 2019 ) , ( Hung et al. 2023 ) , ( Xia et al. 2018a ) ,as shown in Figure 2 . While this approach reduces computational overhead compared to full 3D analysis, it still processes slices in isolation and neglects the unique anatomical insights provided by multi-plane views. For example, the sagittal view may better capture longitudinal organ contours, while the coronal view highlights lateral structures. This crucial information is lost when focusing solely on axial slices ( Khan 2019 ) . Figure 2 : Illustration of input representations in 2D (left side) and 2.5D (right side) slice. 2 Literature Review Organ segmentation in CT scans has advanced significantly with recent advancements in deep learning, yet several challenges persist in balancing computational efficiency, anatomical specificity, and generalizability ( Ni et al. 2024 ) ( Irshad et al. 2023 ) . Traditional approaches, like deformable models ( Kumar and Jain 2022 ) ( Kim and Ye 2022 ) and graph cuts ( Fu et al. 2021 ) ( Xie et al. 2025 ) ( Wang et al. 2024 ) , rely on shape priors and energy minimization to segment organs, but these methods often struggle with inter-patient anatomical variability and require manual initialization, limiting their scalability. Other deep learning efforts, including U-Net variants ( Brunese et al. 2025 ) ( Shastry et al. 2025 ) , demonstrated promising performance in 2D segmentation but faced class imbalance issues due to non-uniform slice relevance across CT volumes.For example, a two-step framework that integrates a slice selector with 3D encoders achieved a Dice score of 95% for organs at risk in head and neck cancer. However, it still processed redundant slices, resulting in increased computational overhead ( Zhang et al. 2020 ) , ( Guo et al. 2020 ) , ( Chen et al. 2021 ) , ( Lei et al. 2021 ) . Recent 3D models, such as V-Net and 3D U-Net ( Zhou 2020 ) ( Pan et al. 2025 ) ( Hossain et al. 2025 ) , capture spatial context more effectively but demand high computational resources, hindering their adoption in clinics with limited infrastructure. To address these limitations, researchers have explored 2.5D methods that incorporate neighboring slices to approximate the volumetric context without the full computational cost of 3D models ( Kumar et al. 2024 ) ( Yin et al. 2025 ) . One approach involves thickening 2D network inputs by feeding multiple slices as channels to integrate 3D contextual information while maintaining lower inference latency ( Yu et al. 2019 ) ( Vu et al. 2020 ) . Other studies used a 2.5D residual U-Net for liver lesion segmentation and demonstrated improved performance