LIDAR: Lightweight Adaptive Cue-Aware Fusion Vision Mamba for Multimodal Segmentation of Structural Cracks Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland Proceedings of the 33rd ACM International Conference on Multimedia (MM ’25),
Hui Liu, Chen Jia, Fan Shi, Xu Cheng, Mengfei Shi, Xia Xie, Shengyong Chen · 2025
Read LIDAR: Lightweight Adaptive Cue-Aware Fusion Vision Mamba for Multimodal Segmentation of Structural Cracks Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland Proceedings of the 33rd ACM International Conference on Multimedia (MM ’25), by Hui Liu, Chen Jia, Fan Shi, Xu Cheng, Mengfei Shi, Xia Xie, Shengyong Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22477.txt.
Introduction
Hui Liu, Chen Jia, Fan Shi, and four co-authors segment structural cracks at pixel level with a lightweight network named LIDAR. Crack inspection uses several data modes at once, and older methods fuse them slowly or bluntly. LIDAR perceives shape and texture cues from each mode and merges them on the fly. Two custom modules do the work, one for cue-aware scanning and one for dual domain fusion across space and frequency.
A lightweight multi-kernel convolution reads complex crack shapes at low cost and replaces most standard convolutions. Experiments on three datasets beat leading methods. The paper appeared at the ACM International Conference on Multimedia in Dublin.
Catalog record
| CREATOR | Hui Liu, Chen Jia, Fan Shi, Xu Cheng, Mengfei Shi, Xia Xie, Shengyong Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-22477
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LIDAR: Lightweight Adaptive Cue-Aware Fusion Vision Mamba for Multimodal Segmentation of Structural Cracks Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland Proceedings of the 33rd ACM International Conference on Multimedia (MM ’25), October 27–31, 2025, Dublin, Ireland DOI: 10.1145/3746027.3755452 ISBN: 979-8-4007-2035-2/2025/10 Conference: Make sure to enter the correct conference title from your rights confirmation email; October 27–31, 2025; Dublin, Ireland 3846 CCS: Computing methodologies Image segmentation Hui Liu, Chen Jia, Fan Shi, Xu Cheng, Mengfei Shi, Xia Xie, Shengyong Chen Abstract . Achieving pixel-level segmentation with low computational cost using multimodal data remains a key challenge in crack segmentation tasks. Existing methods lack the capability for adaptive perception and efficient interactive fusion of cross-modal features. To address these challenges, we propose a Lightweight Adaptive Cue-Aware Vision Mamba network (LIDAR), which efficiently perceives and integrates morphological and textural cues from different modalities under multimodal crack scenarios, generating clear pixel-level crack segmentation maps. Specifically, LIDAR is composed of a Lightweight Adaptive Cue-Aware Visual State Space module (LacaVSS) and a Lightweight Dual Domain Dynamic Collaborative Fusion module (LD3CF). LacaVSS adaptively models crack cues through the proposed mask-guided Efficient Dynamic Guided Scanning Strategy (EDG-SS), while LD3CF leverages an Adaptive Frequency Domain Perceptron (AFDP) and a dual-pooling fusion strategy to effectively capture spatial and frequency-domain cues across modalities. Moreover, we design a Lightweight Dynamically Modulated Multi-Kernel convolution (LDMK) to perceive complex morphological structures with minimal computational overhead, replacing most convolutional operations in LIDAR. Experiments on three datasets demonstrate that our method outperforms other state-of-the-art (SOTA) methods. On the light-field depth dataset, our method achieves 0.8204 in F1 and 0.8465 in mIoU with only 5.35M parameters. Code and datasets are available at https://github.com/Karl1109/LIDAR-Mamba . 1. Introduction Cracks with diverse morphologies frequently appear on the surfaces of real-world materials such as asphalt, concrete, plastic runways, and masonry, primarily due to shear stress. Thus, regular and automated structural health monitoring is essential to prevent losses in daily production and life ( Chen et al. 2024 ; Liao et al. 2022 ; Lang et al. 2024 ; Zhang et al. 2023c ; Xue et al. 2023 ; Li et al. 2025a ) . Recently, deep learning-based methods have demonstrated strong performance in automatic crack image segmentation ( Jaziri et al. 2024 ; Liu et al. 2021 ; Xiang et al. 2023 ; Wang et al. 2024b ) . However, most methods rely solely on single-modality RGB data, making them vulnerable to lighting variations and background noise ( Liu et al. 2022a ) . They fail to capture subsurface thermal anomalies in infrared images, model stress-induced polarization changes, or interpret spatial hierarchies in depth images ( Wang et al. 2022 ) , resulting in degraded performance under complex visual conditions such as uneven illumination, cluttered backgrounds, and ambiguous crack boundaries ( Liu et al. 2022b ) . Figure 1. Performance of LIDAR on light-field depth dataset. (a) Comparison with SOTA methods. (b) Impact of different convolution types on performance. (c) Segmentation results for dual-modality images under complex conditions. Recent multimodal semantic segmentation methods based on Convolutional Neural Networks (CNNs) and Transformers have achieved promising results ( Yang et al. 2023 ; Ye and Xu 2022 ; Bachmann et al. 2022 ; Wang et al. 2024a ) . Representative methods such as PGDENet ( Zhou et al. 2022 ) , CAINet ( Lv et al. 2024 ) , and ESANet ( Seichter et al. 2022 ) utilize CNNs to fuse high-level semantics with low-level spatial details through progressively guided strategies that reduce modality discrepancies. While CNN-based methods effectively capture morphological cues in key regions, their limited receptive fields and inductive biases hinder the modeling of continuous texture patterns. Additionally, lots of convolution operations lead to increased computational overhead. Transformer-based methods such as Omnivore ( Girdhar et al. 2022 ) , EMMA ( Zhao et al. 2024 ) , and CMX ( Zhang et al. 2023b ) encode different modalities into interactive embeddings and employ self-attention to model long-range dependencies. Although they capture both morphological and textural cues effectively, the quadratic scaling of attention mechanisms with input length makes training and inference on high-resolution images computationally expensive and unsuitable for edge deployment ( Yu and Wang 2025 ) . Despite their promising results, all of the above methods lack selective interaction and noise suppression across modalities and feature levels, leading to the loss of critical details. Recently, the Selective State Space model (S6) Mamba ( Gu and Dao 2023 ; Gu et al. 2022b ) has shown impressive performance in long-sequence modeling. Compared to traditional linear time-invariant state space models (S4) ( Gu et al. 2022a ; Goel et al. 2022 ) , Mamba offers greater flexibility for complex data while reducing computational cost ( Lu and Du 2025 ; Xiao et al. 2025 ; Guo et al. 2024 ; Mushui et al. 2024 ) . Its success in vision tasks, such as Vision Mamba ( Zhu et al. 2024 ) , confirms its effectiveness in modeling both local cues and long-range dependencies by scanning fixed-size pixel patches within each Visual State Space (VSS) block. Vision Mamba has since inspired various Mamba-based variants ( Zhang et al. 2025 ; Li et al. 2025b ) , where the scanning strategy is key to capturing spatial dependencies across regions. PlainMamba ( Yang et al. 2024 ) , VMamba ( Liu et al. 2024 ) , and SCSegamba ( Liu et al. 2025 ) adopt 2D parallel, bidirectional, or combined parallel-diagonal snake scanning to enhance the modeling of spatial continuity, multi-directional context, and complex textures. While such strategies improve irregular structure perception, they rely on uniform, rule-based scanning for all images, limiting adaptability to highly complex and image-specific texture cues and topologies. This often results in discontinuities or blurred segmentation outputs. Moreover, even with uniform rules, generating repeated scanning sequences for each image introduces latency and reduces efficiency. Sigma ( Wan et al. 2025 ) , the first to introduce Mamba into multimodal segmentation, adopts an inefficient parallel scanning strategy without selective interaction or noise suppression during fusion, resulting in high computational cost and missed detections in high-frequency critical regions, as shown in Figure 1 (c). Additionally, existing Mamba-based methods stack many VSS blocks, increasing parameter count and computational overhead, which can lead to redundancy and feature degradation. Common convolutions with heavy parameters are used in feature processing and final segmentation, limiting the potential for deployment on resource-constrained devices. To address the above challenges, we propose the Lightweight Adaptive Cue-Aware Vision Mamba network (LIDAR), which efficiently captures morphological and textural crack cues across various modalities—including RGB images, infrared thermography, polarization informations, and light-field depth cues, while handling arbitrary input sizes with low computational cost. This enables the generation of high-quality crack segmentation maps across diverse scenarios. As shown in Figure 1 (a), LIDAR achieves the best performance while requiring the minimal computational resources. To make Mamba adaptable to complex modality-specific crack features, we design the Lightweight Adaptive Cue-Aware Visual State Space module (LacaVSS). It integrates the Efficient Dynamic Guided Scanning Strategy (EDG-SS) based on pre-scanned masks, which significantly accelerates the generation of scanning sequences. EDG-SS dynamically prioritizes crack regions based on image content, improving both the efficiency of