MixerCSeg: An Efficient Mixer Architecture for Crack Segmentation via Decoupled Mamba Attention
Zilong Zhao, Zhengming Ding, Pei Niu, Wenhao Sun, Feng Guo, [1ex] School of Qilu Transportation, Shandong University, China · 2026
Read MixerCSeg: An Efficient Mixer Architecture for Crack Segmentation via Decoupled Mamba Attention by Zilong Zhao, Zhengming Ding, Pei Niu, Wenhao Sun, Feng Guo, [1ex] School of Qilu Transportation, Shandong University, China (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-01361.txt.
Introduction
Zhao and four colleagues present MixerCSeg, a mixer for pixel-level crack cutting, built like a team of experts. CNN-like pathways focus on local grains, Transformer-style paths capture global links, and Mamba-like flows model stepwise context in one encoder. Its TransMixer probes Mamba's latent focus while building pathways showing both nearness and global reach. A spatial plan plus Direction-guided Edge Gated Conv sharpens edge sense for odd crack shapes with minimal cost.
Catalog record
| CREATOR | Zilong Zhao, Zhengming Ding, Pei Niu, Wenhao Sun, Feng Guo, [1ex] School of Qilu Transportation, Shandong University, China |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37244 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.01361
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MixerCSeg: An Efficient Mixer Architecture for Crack Segmentation via Decoupled Mamba Attention Zilong Zhao, Zhengming Ding, Pei Niu, Wenhao Sun, Feng Guo, [1ex] School of Qilu Transportation, Shandong University, China Abstract Feature encoders play a key role in pixel-level crack segmentation by shaping the representation of fine textures and thin structures. Existing CNN-, Transformer-, and Mamba-based models each capture only part of the required spatial or structural information, leaving clear gaps in modeling complex crack patterns. To address this, we present MixerCSeg, a mixer architecture designed like a coordinated team of specialists, where CNN-like pathways focus on local textures, Transformer-style paths capture global dependencies, and Mamba-inspired flows model sequential context within a single encoder. At the core of MixerCSeg is the TransMixer, which explores Mamba’s latent attention behavior while establishing dedicated pathways that naturally express both locality and global awareness. To further enhance structural fidelity, we introduce a spatial block processing strategy and a Direction-guided Edge Gated Convolution (DEGConv) that strengthens edge sensitivity under irregular crack geometries with minimal computational overhead. A Spatial Refinement Multi-Level Fusion (SRF) module is then employed to refine multi-scale details without increasing complexity. Extensive experiments on multiple crack segmentation benchmarks show that MixerCSeg achieves state-of-the-art performance with only 2.05 GFLOPs and 2.54 M parameters, demonstrating both efficiency and strong representational capability. The code is available at https://github.com/spiderforest/MixerCSeg . 1 Introduction As infrastructure such as roads and bridges ages and deteriorates over time, the issue of cracks has become increasingly prominent. As a key technology for monitoring and maintaining road health, road crack segmentation enables the timely detection of potential crack threats. However, achieving high-precision pixel-level crack segmentation remains a significant challenge due to the considerable morphological diversity, uneven texture distribution, and low contrast between cracks and their background 9 . To address this challenge, existing crack segmentation models are mainly based on three architectures: Convolutional Neural Networks (CNNs), Transformers 24 , and Mamba 6 . Figure 1 : Visualization results of heatmaps and attention maps in VMamba 18 . Benefiting from the multi-directional scanning mechanism, tokens in global channels can achieve a receptive field that covers the entire scope, rather than being limited to historical context. In contrast, local channels focus on the field of view of neighboring regions. Due to the strong capability in extracting local features and computational efficiency advantages, researchers have proposed various CNN-based crack segmentation models 23 ; 14 ; 20 . However, their limited receptive fields make it difficult to effectively model long-range pixel dependencies, resulting in suboptimal performance when dealing with cracks of complex morphology. Vision Transformer 5 ; 19 successfully introduced the Transformer architecture into the field of vision tasks. By leveraging attention mechanisms to explicitly model long-range dependencies between pixels, it has enabled crack segmentation models such as Crackmer 25 and DTrCNet 26 that outperform CNN-based approaches. However, this also results in increased computational complexity and reduced inference efficiency. In recent years, the Mamba 6 architecture has been introduced as a global attention mechanism with linear computational complexity. SCSegamba 16 has designed a Structure-Aware Scanning Strategy to enhance crack segmentation performance. Nevertheless, this progressive data processing mechanism limits its ability to capture and utilize global context in a single forward pass 12 . Recently, hybrid models with diverse architectures have been receiving increasing attention. MambaVision 12 adapts the Mamba structure and, for the first time, proposes a hybrid Mamba-Transformer architecture for visual tasks. VAMBA 22 , targeting long-video understanding, constructs a hybrid model by integrating self-attention, cross-attention, and Mamba modules. RestorMixer 7 improves upon Mamba and Self-Attention 24 by proposing a hybrid model that combines CNN, Transformer, and Mamba to enhance image restoration performance. Although these approaches demonstrate the potential for performance improvement, they simply stack these components in a sequential or parallel manner without thoroughly considering the inherent relationships and differences among the architectures. As a result, the full advantages of the diverse architectural designs are not fully leveraged 12 ; 7 . To address this challenge, we explored the potential attention mechanism of Mamba and proposed a novel hybrid architecture model called MixerCSeg for road crack segmentation. Specifically, we designed a Mixer architecture named TransMixer. It decouples tokens along the channel dimension into global tokens and local tokens based on the inherent attention characteristics of Mamba (as shown in Figure 1 ). For the global tokens, self-attention is introduced to further model long-range dependencies. For the local tokens, a Local Refinement Module is designed to enhance fine-grained feature details through convolutional operations. Additionally, to achieve pixel-level crack segmentation, we designed a Direction-guided Edge Gated Convolution (DEGConv). It employs spatial block processing and utilizes directional priors to enhance edge sensitivity under irregular crack geometries while minimizing computational overhead. Finally, the Spatial Refinement multi-level feature fusion (SRF) module provides global contextual guidance for low-resolution features through cross-scale semantic interactions, generating high-precision segmentation results without incurring additional computational overhead. In summary, our main contributions are as follows: • We introduce TransMixer, a newly designed feature encoding structure that assigns CNN, Transformer, and Mamba pathways distinct roles in capturing local textures, modeling global dependencies, and expressing contextual flow, forming a coordinated architecture rather than a stacked mixture of modules. • We develop MixerCSeg, a crack segmentation model built on this encoder. It incorporates DEGConv to enhance direction-aware edge modeling and SRF to refine multi-scale spatial details with minimal computational cost. • We conduct extensive experiments on multiple crack segmentation benchmarks and show that MixerCSeg achieves state-of-the-art performance with an efficient design of 2.05 GFLOPs and 2.54 M parameters. 2 Related Work 2.1 Road Crack Segmentation Current deep learning-based road crack segmentation methods can be primarily categorized into three types: CNN-based, Transformer-based, and Mamba-based approaches. Among CNN-based methods, DeepCrack 17 established a crack segmentation dataset and a benchmark segmentation model. SDDNet 4 employs separable convolutions to achieve efficient real-time crack segmentation. SFIAN 3 enhances segmentation accuracy by designing a selective fusion and irregularity-aware network. BARNet 10 introduces gradient priors and develops a crack segmentation model that integrates image features with gradient information. However, due to the limitations of CNNs in capturing global receptive fields, they struggle to effectively model long-range dependencies, which restricts further performance improvements in pixel-level crack segmentation. ViT 5 successfully introduced the attention 24 mechanism into visual tasks. Leveraging the advantage of attention mechanisms in long-range dependency modeling, STA 8 utilized Swin-Transformer 19 to extract slender crack features; Crackmer 25 designed a parallel segmentation architecture combining convolution and transformer to enhance the characterization of crack details; CrackFormer 15 proposed a scaling-attention block to suppress non-semantic features and sharpen semantic cracks. Despite these advancements, the quadratic computational complexity introduces new computational efficiency challenges. The Mamba 6 model, leveraging its advantage of linear computational complexity, has been successfully introduced into the visual domain by studies such as ViM 32 and VMamba 18 , providing new perspectives for road crack segmentation. MambaCrackNet 11 incorporates residual Mamba blocks to reduce background interference and improve the detection rate of fine cracks. CrackMamba 33 and SCSegamba 16 designed serpentine and structure-aware scanning strategies, respectively, enhancing the model’s ability to characterize complex crack features. Figure 2 : Overview of the proposed method. (a) illustrates the overall architecture of MixerCSeg. TransMixer blocks and downsampling operators