KARMA: Efficient Structural Defect Segmentation via Kolmogorov-Arnold Representation Learning
Md Meftahul Ferdaus, Mahdi Abdelguerfi, Elias Ioup, Steven Sloan, Kendall N. Niles, and Ken Pathak · 2025
Read KARMA: Efficient Structural Defect Segmentation via Kolmogorov-Arnold Representation Learning by Md Meftahul Ferdaus, Mahdi Abdelguerfi, Elias Ioup, Steven Sloan, Kendall N. Niles, and Ken Pathak (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08186.txt.
Introduction
Md Meftahul Ferdaus and co-authors present KARMA, a lean image model for finding defects in bridges and other structures, in a 2025 paper. Cracks and flaws vary in look, photos are often harsh, and defect pixels are rare next to sound ones. Large models that handle this well are too heavy for live inspection gear.
KARMA builds features from one-dimensional functions rather than standard filters, using a compact module design. A pyramid layout checks defects at several scales, and a prototype step helps with rare defect classes. On benchmark sets, KARMA matched or beat bigger models while using about ninety-seven percent fewer parameters. Its low computing cost suits real-time use in the field.
Catalog record
| CREATOR | Md Meftahul Ferdaus, Mahdi Abdelguerfi, Elias Ioup, Steven Sloan, Kendall N. Niles, and Ken Pathak |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-08186
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
KARMA: Efficient Structural Defect Segmentation via Kolmogorov-Arnold Representation Learning Md Meftahul Ferdaus, Mahdi Abdelguerfi, Elias Ioup, Steven Sloan, Kendall N. Niles, and Ken Pathak Abstract Semantic segmentation of structural defects in civil infrastructure remains challenging due to variable defect appearances, harsh imaging conditions, and significant class imbalance. Current deep learning methods, despite their effectiveness, typically require millions of parameters, rendering them impractical for real-time inspection systems. We introduce KARMA (Kolmogorov-Arnold Representation Mapping Architecture), a highly efficient semantic segmentation framework that models complex defect patterns through compositions of one-dimensional functions rather than conventional convolutions. KARMA features three technical innovations: (1) a parameter-efficient Tiny Kolmogorov-Arnold Network (TiKAN) module leveraging low-rank factorization for KAN-based feature transformation; (2) an optimized feature pyramid structure with separable convolutions for multi-scale defect analysis; and (3) a static-dynamic prototype mechanism that enhances feature representation for imbalanced classes. Extensive experiments on benchmark infrastructure inspection datasets demonstrate that KARMA achieves competitive or superior mean IoU performance compared to state-of-the-art approaches, while using significantly fewer parameters (0.959M vs. 31.04M, a 97% reduction). Operating at 0.264 GFLOPS, KARMA maintains inference speeds suitable for real-time deployment, enabling practical automated infrastructure inspection systems without compromising accuracy. The source code can be accessed at the following URL: https://github.com/faeyelab/karma . I Introduction Automated detection of structural defects in civil infrastructure is essential for public safety and efficient maintenance [ 1 , 2 ] . The aging global infrastructure makes accurate segmentation of defects such as cracks, fractures, and deformations increasingly critical [ 3 , 4 ] . Traditional methods relying on manual video inspection are labor intensive, slow, and error-prone [ 5 ] . In municipal sewer and culvert systems, missed defects can lead to catastrophic failures, compromising urban safety and water management. Although semantic segmentation methods offer pixel-level defect localization, existing approaches often struggle to balance accuracy with computational efficiency [ 3 , 5 ] . The accurate segmentation of structural defects presents several challenges [ 6 , 7 ] . Defects vary widely in size, shape, and appearance, occurring under various environmental conditions [ 8 , 9 ] . Inspection imagery often suffers from poor lighting, debris obstructions, and inconsistent camera viewpoints [ 5 ] . Furthermore, there is a class imbalance, as rare defects such as holes or collapses occur far less frequently than common problems such as surface cracks [ 10 ] . Thus, robust and computationally efficient semantic segmentation methods are required for reliable performance in practical scenarios [ 6 , 10 ] . Deep learning approaches, particularly Fully Convolutional Networks (FCNs) [ 11 ] and U-Net-based models [ 12 , 13 ] , have significantly improved segmentation performance through pixel-level predictions and innovations such as skip connections and feature pyramid modules. However, these models frequently involve millions of parameters, which limits deployment in resource-constrained settings such as inspection robots or real-time monitoring systems [ 14 ] . Therefore, there is a clear need for segmentation architectures that achieve high accuracy while remaining computationally efficient. Kolmogorov–Arnold representation learning offers a promising solution to these challenges [ 15 , 16 , 17 ] . According to the Kolmogorov–Arnold theorem, any continuous multivariate function can be represented by compositions of one-dimensional functions, enabling compact and efficient neural network designs known as Kolmogorov-Arnold Networks (KANs) [ 18 , 19 , 20 ] . Recent applications of KAN in medical image segmentation achieved state-of-the-art results [ 21 ] , highlighting their potential for structural defect segmentation. We propose KARMA (Kolmogorov-Arnold Representation Mapping Architecture), a highly efficient semantic segmentation framework for structural defect detection. KARMA combines Kolmogorov-Arnold Networks (KANs) and Feature Pyramid Networks (FPNs) [ 22 ] in a novel way to tackle efficient segmentation challenges. Lightweight TiKAN modules within an adaptive FPN (AFPN) backbone use low-rank factorization for parameter efficiency and real-time speeds without losing accuracy. This tailored architecture meets specific problem needs, optimizing efficiency-performance trade-offs and outperforming current methods, as shown by extensive experimental results. Our main contributions include: • A novel semantic segmentation architecture, KARMA, which uniquely integrates Kolmogorov-Arnold representation learning (specifically, parameter-efficient TiKAN modules) within an optimized encoder-decoder framework, representing the first problem-driven architectural synthesis of KAN-based methods for efficient structural defect segmentation. • Comprehensive empirical validation demonstrating competitive or superior performance compared to existing segmentation models, achieving state-of-the-art mean Intersection over Union (IoU) with significantly reduced parameters (up to 97% fewer) on challenging culvert and sewer defect datasets (CSDD) and S2DS. • An efficient inference pipeline suitable for practical deployment, accompanied by detailed analysis of speed-accuracy trade-offs and memory requirements for edge devices. The remainder of this paper is structured as follows: Section II reviews related work in semantic segmentation architectures, structural defect detection, and Kolmogorov-Arnold networks. Section III details the theoretical background and architectural components of KARMA. Section IV outlines the experimental methodology and evaluation metrics. Section V presents results and comparative analysis. Section VI discusses broader implications and future research opportunities, concluding with final remarks in Section VII. II Related Work II-A Semantic Segmentation Architectures Semantic segmentation has evolved significantly through innovations such as FCNs [ 11 ] , enabling pixel-level predictions via end-to-end learning. U-Net [ 12 ] introduced an encoder-decoder architecture with skip connections, which enhances spatial and semantic information integration, notably in biomedical segmentation. Extensions such as UNet++ [ 23 ] and UNet 3+ [ 24 ] provided nested and dense skip connections, respectively, further improving multi-scale feature fusion. FPN [ 22 ] introduced top-down pathways, widely adopted for segmentation tasks, while BiFPN [ 25 ] incorporated bidirectional connections and learned feature weighting for improved efficiency. Recent architectures, including EGE-UNet [ 26 ] and SA-UNet [ 27 ] , use edge guidance and attention mechanisms to improve boundary accuracy with fewer parameters. Transformer-based approaches like Swin-UNet [ 28 ] and Segformer [ 29 ] use attention mechanisms to capture global dependencies efficiently. Lightweight models such as Rolling UNet [ 30 ] and MobileUNETR [ 31 ] exemplify high accuracy combined with reduced computational demands, aligning with the efficiency objectives of KARMA. II-B Structural Defect Segmentation Recent developments in structural defect segmentation have shifted from classification and object detection techniques towards precise pixel-level segmentation methods [ 6 , 32 ] . Improved architectures based on U-Net have significantly enhanced accuracy in clearly defining defect shapes [ 5 ] . To overcome issues such as class imbalance, methods like Sewer-ML and enhanced FPN (E-FPN) emphasize multi-scale defect representation and customized loss functions [ 33 , 34 ] . Leading-edge approaches integrate Haar-like features and optimized pyramid structures to achieve high segmentation accuracy [ 35 ] . Recent optimization strategies, including focal loss, class-weighted methods, and boundary-aware loss functions, further improve segmentation performance, particularly for uncommon defect classes. Current research trends prioritize achieving both accuracy and computational efficiency by employing pyramid structures and attention mechanisms suitable for real-time applications [ 6 , 32 ] . II-C Kolmogorov-Arnold Networks and Representation Learning Kolmogorov-Arnold Network (KAN) [ 18 ] , inspired by the Kolmogorov-Arnold representation theorem, provides compact, but powerful representations by decomposing complex functions into compositions of one-dimensional functions. Recent applications of KANs in medical imaging and defect detection highlight their potential to achieve high accuracy [ 21 ] . Hybrid architectures such as HKAN [ 36 ] integrate CNNs