A Case Study on Energy-Efficient Edge AI Crack Segmentation

Matthias Tschöpe *,1 , Mohamed Moursi *,2 , Vladimir Rybalkin *,2 , Bo Zhou 1 , Norbert Wehn 2 , Paul Lukowicz 1 · 2026

Read A Case Study on Energy-Efficient Edge AI Crack Segmentation by Matthias Tschöpe *,1 , Mohamed Moursi *,2 , Vladimir Rybalkin *,2 , Bo Zhou 1 , Norbert Wehn 2 , Paul Lukowicz 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13933.txt.

Introduction

Tschope and colleagues study crack segmentation on low-power edge devices for infrastructure inspection, where drones can replace risky human entry. Knowledge distillation first strengthens compact U-Net models, then post-training quantization shrinks them further, and a custom FPGA design maximizes energy efficiency. The FPGA version runs 398 frames per second at a mean IoU of 69.42 percent, while the best model reaches about 72 percent, nearly 9 points above the prior result.

Catalog record

CREATORMatthias Tschöpe *,1 , Mohamed Moursi *,2 , Vladimir Rybalkin *,2 , Bo Zhou 1 , Norbert Wehn 2 , Paul Lukowicz 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37213
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.13933

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Case Study on Energy-Efficient Edge AI Crack Segmentation Thanks: The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This work was supported by the European Union’s Horizon Europe research and innovation programme (HORIZON-CL4-2021-HUMAN-01) in the project SustainML (101070408). * These authors contributed equally to this work. Matthias Tschöpe *,1 , Mohamed Moursi *,2 , Vladimir Rybalkin *,2 , Bo Zhou 1 , Norbert Wehn 2 , Paul Lukowicz 1 Abstract Crack segmentation on edge devices can support continuous infrastructure monitoring and maintenance and thereby help to preserve public safety. Furthermore, autonomous infrastructure monitoring by using Unmanned Aerial Vehicles (UAVs) can reduce inspection risks, as human operators no longer need to enter hazardous areas. Edge processing reduces the cost of inspection by eliminating the need for high resolution image storage for offline processing and mitigates the security risks and bandwidth requirements of streaming to cloud servers. Edge inference is difficult due to the limited memory and computational capabilities of edge devices, which can affect both accuracy and latency. Furthermore, battery-powered devices are subject to strict power and energy constraints. Together, these limitations impose restrictions on the model size and computational complexity that can be deployed close to the sensor. In recent years, Transformers have achieved state-of-the-art accuracy in a variety of applications, including semantic segmentation. However, Transformer-based models are typically large and computationally intensive, making efficient edge deployment difficult. To address this, we first apply knowledge distillation to enhance the performance of the base models. We then use Post-Training Quantization (PTQ) to compress the models further. Additionally, we consider the deployment of these models across multiple edge platforms. To maximize energy efficiency, we design and implement a custom hardware architecture for the models on an FPGA. Our results show that Knowledge Distillation (KD) improves all tested U-Net variants. Among the evaluated platforms, the selected FPGA implementation achieves 398 398 Frames Per Second (FPS) at 204.99 204.99 Frames/J while maintaining a mean Intersection over Union (IoU) of 69.42 % 69.42\% . In addition, our best model reaches 71.92 % 71.92\% mean IoU , which is 8.82 8.82 percentage points (pps) higher than the previously reported result on the CrackVision12K dataset. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. I Introduction Inspection and maintenance of civil infrastructure, such as bridges, tunnels, and high-rise buildings, are essential to ensure long-term safety and reliability. Traditional inspection methods are largely manual, requiring human experts to access potentially dangerous locations to visually assess structural damage. With the emergence of UAVs , automated large-scale inspection of concrete and asphalt surfaces has become feasible, offering both safety and efficiency advantages. UAV -based inspection systems equipped with onboard computer vision can identify cracks and other forms of surface degradation without exposing human inspectors to hazardous environments. The main challenge for onboard crack segmentation is the need to operate on resource-constrained edge devices with limited power, memory, and computational capacity, while still enabling real-time processing. Although Transformer-based models achieve state-of-the-art segmentation performance, their computational and memory demands hinder practical edge deployment. Consequently, lightweight architectures such as U-Net remain more suitable. Despite their simpler design, U-Net variants exhibit substantial variability in parameter count and computational cost, and still require optimization for efficient edge execution. Identifying models that balance segmentation accuracy and efficiency is therefore critical for real-world edge crack segmentation. Efficient deployment of crack segmentation models on edge devices is governed by strict constraints on latency, power consumption, and energy efficiency, particularly under small batch sizes dictated by the number of input sensors (e.g., cameras). In this work, we investigate implementation across heterogeneous edge platforms, including CPUs, GPUs, and Neural Processing Units (NPUs) , each offering distinct trade-offs. GPUs provide high throughput, especially for large batch sizes, but typically incur higher power consumption and are less efficient in small-batch regimes. CPUs offer greater flexibility and broader operator support, yet often fall short in terms of parallel efficiency. NPUs , while promising superior energy efficiency, are constrained by limited support for operators and model architectures, complicating deployment. These disparities make platform selection, numerical precision, and runtime configuration non-trivial design choices. Collectively, these limitations highlight the need for custom Field-Programmable Gate Array (FPGA) -based architectures to achieve superior energy efficiency and mitigate platform-specific constraints. Our contributions are as follows: • We perform a comprehensive design space exploration across multiple levels, from model-level design to hardware platforms, providing a comparative analysis of segmentation results, latency, power consumption, and energy efficiency for crack segmentation on several edge platforms. • We design and implement U-Net variants spanning three orders of magnitude in parameter count to study the trade-off between segmentation performance and efficiency. Knowledge distillation from a Transformer model is applied to enhance the smaller U-Net variants. The resulting Pareto-optimal model is 63.63\times smaller, and 6.32 pps better, compared to the currently best tested Hybrid-Segmentor model from Goo et al [ 11 ] . • To further improve energy efficiency and throughput for single-batch processing, we develop a custom hardware architecture and implement it on an FPGA. • The Pareto-optimal FPGA implementation outperforms alternative embedded platforms, achieving the highest energy efficiency (204.99 Frames/J) and throughput (398 FPS) while still improving the segmentation accuracy by 2.79 pps compared to the baseline U-Net without KD . II Related Work II-A Crack Segmentation Approaches Early methods of crack segmentation are often based on graph-based approaches such as the use of shortest path algorithms, as in [ 12 ] , or the use of minimum spanning trees (MST), as in [ 35 ] . The advantages of these algorithms lie in their efficient implementation and explainability. However, since the introduction of UNet [ 25 ] , deep learning models recognize cracks much better. Due to its efficient encoder-decoder structure, skip connections, UNet has become particularly popular for crack segmentation, especially for real-time applications. As a result, there are now many deep learning approaches that build on this and propose new, improved models or training procedures [ 6 , 20 , 14 , 19 , 29 , 18 ] . UNet++ was introduced in 2019 [ 34 ] . In 2023, an improved UNet incorporating an attention mechanism was proposed [ 1 ] . However, most of these variants require increased computational resources and are therefore unsuitable for edge or embedded platforms. One of the most advanced real-time capable models is UNext [ 2 ] . However, its reliance on attention mechanisms introduces architectural complexity that currently hinders edge deployments. II-B Semantic Segmentation on Embedded Platforms In recent years, embedded platforms have gained significant traction for crack segmentation. Some authors propose specifically designed segmentation models for embedded platforms. For example, [ 3 ] presents MCFF-L Net - an architecture with 1.18 million parameters - combined with knowledge distillation, which achieves good segmentation results and is able to run in real-time on a Jetson Xavier NX. Similarly, [ 33 ] considered crack segmentation on devices for structural health monitoring. A related approach by [ 32 ] uses a special KD approach for measurement tasks on embedded systems. Other works focus on simplifying UNet for microcontroller-class hardware,

Read the complete text