Nano-U: Efficient Terrain Segmentation for Tiny Robot Navigation
Federico Pizzolato, Francesco Pasti, Nicola Bellotto · 2026
Read Nano-U: Efficient Terrain Segmentation for Tiny Robot Navigation by Federico Pizzolato, Francesco Pasti, Nicola Bellotto (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10210.txt.
Introduction
Pizzolato, Pasti and Bellotto build a framework for binary terrain segmentation on a low-cost microcontroller, a capability tiny outdoor robots need but state-of-the-art models cannot fit. Memory and compute limits on microcontrollers block deployment on small platforms. At the core sits Nano-U, a highly compact segmentation network with only a few thousand parameters.
To offset minimal capacity, Nano-U trains via Quantization-Aware Distillation, combining distillation with quantization-aware training. The quantised model performs excellently on the Botanic Garden data set and very well on TinyAgri, a custom field set with harder scenes. Deployed on a commodity microcontroller via extended MicroFlow, a Rust compiler-based inference engine for TinyML, the model runs on an ESP32-S3 with minimal memory footprint and low latency. It eliminates interpreter overhead and dynamic memory allocation. The result is a viable, energy-efficient perception route for low-cost robots.
Catalog record
| CREATOR | Federico Pizzolato, Francesco Pasti, Nicola Bellotto |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10210
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Nano-U: Efficient Terrain Segmentation for Tiny Robot Navigation Federico Pizzolato, Francesco Pasti, Nicola Bellotto Abstract Terrain segmentation is a fundamental capability for autonomous mobile robots operating in unstructured outdoor environments. However, state-of-the-art models are incompatible with the memory and compute constraints typical of microcontrollers, limiting scalable deployment in small robotics platforms. To address this gap, we develop a complete framework for robust binary terrain segmentation on a low-cost microcontroller. At the core of our approach we design Nano-U , a highly compact binary segmentation network with a few thousand parameters. To compensate for the network’s minimal capacity, we train Nano-U via Quantization-Aware Distillation (QAD), combining knowledge distillation and quantization-aware training. This allows the final quantized model to achieve excellent results on the Botanic Garden dataset and to perform very well on TinyAgri, a custom agricultural field dataset with more challenging scenes. We deploy the quantized Nano-U on a commodity microcontroller by extending MicroFlow, a compiler-based inference engine for TinyML implemented in Rust. By eliminating interpreter overhead and dynamic memory allocation, the quantized model executes on an ESP32-S3 with a minimal memory footprint and low latency. This compiler-based execution demonstrates a viable and energy-efficient solution for perception on low-cost robotic platforms. I INTRODUCTION Terrain segmentation is a fundamental perception capability for autonomous mobile robots operating in unstructured outdoor environments such as agricultural fields and natural trails [ 1 , 2 ] . Unlike structured road scenarios, traversability estimation in these settings is challenging due to dense vegetation, uneven ground, and strong lighting variation. While deep learning has become the standard for robust segmentation, state-of-the-art models are impractical for tiny robotic platforms subject to strict kilobyte memory budgets and milliwatt power constraints [ 3 ] . Adapting these computationally heavy models to run on low-power microcontrollers (MCUs) is a fundamental challenge for the scalable deployment of small and inexpensive mobile robots. Existing Tiny Machine Learning (TinyML) solutions typically target simpler classification tasks or rely on dedicated ML accelerators [ 4 ] . In this work instead, we use a commodity, general purpose microcontroller board ESP32-S3-CAM, proposing a framework for robust terrain segmentation on non-specialized, widely accessible platforms costing as little as $10. To this end, our main contributions are as follows: Fig. 1: The Nano-U segmentation model identifies traversable terrains (Right). It executes entirely on an ESP32-S3 microcontroller via the Rust-based MicroFlow engine, demonstrating feasibility for the tight memory and compute resources of a small mobile robot (Left). • We design Nano-U, a small (33 KB with integer INT8 precision) binary segmentation network inspired by the popular U-Net architecture. To fit within strict memory limits, we deliberately omit some standard connections and overcome accuracy losses by training Nano-U via adapting Quantization-Aware Distillation (QAD) [ 5 , 6 ] . This single-pass regime fuses knowledge distillation from a full-scale teacher with INT8 fake-quantization, enabling the network to learn robust representations despite its extreme parameter constraints. • We deploy Nano-U by extending MicroFlow [ 7 ] , a compiler-based Rust inference engine for TinyML. By resolving the network topology at compile time, we completely bypass interpreter overhead and dynamic memory allocations during inference. Furthermore, this bare-metal approach eliminates unnecessary peripheral initializations, maximizing available internal RAM and strictly bounding energy consumption. We evaluate Nano-U on Botanic Garden [ 2 ] , a comprehensive dataset for outdoor robot navigation, and on TinyAgri, a custom and challenging terrain-segmentation dataset collected via the onboard camera of a small rover (Fig. 1 ). We publicly release Nano-U and the TinyAgri dataset to support further research in edge robotics applications 1 1 1 https://github.com/federico-pizz/Nano-U . To validate our framework’s efficiency, we also conduct hardware profiling directly on the ESP32-S3-CAM during Nano-U inference, revealing low RAM utilization, energy consumption, and processing latency. The remainder of the paper is organized as follows: Sec. II reviews related work; Sec. III describes Nano-U and the optimisation pipeline; Sec. IV details the experimental setup; Sec. V presents the results of the segmentation and hardware performance; Sec. VI summarises the main achievements and suggests opportunities for future research. II RELATED WORK II-A Terrain Segmentation in Robotics Before the widespread adoption of deep learning (DL), traversable terrain was commonly identified through hand-crafted appearance models, such as self-supervised color statistics propagated from a seed region ahead of the robot [ 8 ] . Early DL approaches instead replaced the classification head of standard CNNs with convolutional layers to enable dense per-pixel prediction [ 9 ] . Subsequent encoder-decoder architectures such as SegNet [ 10 ] and U-Net [ 11 ] recovered spatial detail lost during downsampling via skip connections. DeepLabV3 and its extension [ 12 , 13 ] instead captured multi-scale context through Atrous Spatial Pyramid Pooling (ASPP), coupling it with a lightweight decoder to recover sharp object boundaries. However, all the above models assume GPU-based inference, with sizes ranging from tens to hundreds of millions of parameters. While these architectures have been successfully applied to terrain segmentation in agricultural robotics [ 14 , 15 ] , their substantial resource requirements make them incompatible with the constraints of small robots [ 3 ] . To satisfy the strict memory constraints of commodity MCUs, we depart from this multi-class paradigm and focus on binary traversability estimation, a simplified formulation that remains fully sufficient for autonomous path planning [ 1 ] . II-B Efficient Neural Networks Deploying neural networks on constrained hardware has driven research into architectures and training methods that reduce model size without significant accuracy loss. At the architectural level, traditional works scale down model parameters and computational overhead by decreasing network depth and scaling channel width multipliers. This is often done via techniques such as Neural Architecture Search [ 16 ] , which automates the exploration of architecture configurations within specified hardware budgets. Beyond it, optimizing the fundamental computational blocks is critical for on-device efficiency [ 17 , 18 ] . However, scaling down an architecture, limits its representational capacity. Knowledge distillation [ 19 ] mitigates this by transferring the generalization capability of a large teacher network into a compact student by matching soft output distributions rather than hard ground-truth labels. Temperature scaling flattens the teacher’s output, exposing gradient signal on ambiguous boundary pixels that a binary label would suppress. Finally, neural networks are typically quantized to INT8 precision to be executed more efficiently on MCU-based embedded systems. However, this introduces a significant accuracy degradation when high-precision floating-points FP32 weights are mapped to INT8 after training. Quantization-Aware Training (QAT) [ 20 ] addresses this, by injecting fake-quantisation nodes that simulate 8-bit rounding in the forward pass while preserving full-precision gradients via the straight-through estimator. This is essential for small networks, where the representational margin is too narrow to absorb the perturbation of post-training quantisation without significant accuracy loss [ 21 ] . While traditional approaches apply QAT as a separate fine-tuning stage, recent works explore unified paradigms. Quantization-Aware Knowledge Distillation (QKD) coordinates these objectives to preserve accuracy in low-bitwidth models [ 22 ] , and collaborative multi-teacher frameworks have been proposed to further guide the learning of ultra-low bit-width networks [ 23 ] . Building on these concepts, we fuse QAT with Knowledge Distillation from the first epoch of Nano-U training, a design choice detailed in Section