Adaptive and Robust Image Processing on CubeSats
Robert Bayer, Julian Priest, Daniel Kjellberg, Jeppe Lindhard, Nikolaj Sørenesen, Nicolaj Valsted, Ívar Óli, Pınar Tözün · 2025
Read Adaptive and Robust Image Processing on CubeSats by Robert Bayer, Julian Priest, Daniel Kjellberg, Jeppe Lindhard, Nikolaj Sørenesen, Nicolaj Valsted, Ívar Óli, Pınar Tözün (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-03152.txt.
Introduction
Robert Bayer and co-authors make image work on tiny satellites both flexible and sturdy, in work from 2025. CubeSats are cheap space platforms, but their lean hardware and remote perch cramp how photo pipelines can change after launch. The team built two systems to fix that.
One, DIPP, splits pipelines into swap-ready modules that can update with slim data cost and shrug off bad uploads. The other, DISH, is a small language and runner that schedules photo jobs on weak chips. Tests showed the split design adds near no overhead. DISH matched a known scripting tongue in range while using less memory.
Catalog record
| CREATOR | Robert Bayer, Julian Priest, Daniel Kjellberg, Jeppe Lindhard, Nikolaj Sørenesen, Nicolaj Valsted, Ívar Óli, Pınar Tözün |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-03152
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adaptive and Robust Image Processing on CubeSats Robert Bayer, Julian Priest, Daniel Kjellberg, Jeppe Lindhard, Nikolaj Sørenesen, Nicolaj Valsted, Ívar Óli, Pınar Tözün Abstract . CubeSats offer a low-cost platform for space research, particularly for Earth observation. However, their resource-constrained nature and being in space, challenge the flexibility and complexity of the deployed image processing pipelines and their orchestration. This paper introduces two novel systems, DIPP and DISH , to address these challenges. DIPP is a modular and configurable image processing pipeline framework that allows for adaptability to changing mission goals even after deployment, while preserving robustness. DISH is a domain-specific language (DSL) and runtime system designed to schedule complex imaging workloads on low-power and memory-constrained processors. Our experiments demonstrate that DIPP ’s decomposition of the processing pipelines adds negligible overhead, while significantly reducing the network requirements of updating pipelines and being robust against erroneous module uploads. Furthermore, we compare DISH to Lua, a general purpose scripting language, and demonstrate its comparable expressiveness and lower memory requirement. 1. Introduction Nanosatellites, especially CubeSats ( Dideriksen et al. 2024 ; Laizans et al. 2014 ; Kozaris et al. 2023 ; Geeroms et al. 2015 ) , have democratized access to space, enabling more organizations to participate in space-related research, such as Earth observation ( Aksoy et al. 2022 ; Denby and Lucia 2020 ; Cheng et al. 2024 ) . However, the limited resources of CubeSats present challenges for applications deployed on CubeSats. First, the limited network bandwidth necessitates more on board data processing, while bounding the updatability of the deployed programs, to reduce the downlink and uplink network traffic, respectively. Second, the limited memory restricts the complex orchestration of these programs. Flexibility. Existing image processing pipelines deployed on CubeSats are often inflexible, relying on fixed predefined processing stages that cannot be easily modified once the satellite is in orbit ( Kozaris et al. 2023 ) . This inflexibility is problematic for missions where scientific goals or customer requirements change frequently, requiring changes to the image processing pipelines. The constrained and often asymmetrical network bandwidth typical of CubeSats further amplify this challenge, making uploading new pipeline binaries a significant bottleneck. The rising demand for offloading machine learning to satellites, leads to even higher pressure on the uplink due to more frequent updates to models. Despite these limitations and challenges, integrating machine learning on CubeSats is essential for enabling new use cases, such as onboard event detection and image filtering. Performing these tasks on board can lead to a more efficient use of the limited bandwidth, downlinking only the most relevant data ( Denby et al. 2023 ) . Robustness. The main reason behind the conventional approach of inflexible pipelines on satellites is avoiding mishaps due to frequent updates. CubeSats are often utilized as test platforms for new technologies due to their low deployment costs. This approach allows for experimentation with novel technologies where mission failure poses a lower risk. Nonetheless, robustness and fault-tolerance are of utmost importance for all deployments, where physical intervention is impossible ( Narayana et al. 2021 ) . Orchestration. Emerging Earth observation applications also require complex and flexible task orchestration. However, existing approaches often lack a memory and bandwidth efficient way of providing expressiveness and adaptivity required for missions involving dependencies between observations, geofencing, or precise attitude control, such as those required for photogrammetry. To address the challenges of image processing on CubeSats, this paper presents DIPP and DISH . DIPP ( DISCO Image Processing Pipeline) is a modular and configurable approach to image processing pipelines that allows adaptability to changing mission goals, while preserving the robustness of the system. DISH (DIsco ScHeduler) is a DSL and runtime for Earth observation, enabling users to schedule complex workloads and subsequent processing of the imagery, while running on low-power real-time processors with limited memory. More specifically, the contributions of the paper are: DIPP : Modular, reconfigurable, and fault-tolerant image processing framework for CubeSats. Section 3 introduces a new framework for image processing that decomposes the execution of image processing pipelines into modules , which can be added, reordered, replaced, or removed with a set of parameters specific to the pipeline, while allowing module reuse across pipelines. We evaluate DIPP using a representative image processing pipeline, composed of preprocessing, deep learning inference, and postprocessing modules. The results demonstrate that DIPP adds negligible overhead to end-to-end pipeline execution, while almost halving the data to be uplinked if one wants to update functionality over time. Furthermore, any errors or failures that occur within a module are contained in the module. DISH : Expressive DSL and runtime for complex observation scheduling on CubeSats. Section 4 introduces a new DSL and runtime system. The DSL combines the low resource requirements of event-driven programming and the expressiveness of general-purpose scripting. The runtime polls the configuration and telemetry of other components in the satellite, such as the battery level and power generation, for power-aware scheduling and orchestration of flight plans. We illustrate that DISH brings the expressiveness of a general-purpose scripting language, such as Lua, onto a hardware platform suitable for CubeSats, despite Lua being unable to fit on such memory-constrained platforms. The rest of this paper is organized as follows. Section 2 presents the educational satellite that this work targets and the related work. Section 5 evaluates the performance of DIPP and DISH , while Section 6 discusses trade-offs of their design choices and the future work directions. Finally, Section 7 concludes the paper. 2. Background To better illustrate the target satellite use case for this work, Section 2.1 introduces the DISCO project. Then, Section 2.2 surveys related work, with a focus on in-orbit processing and observation scheduling. 2.1. DISCO -2 Goal & Requirements. DISCO is an educational satellite program, where students are given the opportunity to design and operate CubeSats, a class of nanosatellites with a form factor of 10cm cubes per unit and the possibility to stack multiple units to create a larger satellite. It is a collaboration between three universities and the Polar Research Organization. DISCO -2 is the second satellite to be launched in the project. It is a 3U CubeSat carrying an Earth observation payload , including two RGB and a single IR (infrared) camera. Besides capturing images, the payload will perform in-orbit image analysis to increase the value of the downlinked data. While the payload will initially be tasked with a simple cloud cover detection, the long-term goal is to provide a platform for research, such as photogrammetry of glaciers in the Arctic. Because of DISCO -2’s asymmetrical bandwidth, achieving 1mbit/s downlink and 9.6kbit/s uplink, it is crucial to utilize the bandwidth efficiently. This constraint and the need to support frequently changing workloads, require a reconfigurable image processing pipeline. Furthermore, while all the tasks submitted for deployment on the satellite will be thoroughly tested for errors on the satellite’s replica on Earth, the image processing pipeline needs to be highly fault-tolerant against errors not caught during the tests. Earth observation tasks also need complex orchestration, such as attitude control or precise timing. To enable deployment of such tasks, we need a way to express their logic in a compact way that can run on a memory-limited core. Figure 1 .