Evaluating Four FPGA-accelerated Space Use Cases based on Neural Network Algorithms for On-board Inference

1 st Pedro Antunes, 2 nd Muhammad Ihsan Al Hafiz, 3 rd Jonah Ekelund, 4 th Ekaterina Dineva, 5 th George Miloshevich, 6 th Panagiotis Gonidakis, 7 th Artur Podobas · 2026

Read Evaluating Four FPGA-accelerated Space Use Cases based on Neural Network Algorithms for On-board Inference by 1 st Pedro Antunes, 2 nd Muhammad Ihsan Al Hafiz, 3 rd Jonah Ekelund, 4 th Ekaterina Dineva, 5 th George Miloshevich, 6 th Panagiotis Gonidakis, 7 th Artur Podobas (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14091.txt.

Introduction

Antunes and co-authors test FPGA acceleration of neural networks for four space mission tasks on an AMD ZCU104 board. Spacecraft sensors now gather more data than onboard storage and downlinks can handle. Two tool flows are compared: Vitis AI on the built-in DPU and custom Vitis HLS designs. Vitis AI runs up to about 34 times faster than the embedded ARM CPU, and custom designs reach about five-fold gains with wider operator support. Power per inference drops in all four cases.

Catalog record

CREATOR1 st Pedro Antunes, 2 nd Muhammad Ihsan Al Hafiz, 3 rd Jonah Ekelund, 4 th Ekaterina Dineva, 5 th George Miloshevich, 6 th Panagiotis Gonidakis, 7 th Artur Podobas
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32059
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.14091

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evaluating Four FPGA-accelerated Space Use Cases based on Neural Network Algorithms for On-board Inference 1 st Pedro Antunes, 2 nd Muhammad Ihsan Al Hafiz, 3 rd Jonah Ekelund, 4 th Ekaterina Dineva, 5 th George Miloshevich, 6 th Panagiotis Gonidakis, 7 th Artur Podobas Abstract Space missions increasingly deploy high-fidelity sensors that produce data volumes exceeding onboard buffering and downlink capacity. This work evaluates FPGA acceleration of neural networks (NNs) across four space use cases on the AMD ZCU104 board. We use Vitis AI (AMD DPU) and Vitis HLS to implement inference, quantify throughput and energy, and expose toolchain and architectural constraints relevant to deployment. Vitis AI achieves up to 34.16 × \times higher inference rate than the embedded ARM CPU baseline, while custom HLS designs reach up to 5.4 × \times speedup and add support for operators (e.g., sigmoids, 3D layers) absent in the DPU. For these implementations, measured MPSoC inference power spans 1.5-6.75 W, reducing energy per inference versus CPU execution in all use cases. These results show that NN FPGA acceleration can enable onboard filtering, compression, and event detection, easing downlink pressure in future missions. I Introduction Future space research missions, in both near-Earth and deep-space regimes, will leverage artificial intelligence (AI) and high-performance computing (HPC) hardware [ 23 ] to perform in situ analysis of the large data volumes produced by on-board high-fidelity sensors. Processing data on the spacecraft enables transmission of only distilled results over bandwidth-constrained links to Earth [ 14 ] . However, modern Neural Networks (NNs) are compute-intensive and often exceed the performance or energy envelopes of radiation-hardened general-purpose processors (CPUs) [ 16 ] . This gap is sharper in space, where platforms face strict power, thermal, and radiation constraints. Although radiation-hardened CPUs are common, they lack the efficiency needed for sustained NN inference. Reprogrammable logic in radiation-hardened Field-Programmable Gate Arrays (FPGAs) allows the instantiation of specialized accelerators matched to these workloads. A recent survey [ 5 ] underscores the advantages of this hardware for space-borne NN deployment. This work implements and accelerates NN algorithms on FPGAs across four distinct space-mission use cases using two complementary toolchains: Vitis AI [ 4 ] with the AMD Deep Learning Processor Unit (DPU) [ 2 ] , and Vitis High-Level Synthesis (HLS) [ 3 ] . We lower energy per inference ( E=P\times t ) by (i) reducing execution time through architectural parallelism and (ii) constraining power via smaller resource footprints and selective on-chip weight residency. These characteristics define the design space tradeoff explored in the remainder of the paper. Our main contributions are: 1. FPGA accelerators for four previously unaccelerated neural-network workloads relevant to upcoming missions. These NNs include two in-situ and two remote sensing applications: • VAE Encoder - Probabilistic convolutional encoder for solar vector-magnetogram (SHARP) tiles (e.g., 128 \times 256 inputs) compressing to a 6-element latent vector (1:16,384 ratio). • CNetPlusScalar [ 18 ] - CNN plus scalar-context regressor ingesting multi-modal solar imagery (HMI + AIA 193 Å) and recent background flux to forecast future soft X-ray flux. • ESPERTA / multi-ESPERTA [ 1 ] - Six parallel lightweight models for early Solar Energetic Particle (SEP) event prediction. • MMS Neural Networks (BaselineNet, ReducedNet, LogisticNet) [ 11 ] - 3D convolution plus fully connected architectures processing 32 \times 16 \times 32 ion energy distributions (FPI instrument) to classify dayside plasma regions (SW, IF, MSH, MSP). 2. Empirical quantification of latency, throughput, FPGA resource utilization, and energy per inference versus CPU, showing speedups up to 34.16 \times and inference power as low as 1.5 W. 3. Comparative analysis of DPU (high efficiency, restricted operator set, INT8 quantization) versus HLS (flexibility: 3D layers, sigmoid, comparators, IEEE-754 precision; lower baseline parallelism) for future space deployment. II Background II-A FPGA platforms FPGAs are semiconductor devices that can be reconfigured to perform specific tasks. They consist of programmable logic blocks and interconnects, allowing users to implement custom hardware designs. FPGAs are suitable for space applications due to their parallel processing capabilities and adaptability to evolving mission requirements. This study leverages the AMD ZCU104 development board. This board is a mid-tie‘red FPGA development board specifically designed for embedded design and systems, targeting applications that require flexibility and performance. This board features a comprehensive set of peripherals (USBs, HDMIs, JTAGs, etc.) and an AMD ZU7EV MPSoC device, which comprises two distinct components: the Processing System (PS), referred to as the CPU, and the Programmable Logic (PL), denoted as FPGA. The CPU comprises two hard processing systems (HPS): a high-performance ARM Cortex A53 and a real-time focused ARM Cortex R5. In contrast, the FPGA comprises reconfigurable logic, encompassing 504k logic cells, 38 Mb ( 4.75 MB) of on-chip SRAM, and 1728 DSP slices for computations. The ZCU104 is an ideal platform for prototyping space applications, having been extensively utilized in previous research on hardware accelerators for space [ 7 , 17 , 20 , 28 ] . The reconfigurable area of the ZCU104 is comparable to that of radiation-tolerant or hard FPGAs (e.g., Kintex UltraScale XQR), enabling seamless transfer of results between these devices with minimal effort. II-B Implementation Approaches II-B 1 Vitis AI / AMD Deep Learning Processor Unit Vitis AI is a tool developed by AMD/Xilinx designed to accelerate NN algorithms on AMD/Xilinx FPGAs. It streamlines the deployment of NN models on heterogeneous hardware through a unified workflow that includes model optimization, quantization, compilation, and deployment. Vitis AI supports popular deep learning frameworks such as TensorFlow and PyTorch, allowing developers to utilize pre-trained NN models or customize and train their own. These models can be quantized using either post-training quantization (PTQ) or quantization-aware training (QAT). The PTQ method involves converting weights and activations to 8-bit integers directly, while QAT fine-tunes the model with training data to enable inference with 8-bit weight and activation values. A critical component of Vitis AI is the DPU, a configurable IP core dedicated to convolutional neural networks (CNNs). This DPU is configured by uploading instructions equivalent to the NN model intended for execution, following compilation with Vitis AI. The DPU is a scalable and energy-efficient accelerator that integrates into AMD/Xilinx FPGAs. It achieves high-performance inference by parallelizing operations such as matrix multiplications and activations, thus reducing latency and power consumption compared to CPUs. Developers can tailor the DPU’s architecture to balance resource utilization and throughput, optimizing it for specific applications like real-time processing or environments with limited resources. II-B 2 Vitis HLS AMD/Xilinx Vitis HLS is a tool that enables users to define circuit functionality through C/C++, which is then transformed by the Vitis HLS compiler into a register transfer level (RTL) hardware description. This RTL description is subsequently synthesized and mapped onto an FPGA. The primary objectives of such HLS tools are to enhance productivity and portability by automating tasks traditionally performed by hardware engineers. Crucially, these tools democratize FPGA utilization for non-hardware engineers by allowing them to describe accelerators using more abstract languages than traditional hardware description languages. Vitis HLS supports various forms of parallelism tailored to different application scenarios. These include data-level parallelism, which is analogous to vector systems in CPUs; process-level concurrency; and streams or channels between tasks. The programmer can control the degree of parallelism through specific compiler directives,

Read the complete text