Invited Paper: FEMU : An Open-Source and Configurable Emulation Framework for Prototyping TinyAI Heterogeneous Systems

Simone Machetti 1 , Deniz Kasap 1 , Juan Sapriza 1 , Rubén Rodríguez Álvarez 1 , Hossein Taji 1 , José Miranda 6 , Miguel Peón-Quirós 4 , David Atienza 1 · 2025

Read Invited Paper: FEMU : An Open-Source and Configurable Emulation Framework for Prototyping TinyAI Heterogeneous Systems by Simone Machetti 1 , Deniz Kasap 1 , Juan Sapriza 1 , Rubén Rodríguez Álvarez 1 , Hossein Taji 1 , José Miranda 6 , Miguel Peón-Quirós 4 , David Atienza 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-16981.txt.

Introduction

Simone Machetti and co-authors present FEMU, an emulation framework for tiny AI hardware, in this 2025 paper. Tiny AI systems mix processors and accelerators on tight energy budgets. Prototyping them in real hardware is slow and costly. FEMU runs the system under development inside an FPGA while a normal software environment supervises it.

Their demo platform uses a Xilinx chip with a Linux and Python control side. The hardware side hosts an open, energy efficient platform design. Energy models come from a real silicon version of that design in 65 nanometer technology. Designers can swap hardware parts and measure effects quickly. The framework is open source and configurable. It targets rapid, realistic evaluation before any chip is built.

Catalog record

CREATORSimone Machetti 1 , Deniz Kasap 1 , Juan Sapriza 1 , Rubén Rodríguez Álvarez 1 , Hossein Taji 1 , José Miranda 6 , Miguel Peón-Quirós 4 , David Atienza 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-16981

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Invited Paper: FEMU : An Open-Source and Configurable Emulation Framework for Prototyping TinyAI Heterogeneous Systems Simone Machetti 1 , Deniz Kasap 1 , Juan Sapriza 1 , Rubén Rodríguez Álvarez 1 , Hossein Taji 1 , José Miranda 6 , Miguel Peón-Quirós 4 , David Atienza 1 Abstract In this paper, we present the new FPGA EMUlation ( FEMU ), an open-source and configurable emulation framework for prototyping and evaluating TinyAI heterogeneous systems (HS). FEMU leverages the capability of system-on-chip (SoC)-based FPGAs to combine the under-development HS implemented in a reconfigurable hardware region (RH) for quick prototyping with a software environment running under a standard operating system in a control software region (CS) for supervision and communication. To evaluate our approach, we built the X-HEEP FPGA EMUlation ( X-HEEP-FEMU ) platform by instantiating the proposed framework with real-world hardware and software components. X-HEEP-FEMU is deployed on the Xilinx Zynq-7020 SoC and integrates the eXtendible Heterogeneous Energy Efficient Platform ( X-HEEP ) host in the RH, a Linux-based Python environment on the ARM Cortex-A9 CS, and energy models derived from a TSMC 65 nm 65\text{\,}\mathrm{nm} CMOS silicon implementation of X-HEEP , called HEEPocrates . I INTRODUCTION The increasing demand for real-time machine learning applications has driven the rapid growth of edge computing. By processing data directly on local devices instead of relying on remote cloud infrastructure, edge computing minimizes latency, strengthens data privacy, and enhances energy efficiency. These are key advantages for many edge-centric use cases. However, these workloads impose strict requirements on processing power, responsiveness, and energy consumption, highlighting the need for customized hardware solutions [ 1 ] . An effective strategy to meet these requirements is the use of heterogeneous systems (HS), which combine a general-purpose central processing unit (CPU) as host with specialized hardware accelerators to optimize both performance and energy efficiency [ 2 , 3 , 4 , 5 ] . The design of such systems is particularly critical for ultra-low-power edge applications (TinyAI), where balancing performance, power, and energy efficiency presents significant challenges. These applications run on battery-powered devices operating under tight power constraints, typically in the range of tens of milliwatts, necessitating highly efficient architectures. Their small form factor also imposes strict area restrictions, with a complete system-on-chip (SoC) often occupying only a few square millimeters. The challenges further increase on the software side, where applications generally involve two distinct, possibly overlapping, operational phases [ 6 , 7 ] : (1) acquisition, where sensor data are collected through analog-to-digital converters (ADCs) and stored in memory [ 8 ] , and (2) processing, where these data are analyzed. To efficiently prototype and evaluate such systems, tight hardware/software co-design is essential. This requires flexible and accurate development platforms capable of supporting real-time interaction, as well as performance and energy measurements. Existing register transfer level (RTL)-based platforms [ 9 , 10 ] offer cycle-accurate modeling, but are slow, inflexible, and require complete hardware implementations, making them unsuitable for early-stage design exploration. On the other hand, software-based simulators [ 11 ] are easier to use and faster, but typically lack sufficient accuracy or realism to guide design decisions for TinyAI systems reliably. To overcome these challenges, we present FPGA EMUlation ( FEMU ), an open-source and configurable emulation framework for prototyping and evaluating TinyAI HS. This approach leverages the capability of SoC-based FPGAs to combine the under-development HS implemented in a reconfigurable hardware region (RH) for quick prototyping, with a software environment running under a standard operating system (OS) on a control software region (CS) for supervision and communication. HS peripherals are virtualized on the CS, enabling flexible communication and processing of comprehensive signal databases to evaluate the correctness of the system. Custom accelerators can be incorporated as virtualized software models in the CS for early-stage testing or as RTL modules in the RH for later-stage development. The framework supports system-level performance and energy estimation for combinations of virtualized and RTL accelerators using models derived from real-world silicon measurements. Developers interact with FEMU via a software interface, which simplifies communication and accelerates design space exploration. To demonstrate our approach, we implement the X-HEEP FPGA EMUlation ( X-HEEP-FEMU ) platform by instantiating the proposed framework with real hardware and software components. X-HEEP-FEMU is deployed on the Xilinx Zynq-7020 SoC and integrates the eXtendible Heterogeneous Energy Efficient Platform ( X-HEEP ) [ 12 ] host in the RH, a Linux-based Python environment on the ARM Cortex-A9 CS, and energy models derived from a TSMC 65\text{\,}\mathrm{nm} CMOS silicon implementation of X-HEEP , referred to as HEEPocrates [ 2 ] . The key contributions of this work are: • FEMU : a flexible and reusable emulation framework for prototyping and evaluating TinyAI HS. • A hybrid SW/HW strategy that enables debugging, ADC, and flash virtualization, as well as accelerator integration during both early-stage development using software models and later-stage deployment with RTL implementations. • A system-level approach for performance and energy estimation, grounded in real silicon measurements and enabling practical evaluation of HS. • X-HEEP-FEMU : a complete emulation platform realized by instantiating the proposed framework with real-world hardware and software components, released as open source. 1 1 1 The complete code and documentation of the X-HEEP-FEMU platform are available at https://github.com/esl-epfl/x-heep-femu and https://github.com/esl-epfl/x-heep-femu-sdk . The remainder of this paper is organized as follows. Section 2 reviews related work. Section 3 introduces the FEMU framework. Section 4 describes the X-HEEP-FEMU platform. Section 5 presents three case studies, and, finally, in Section 6 we draw our conclusions. II STATE-OF-THE-ART TABLE I : Comparison of relevant FPGA-based platforms across key features. FPGA Platforms HS-based RH OS-based CS IP Virtualization Performance Estimation Energy Estimation LiME [ 13 ] ✗ ✗ ✗ ✓ ✗ Hybrid [ 14 ] ✗ ✓ ✓ ✓ ✗ FAME [ 15 ] ✗ ✓ ✗ ✓ ✗ Extrapolator [ 16 ] ✗ ✓ ✗ ✓ ✗ ULPemu [ 17 ] ✓ ✗ ✗ ✓ ✓ ACE [ 18 ] ✗ ✓ ✗ ✓ ✗ SnifferSoC [ 19 ] ✗ ✗ ✗ ✓ ✓ ThermalMPSoC [ 20 ] ✗ ✗ ✗ ✓ ✓ HLL [ 21 ] ✗ ✗ ✗ ✓ ✗ HERO [ 22 ] ✓ ✓ ✓ ✓ ✗ Plug [ 23 ] ✓ ✗ ✓ ✓ ✗ SoftPower [ 24 ] ✓ ✗ ✗ ✓ ✓ DAQ [ 25 ] ✓ ✗ ✗ ✗ ✗ FEMU (this work) ✓ ✓ ✓ ✓ ✓ This section reviews the most relevant FPGA-based platforms that have inspired the development of the proposed FEMU framework. Table I compares these platforms across five key dimensions relevant for TinyAI system prototyping and evaluation: (1) HS-based RH, referring to platforms that feature an HS implemented in an RH to enable quick prototyping; (2) OS-based CS, indicating platforms equipped with a CS capable of running a standard operating system to handle coordination and communication tasks; (3) IP virtualization, which supports flexible integration and rapid prototyping by allowing modules to be emulated in software before hardware deployment; (4) performance estimation, which is essential for identifying execution bottlenecks and evaluating system responsiveness; and (5) energy estimation, which allows designers to assess and optimize power consumption, a key requirement for battery-powered applications at the edge. The following discussion analyzes these features

Read the complete text