AMPLE: Event-Driven Accelerator for Mixed-Precision Inference of Graph Neural Networks

Pedro Gimenes, Yiren Zhao, George Constantinides · 2025

Read AMPLE: Event-Driven Accelerator for Mixed-Precision Inference of Graph Neural Networks by Pedro Gimenes, Yiren Zhao, George Constantinides (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-21196.txt.

Introduction

Pedro Gimenes, Yiren Zhao, and George Constantinides design a chip accelerator for graph neural networks in a 2025 paper. These networks reason over linked data, but their scattered memory access wastes standard hardware. Existing FPGA designs buffer data in pairs and stall on lopsided graphs.

Their engine, AMPLE, runs on an event-driven flow that reacts as data arrives. Arithmetic precision is set per node, so easy nodes compute cheaply and hard ones keep accuracy. Prefetchers for data and instructions keep off-chip memory busy. On citation and social graphs up to 700,000 nodes, the chip ran on average 243 times faster than a CPU and about seven times faster than a GPU.

Catalog record

CREATORPedro Gimenes, Yiren Zhao, George Constantinides
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-21196

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AMPLE: Event-Driven Accelerator for Mixed-Precision Inference of Graph Neural Networks Pedro Gimenes, Yiren Zhao, George Constantinides Abstract Graph Neural Networks (GNNs) have recently gained attention due to their performance on non-Euclidean data. The use of custom hardware architectures proves particularly beneficial for GNNs due to their irregular memory access patterns, resulting from the sparse structure of graphs. However, existing FPGA accelerators are limited by their double buffering mechanism, which doesn’t account for the irregular node distribution in typical graph datasets. To address this, we introduce AMPLE (Accelerated Message Passing Logic Engine), an FPGA accelerator leveraging a new event-driven programming flow. We develop a mixed-arithmetic architecture, enabling GNN inference to be quantized at a node-level granularity. Finally, prefetcher for data and instructions is implemented to optimize off-chip memory access and maximize node parallelism. Evaluation on citation and social media graph datasets ranging from 2 2 K to 700 700 K nodes showed a mean speedup of 243 × 243\times and 7.2 × 7.2\times against CPU and GPU counterparts, respectively. 1 Introduction Graphs serve as powerful representations for capturing relationships between entities, which are represented as nodes, connected together by edges. This structure enables modeling a wide range of complex systems, including social networks ( Alamsyah et al. 2021 ) , biological interactions ( Wu et al. 2021 ) , and recommendation systems ( Wang et al. 2021 ) . Graph Neural Networks (GNNs) have emerged as a transformative approach for processing graph data, designed to learn from complex relational information by exploiting the interconnections within the graph ( Kipf & Welling 2016 ; Veličković et al. 2017 ) . Inference on GNN models can be divided into two main computational phases, (1) Aggregation and (2) Transformation ( Gilmer et al. 2017 ) . In the Aggregation phase, a permutation-invariant function such as summation or mean is applied over the feature embeddings of a node’s neighbors. The results of this phase are then utilized in the Transformation phase, which consists of a fully-connected layer used to generate the updated feature embedding for each node. While the Transformation phase presents a highly regular computational pattern , which can be effectively accelerated on a parallelized device such as a GPU, the Aggregation phase involves many irregular memory accesses due to the random and sparse nature of typical graph data. Additionally, aggregation latency is a function of a node’s degree, which follows a highly non-uniform distribution. As such, an efficiently-designed GNN accelerator needs to alleviate the computational irregularity of the Aggregation phase while leveraging the regularity of the Transformation phase ( Yan et al. 2020 ) . Table 1: Summary of graph processing features across hardware platforms. Although CPU parallelization is possible, multi-threaded CPUs have limited core count compared to parallelized accelerators. Event-driven programming is possible in GPUs, however computation does not follow a node-centric flow. Although pre-fetching is possible in GenGNN, all incoming messages for nodes in flight are required to be stored on-chip. Finally, no existing accelerators support arbitrary multi-precision computation. Hardware Platform Parallelization Event-Driven Programming Node Pre-Fetching Multi-Precision CPU (Intel Xeon) ✗ ✓ ✗ ✗ GPU (RTX A6000) ✓ ✓ ✗ ✗ HyGCN ( Yan et al. 2020 ) ✓ ✗ ✗ ✗ GenGNN ( Abi-Karam et al. 2022 ) ✓ ✗ ✓ ✗ AMPLE ✓ ✓ ✓ ✓ Although CPU memory systems are a mature and highly optimized technology, the sparse structure of graph data renders traditional cache systems less effective, since node aggregation incurs a high number of accesses to non-contiguous memory ranges. Inference on GPUs offers higher performance due to the deep level of parallelism, however, these devices are limited by high-latency memory management mechanisms. Additionally, there is no support for inter-phase pipelining, meaning aggregation results must be stored into off-chip memory before being re-fetched for the transformation phase. Finally, modern devices have limited support for computation with low-precision numerical formats. These considerations have motivated the design of several GNN accelerators. HyGCN leverages a set of Single Instruction Multiple Data (SIMD) cores for aggregation, and a systolic array for node transformation ( Yan et al. 2020 ) . Meanwhile, GenGNN was proposed as a model-agnostic framework for GNN acceleration, addressing the gap between the development pace of GNN models and custom accelerators ( Abi-Karam et al. 2022 ) through High-Level Synthesis tools. Table 1 summarizes the characteristics of available GNN hardware platforms. Despite the benefits of previously proposed GNN accelerators, (i) the double-buffering mechanism deployed in HyGCN is not well suited for graph computation due to the non-uniform distribution of node degrees. Under this paradigm, low degree nodes must wait for higher degree nodes before computation can proceed, causing a high number of pipeline gaps. This highlights the need for an event-driven programming flow , where nodes are independently allocated resources and scheduled onto the accelerator. Additionally, (ii) neither accelerator offers hardware support for model quantization. As observed by Tailor et al. ( Tailor et al. 2020 ) , the accuracy cost of quantization in GNNs is predominantly due to the aggregation phase and directly correlated to a node’s degree. As such, casting low-degree nodes to lower-precision formats while preserving high-degree nodes in high precision leads to reduced memory cost and resource usage at a low cost to model accuracy. Finally, (iii) existing accelerators require on-chip buffering of node embeddings for the entire input graph. As such, these have limited applicability for inference on large graphs ( >100k nodes) where embeddings cannot feasibly be stored on-chip, highlighting the need for a node-centric pre-fetching system to hide memory access latency while the accelerator is busy. We address these shortcomings by introducing a novel GNN accelerator, AMPLE, contributing the following: • We showcase an event-driven programming model for GNN acceleration, by enabling the host to program nodes asynchronously through memory-mapped registers. • We propose an architecture featuring a heterogeneous pool of multi-precision Aggregation Cores connected through a Network-on-Chip, which are dynamically allocated to nodes according degree and precision. • We evaluate AMPLE on large-scale graph datasets ranging from 2K to 700K nodes, achieving an average speedup of 243\times and 7.2\times compared to CPU and GPU baselines, respectively. The body of this paper is structured as follows. Section 2 covers background on GNNs and neural network quantization. Section 3 explains the architecture of the AMPLE accelerator, including how each high-level feature is achieved at the circuit level. Finally, Section 4 explains the testing methodology and experimental results against CPU/GPU baselines. 2 Background 2.1 Graph Representation A graph G=(\mathcal{V},\mathcal{E}) is a set of nodes/vertices \mathcal{V} and edges \mathcal{E} . The set of feature representations at layer l is denoted by matrix X^{(l)}\in\mathcal{R}^{N\times D} , where N=|\mathcal{V}| is the number of nodes and D is the feature size. An element e_{i,j}=(v_{i},v_{j}) present in \mathcal{E} indicates that there is a connection between nodes v_{i} and v_{j} , meaning node v_{j} is contained in the set of i ’s neighbors, \mathcal{N}_{i} , and v_{i} is contained in \mathcal{N}_{j} . In an undirected graph, the edge element e_{i,j} corresponds to e_{j,i} . The connections in a graph can be represented using an N\times N adjacency matrix, where each element A_{i,j} represents an edge between nodes i and j . 2.2 Graph Neural Networks (GNNs) Within a GNN,

Read the complete text