Hardware Acceleration for Neural Networks: A Comprehensive Survey Journal: JACM

Bin Xu, Ayan Banerjee, Sandeep Gupta · 2025

Read Hardware Acceleration for Neural Networks: A Comprehensive Survey Journal: JACM by Bin Xu, Ayan Banerjee, Sandeep Gupta (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23914.txt.

Description

Bin Xu, Ayan Banerjee, and Sandeep Gupta survey the hardware that runs neural networks, a workload that now dominates both cloud and edge computing. The bottleneck has shifted: raw arithmetic is cheap, while moving data, communicating between chips, and handling irregular operators consume the budget. The survey organizes a sprawling landscape spanning graphics processors, tensor cores, and domain-specific accelerators such as TPUs and NPUs.

Further families include FPGA designs, dedicated inference ASICs, language-model serving chips, in-memory and near-memory computing, and neuromorphic or analog approaches. The taxonomy crosses workloads, from convolutional and recurrent networks to transformers, with execution settings and optimization levers such as reduced precision, sparsity, operator fusion, and memory design. Open challenges close the survey, including long-context inference with its key-value cache burden, dynamic and sparse workloads, energy and security, and fair benchmarking.

Catalog record

CREATORBin Xu, Ayan Banerjee, Sandeep Gupta
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE136 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-23914

Browse the full library · About the Tower of Babel