Algorithm and Hardware Co-Design for Efficient Complex-Valued Uncertainty Estimation Conference: 63rd ACM/IEEE Design Automation Conference; July 26–29, 2026; Long Beach, CA, USA 63rd ACM/IEEE Design Automation Conference (DAC ’26), July 26–29, 2026, Long Beach, CA, USA DOI: 10.1145/3770743.3804197 ISBN: 979-8-4007-2254-7/2026/07

Zehuan Zhang 1 , Mark Chen 1 , He Li 2 , Wayne Luk 1 · 2026

Read Algorithm and Hardware Co-Design for Efficient Complex-Valued Uncertainty Estimation Conference: 63rd ACM/IEEE Design Automation Conference; July 26–29, 2026; Long Beach, CA, USA 63rd ACM/IEEE Design Automation Conference (DAC ’26), July 26–29, 2026, Long Beach, CA, USA DOI: 10.1145/3770743.3804197 ISBN: 979-8-4007-2254-7/2026/07 by Zehuan Zhang 1 , Mark Chen 1 , He Li 2 , Wayne Luk 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19993.txt.

Introduction

Zhang and three colleagues enable uncertainty estimates for complex-valued neural networks, which handle complex numbers but could not gauge confidence. Their dropout-based Bayesian networks, BayesCVNNs, are the first, and an automated search tunes real and imaginary parts through layer and part mixing. A generator builds custom FPGA accelerators from optimized blocks, and the best designs beat hand-built models at lower hardware cost. They run about four and a half times and thirteen times faster than GPU versions, and use under 10 percent of GPU power.

Catalog record

CREATORZehuan Zhang 1 , Mark Chen 1 , He Li 2 , Wayne Luk 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34443
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19993

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Algorithm and Hardware Co-Design for Efficient Complex-Valued Uncertainty Estimation Conference: 63rd ACM/IEEE Design Automation Conference; July 26–29, 2026; Long Beach, CA, USA 63rd ACM/IEEE Design Automation Conference (DAC ’26), July 26–29, 2026, Long Beach, CA, USA DOI: 10.1145/3770743.3804197 ISBN: 979-8-4007-2254-7/2026/07 Zehuan Zhang 1 , Mark Chen 1 , He Li 2 , Wayne Luk 1 Abstract . Complex-Valued Neural Networks (CVNNs) have significant advantages in handling tasks that involve complex numbers. However, existing CVNNs are unable to quantify predictive uncertainty. We propose, for the first time, dropout-based Bayesian Complex-Valued Neural Networks (BayesCVNNs) to enable uncertainty quantification for complex-valued applications, exhibiting broad applicability and efficiency for hardware implementation due to modularity. Furthermore, as the dual-part nature of complex values significantly broadens the design space and enables novel configurations based on layer-mixing and part-mixing , we introduce an automated search approach to effectively identify optimal configurations for both real and imaginary components. To facilitate deployment, we present a framework that generates customized FPGA-based accelerators for BayesCVNNs, leveraging a set of optimized building blocks. Experiments demonstrate the best configuration can be effectively found via the automated search, attaining higher performance with lower hardware costs compared with manually crafted models. The optimized accelerators achieve approximately 4.5 × 4.5\times and 13 × 13\times speedups on different models with less than 10 % 10\% power consumption compared to GPU implementations, and outperform existing work in both algorithm and hardware aspects. Our code is publicly available at: https://github.com/zehuanzhang/BayesCVNN.git. † † cc-license: by † † footnotetext: This work is supported in part by UK EPSRC (EP/X036006/1, EP/P010040/1, EP/V028251/1, EP/S030069/1, UKRI256), in part by the National Natural Science Foundation of China under Grant 62304037, in part by the Natural Science Foundation of Jiangsu Province under Grant BK20230828, and in part by AMD. 1. Introduction Deep neural networks have delivered extraordinary performance across various domains 35 . In practical scenarios such as radar imaging 28 ; 31 ; 8 ; 18 , weather forecasting 20 , and magnetic resonance imaging 9 ; 26 ; 40 , data are collected as complex values containing both real parts and imaginary parts. To handle complex-valued tasks effectively, Complex-Valued Neural Networks (CVNNs) 33 ; 37 have been introduced, and have shown significant advantages compared with real-valued neural networks (RVNNs) in complex-valued tasks 4 . Despite their potential, existing CVNNs lack the ability for uncertainty estimation, which is crucial for reliability and trustworthiness. Uncertainty estimation prevents potential risks especially for health-related and safety-critical applications 45 ; 43 , since it enables assessment of prediction confidence, highlighting processes that require human attention. In real domains, Bayesian Neural Networks (BayesNNs) 30 have emerged to endow models capable of estimating uncertainty. Previous work 22 ; 19 has explored efficient approaches to perform inference. However, these efforts focused on real domains, leaving complex domains underexplored. Directly employing RVNNs to process complex-valued data can result in intrinsic loss of information in imaginary parts 27 ; 36 ; 38 . Therefore, to further enhance the reliability of CVNNs, there is an urgent need to develop Bayesian Complex-Valued Neural Networks (BayesCVNNs), extending Bayesian approximations to complex domains. Nevertheless, to design and deploy BayesCVNNs for practical applications, several key challenges exist. First , although real-domain Bayesian approximation methods 6 ; 17 significantly reduce operational complexity, their effectiveness in complex domains remains unexplored. Second , the inherent dual-component property of complex values leads to a larger model design space. It is a heuristic-driven process to manually design model architectures, making it particularly challenging to develop optimal model designs that satisfy diverse demands of various applications, especially considering the impact of real and imaginary parts. Third , dual components and complex-domain arithmetic 25 drastically increase memory and computational costs. Representing a single complex number with two real-valued elements doubles the memory footprint, and introduces at least a fourfold increase in computational complexity. These incurred costs hinder the practical deployment of BayesCVNNs. To address the first challenge, this paper extends Monte-Carlo Dropout 17 from real to complex domains, providing mathematical analysis that dropout enables Bayesian approximations for CVNNs. The proposed methodology utilizes dropout layers as plug-and-play modules, which exhibit broad applicability across mainstream models. The dropout operations can be implemented by independent and modular engines, facilitating hardware implementation. To address the second challenge, we first conduct a quantitative analysis, which indicates that BayesCVNNs exhibit an exponentially broader design space with respect to the number of layers (Section 3.3 ), compared with dropout-based BayesNNs in real domains. To effectively identify the optimal configurations, we construct a design space that enables layer-mixing and part-mixing configurations (Section 4.1 ). We further propose an evolutionary search approach considering hardware constraints to automatically identify the optimal model designs that outperform manually crafted models with higher algorithmic performance and lower hardware costs. To address the third challenge, we develop efficient FPGA-based hardware modules by leveraging complex-valued operational characteristics, and design a set of fundamental building blocks for complex-valued layers to generate specialized hardware accelerators. Specifically, complex-valued dropout layers contain switches to allow part-mixing configurations. Furthermore, considering application demands and hardware resource constraints, latency-opt and resource-opt hardware mapping schemes are provided. The generated accelerators, with uncertainty estimation capabilities, outperform GPU implementations and existing accelerators in speed and power. Moreover, ablation studies examine the hardware costs associated with RVNN-to-CVNN and CVNN-to-BayesCVNN conversions, quantifying FPGA deployment overheads. Our contributions can be summarized as follows. • A novel dropout-based BayesCVNN that enables reliable uncertainty estimation for complex-valued applications. This complex-valued dropout module supports plug-and-play deployment in CVNNs, showing algorithmic generality and hardware advantages. • An automated search approach to effectively find the dropout configurations for real and imaginary parts that meet both algorithmic targets and hardware constraints. This approach enables layer-mixing and part-mixing configurations, identifying the optimal configuration within an exponentially larger design space than conventional BayesNNs. • An algorithm-hardware co-design framework to generate customized FPGA accelerators for BayesCVNNs based on a set of building blocks with hardware mapping schemes. 2. Background and Related Work 2.1. Bayesian Neural Network Normal neural networks represent model parameters as point values. Unlike those, BayesNNs treat weights as probability distributions. The learning process is based on Bayesian theory: (1) P(\mathbf{w}|\mathcal{D})=\frac{P(\mathcal{D}|\mathbf{w})P(\mathbf{w})}{P(\mathcal{D})} where \mathbf{w} represents weight parameters and \mathcal{D} means input data. P(\mathbf{w}) is the prior probability distribution, which represents the probability of model parameters prior to observing any data. P(\mathcal{D}|\mathbf{w}) is the likelihood, representing the probability of data \mathcal{D} given model parameters \mathbf{w} . P(\mathcal{D}) is called evidence, which is given by: (2) P(\mathcal{D})=\int P(\mathcal{D}|\mathbf{w})P(\mathbf{w})d\mathbf{w}. Due to the high complexity of neural networks, analytical posterior distributions are computationally intractable. To address this, various approximation methods have been proposed 29 ; 39 , among which Monte Carlo Dropout 17 gains attention for its efficiency. Dropout can be used for Bayesian approximation: during inference, BayesNNs perform multiple forward passes for sampling, yielding a set of outputs, where the average is the final prediction and the standard deviation measures associated uncertainty. 2.2. Complex-Valued Neural Network Complex numbers include real and imaginary parts. CVNN layer operations can be performed via executing real-valued operations following complex-domain arithmetic 25 . For instance, in complex convolutional layer operations, the data are denoted as A_{R}+A_{I}i and the filters are denoted as W_{R}+W_{I}i . To calculate the results, four sub-operations

Read the complete text