CARMEN: CORDIC-Accelerated Resource-Efficient Multi-Precision Inference Engine for Deep Learning This work was supported partially by the Dept of Science and Technology (DST), Govt of India, for the INSPIRE PhD fellowship, and MeitY/SMDP-C2S for ASIC design tools.

Sonu Kumar, Mukul Lokhande, Santosh Kumar Vishvakarma, Adam Teman · 2026

Read CARMEN: CORDIC-Accelerated Resource-Efficient Multi-Precision Inference Engine for Deep Learning This work was supported partially by the Dept of Science and Technology (DST), Govt of India, for the INSPIRE PhD fellowship, and MeitY/SMDP-C2S for ASIC design tools. by Sonu Kumar, Mukul Lokhande, Santosh Kumar Vishvakarma, Adam Teman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06878.txt.

Introduction

Sonu Kumar, Mukul Lokhande, Santosh Kumar Vishvakarma, and Adam Teman present CARMEN, a hardware inference engine that uses CORDIC arithmetic to run neural networks efficiently. CORDIC computes multiply-accumulate operations through shifts and additions, and its iteration depth directly sets accuracy. That lets their engine switch between approximate and precise modes at runtime with no hardware change, supporting both eight- and sixteen-bit precision.

A chip implementation in twenty-eight nanometer technology cuts computation cycles by up to a third and power by about a fifth per stage. A large configuration reaches strong compute density and energy efficiency, and a field-programmable board prototype runs real-time object detection at well under half a watt.

Catalog record

CREATORSonu Kumar, Mukul Lokhande, Santosh Kumar Vishvakarma, Adam Teman
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.06878

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CARMEN: CORDIC-Accelerated Resource-Efficient Multi-Precision Inference Engine for Deep Learning This work was supported partially by the Dept of Science and Technology (DST), Govt of India, for the INSPIRE PhD fellowship, and MeitY/SMDP-C2S for ASIC design tools. Sonu Kumar, Mukul Lokhande, Santosh Kumar Vishvakarma, Adam Teman Abstract This paper presents CARMEN, a runtime-adaptive, CORDIC-accelerated multi-precision vector engine for resource-efficient deep learning inference. The key insight is that CORDIC iteration depth directly governs computational accuracy, enabling dynamic switching between approximate and accurate execution modes without hardware modification. The architecture integrates a low-resource iterative CORDIC-based MAC unit with a time-multiplexed multi-activation function block, supporting flexible 8/16-bit precision and high hardware utilization. ASIC implementation in 28 nm CMOS achieves up to 33% reduction in computation cycles and 21% power savings per MAC stage; a 256-PE configuration delivers 4.83 TOPS/mm 2 compute density and 11.67 TOPS/W energy efficiency. FPGA deployment on Pynq-Z2 validates 154.6 ms latency at 0.43 W for real-time object detection. TABLE I: SoTA Design approaches and comparison of respective design features in AI workloads Design Baseline ICIIS’25 [ 13 ] ICIIS’25 [ 20 ] IEEE Access’24 [ 1 ] TVLSI’25 [ 17 ] ISCAS’25 [ 11 ] ISVLSI’25 [ 12 ] Proposed Compute Pipe-CORDIC Pipe-CORDIC PWL Pipe-CORDIC Pipe-CORDIC Logarithmic Approx. Iterative CORDIC Iterative CORDIC Arch. Type Fully Parallel Layer-Reused AF-Reused AF-Reused Systolic Array Time-multiplexed Reconfigurable Array Layer-Reused Vector Engine Scalability No Yes No No - Yes No Yes Precision FxP-8 FxP-8 FxP-8 FxP-8 FxP-4/8/16/32 Posit-8/16/32 FxP-8 FxP-8/16 Accuracy loss High High High High Medium Low Medium Variable (Low) Design Overhead Area, St. Power Area Area, St. Power Area, Power Energy Area, Complexity Latency Application-optimized Performance AF-Supported ReLU ReLU Sigmoid/Tanh NA Sigmoid, Softmax, Tanh, ReLU Sigmoid, Tanh, Softmax Sigmoid/Tanh SoftMax, GELU, Sigmoid Tanh, Swish, ReLU, and SELU Applications ANN ANN ANN DNN DNN, Transformers DNN DNN DNN, Transformers (MLP) I Introduction Over the past decade, deep learning has enabled transformative advancements across diverse application domains, driven by architectures such as Deep Neural Networks (DNNs), Vision Transformers (ViTs), and Large Language Models (LLMs) [ 23 , 9 ] . From early convolutional neural networks (CNNs) to large-scale transformer-based models, the fundamental computational kernels remain largely unchanged, consisting of convolutional, fully connected (FC) or multi-layer perceptron (MLP), and multi-head attention (MHA) layers [ 18 ] . Workload characterization studies indicate that multiply-accumulate (MAC) operations dominate the computation, accounting for nearly 90% of total operations, while activation functions (AFs) contribute only 2-5% [ 7 ] . Efficient execution of these workloads under stringent area and power constraints remains a key challenge for edge AI deployment. Prior works have explored several techniques to improve resource efficiency, including fixed-point quantization [ 6 ] , CORDIC-based arithmetic [ 12 ] , logarithmic approximations [ 11 ] , and truncation strategies [ 1 ] . While these approaches reduce computational complexity [ 3 ] , they often introduce accuracy degradation of up to 4% [ 1 ] or lead to suboptimal energy efficiency [ 16 ] . Furthermore, the imbalance in workload distribution between MAC operations and AFs has been largely overlooked. Existing designs allocate substantial hardware resources to AF units, resulting in poor utilization, with reports indicating up to 84% idle cycles [ 13 ] and 20-25% area overhead due to inactive logic in accelerators such as Google TPUv4 [ 7 ] . More fundamentally, the trade-off between computational accuracy and hardware efficiency is typically fixed at design time: static CORDIC iteration depths or approximation schemes either incur unnecessary latency for error-tolerant layers or compromise accuracy for sensitive computations. Table I summarizes these limitations across current state-of-the-art (SoTA) approaches. To address these gaps, this work adopts a runtime-adaptive design paradigm. The key insight is that CORDIC computation accuracy is directly governed by the number of iterations, which can be dynamically tuned without modifying the underlying hardware. This enables seamless switching between approximate and accurate execution modes with minimal area overhead. Additionally, by prioritizing MAC-dominated execution and time-multiplexing activation function hardware, the design significantly improves resource utilization. Based on these principles, we present CARMEN, a CORDIC-accelerated multi-precision vector engine for resource-constrained deep learning applications. The key contributions are: 1. A runtime-adaptive iterative CORDIC-based MAC unit supporting approximate and accurate modes, enabling latency-accuracy trade-offs with up to 33% cycle reduction and < 2% accuracy loss. 2. A reconfigurable multi-precision vector engine integrating MAC, time-multiplexed multi-AF (ReLU, GELU, SoftMax, Tanh, Sigmoid, Swish, SELU), pooling, and normalization units with efficient resource sharing and high hardware utilization. 3. Comprehensive FPGA and ASIC evaluation in 28 nm CMOS, demonstrating 4.83 TOPS/mm 2 compute density and 11.67 TOPS/W energy efficiency, with system-level validation at 154.6 ms latency and 0.43 W on Pynq-Z2. II Proposed Solution Fig. 1: Resource-efficient DL accelerator, comprised of Vector Engine, data pre-fetcher, control engine, interface and off-chip memory. The architecture of the proposed CARMEN accelerator is shown in Fig. 1 . It consists of five key components: (i) a runtime-configurable vector engine [ 13 ] , (ii) a time-multiplexed multi-AF unit [ 12 ] supporting Tanh, Softmax, GELU, Sigmoid, Swish, ReLU, and SELU, (iii) a performance-enhanced AAD pooling unit [ 8 ] , (iv) a normalization unit, and (v) a data pre-processing and off-chip memory interface. The vector engine forms the compute core and comprises N precision-adjustable, accuracy-configurable iterative MAC units, each supplied by dual kernel memory banks of size ( n -bit \times 32) for weights and input activations. A hierarchical, synthesizable generator framework enables scalable instantiation of the architecture for both edge and high-performance computing (HPC) scenarios. II-A Runtime-Adaptive Low-Resource Iterative CORDIC MAC The unified CORDIC algorithm, introduced by Walther [ 25 ] , enables efficient computation of circular, linear, and hyperbolic functions using simple arithmetic components such as adders/subtractors, multiplexers, and shift units. Recent works, including ReCON [ 22 ] and Flex-PE [ 17 ] , have leveraged CORDIC for DNN primitives such as MAC operations and nonlinear activation functions. However, such unified CORDIC-based vector engines are inherently general-purpose and do not exploit the workload imbalance in DNNs, where AFs contribute only 2-5% of operations. As a result, hyperbolic and circular rotation units dedicated to AF computation remain largely idle, incurring unnecessary area and power overhead. To overcome this inefficiency, we propose an optimized iterative CORDIC-based MAC architecture, as illustrated in Fig. 2 . Unlike conventional pipelined implementations that replicate hardware across stages, the proposed design reuses arithmetic resources across iterations, thereby significantly reducing area and switching activity. This approach achieves up to 33% reduction in computation cycles and 21% lower power per stage. Although iterative execution introduces additional latency per MAC operation, this overhead is effectively amortized through parallel vector execution, making the design well-suited for high-throughput accelerator systems. Fig. 2: Iterative low-latency CORDIC MAC architecture. II-B Dynamically Configurable Versatile Multi-AF Block The proposed multi-AF unit improves hardware efficiency through time-multiplexed execution of multiple nonlinear functions. Instead of dedicating separate hardware resources for each activation function, the design reuses shared CORDIC datapaths along with lightweight auxiliary logic. The CORDIC core operates in hyperbolic rotation mode to compute sigmoid and tanh, while softmax is realized through a combination of exponentiation and normalization stages. Simpler functions such as ReLU and its variants are handled by bypass logic with negligible overhead.

Read the complete text