CORDIC Is All You Need
Omkar Kokane, Adam Teman, Anushka Jha, Guru Prasath SL, Gopal Raut, Mukul Lokhande, S. V. Jaya Chand, Tanushree Dewangan, Santosh Kumar Vishvakarma · 2025
Read CORDIC Is All You Need by Omkar Kokane, Adam Teman, Anushka Jha, Guru Prasath SL, Gopal Raut, Mukul Lokhande, S. V. Jaya Chand, Tanushree Dewangan, Santosh Kumar Vishvakarma (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11685.txt.
Introduction
Omkar Kokane and eight co-authors present a chip design built on one math block in a 2025 paper. The block, called CORDIC, can do both plain multiply and add work and the curved functions AI nets need, such as tanh and softmax. One block for both jobs could shrink the size and power draw of AI chips at the edge.
Their engine lines up many such blocks in a grid that can be reshaped for each task. It trims forty percent of the work as spare. In tests it ran more than four times faster than a base design, with a fifth of the power and a quarter of the chip area. A trial on a field programmable board kept the gains.
Catalog record
| CREATOR | Omkar Kokane, Adam Teman, Anushka Jha, Guru Prasath SL, Gopal Raut, Mukul Lokhande, S. V. Jaya Chand, Tanushree Dewangan, Santosh Kumar Vishvakarma |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-11685
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CORDIC Is All You Need Omkar Kokane, Adam Teman, Anushka Jha, Guru Prasath SL, Gopal Raut, Mukul Lokhande, S. V. Jaya Chand, Tanushree Dewangan, Santosh Kumar Vishvakarma Abstract . Artificial intelligence necessitates adaptable hardware accelerators for efficient high-throughput million operations. We present pipelined architecture with CORDIC block for linear MAC computations and nonlinear iterative Activation Functions ( AF ) such as tanh \tanh , s i g m o i d sigmoid , and SoftMax. This approach focuses on a Reconfigurable Processing Engine ( RPE ) based systolic array, with 40% pruning rate, enhanced throughput up to 4.64 × \times , and reduction in power and area by 5.02 × \times and 4.06 × \times at CMOS 28 nm, with minor accuracy loss. FPGA implementation achieves a reduction of up to 2.5 × \times resource savings and 3 × \times power compared to prior works. The Systolic CORDIC engine for Reconfigurability and Enhanced throughput (SYCore) deploys an output stationary dataflow with the CAESAR control engine for diverse AI workloads such as Transformers, RNNs/LSTMs, and DNNs for applications like image detection, LLMs, and speech recognition. The energy-efficient and flexible approach extends the enhanced approach for edge AI accelerators supporting emerging workloads. DOI: XXXXXXX.XXXXXXX CCS: Hardware CCS: Hardware Integrated circuits CCS: Hardware Reconfigurable logic and FPGAs CCS: Hardware Hardware accelerators 1. Introduction Artificial Intelligence and Machine Learning ( AI/ML ) have been extensively implemented and embraced across various technological domains. Among the myriad algorithmic frameworks, deep neural networks (DNNs) have captured significant attention due to their vast applicability in fields like science, engineering, agriculture, healthcare, etc. DNNs have revolutionized image classification, audio recognition, and natural language processing ( Raut et al., 2023a ) . DNNs are structured with multiple layers, starting from the input, passing through several hidden layers, and concluding with the output layers. During inference, these layers form a directed acyclic graph with nodes and edges leading to neurons in subsequent layers. Each node, or neuron, executes two core tasks: First, it employs a Multiply, Add and Accumulate( MAC ) unit to aggregate the weighted input features and second, it applies the Activation Function( AF ) to the resulting sum. A deep neural network (DNN) is a type of Artificial Neural Network( ANN ) that consists of multiple hidden layers between the input and output, typically structured as either a Convolutional Neural Network ( CNN ) or Fully Connected ( FC ). Researchers have focused on developing specialized hardware solutions, including Application-Specific Integrated Circuits ( ASICs ), Graphics Processing Units ( GPUs ), Field-Programmable Gate Arrays ( FPGA ), and multi-threaded CPUs ( Zhu et al., 2020 ; Wang et al., 2018 ; Basavaraju et al., 2024 ) , to enhance the efficiency of DNN implementations. ASICs are specialized hardware optimized for a specific task, sacrificing the adaptability of a reconfigurable architecture for improved power efficiency compared to platforms such as FPGAs and GPUs. These latter platforms, while more versatile and capable of executing a variety of tasks, tend to have higher power consumption ( Morcel et al., 2019 ; Boutros et al., 2018 ) . FPGAs provides cost efficiency, and flexibility, with limited on-chip memory and resources ( Boutros et al., 2018 ) . Thus, innovative design methodologies are required to manage the area, complexity, and reconfigurability challenges in DNNs . Additionally, a DNN comprises various layers, including CNN, feed-forward, normalization, long-term short-term memory ( LSTM) , Gated Recurrent Unit ( GRU ), pooling, and activation layers like Rectified Linear Unit( ReLU ), \tanh , and sigmoid ( Zhu et al., 2020 ; Kokane et al., 2024a ) . The core components of a DNN model are the Processing Engines (PEs), or artificial neurons. These involve multiplication and accumulation processes followed by a nonlinear AF . Multiplication and accumulation operations, handled by MAC units through complex adder and compressor design, are computationally intensive. The output is then subjected to nonlinear transformations using AFs such as sigmoid, \tanh , and ReLU , commonly employed in DNNs ( Raut et al., 2023b ) . Activation functions are crucial in DNN architectures to enable features like model size reduction and prevention of overfitting issues ( Han et al., 2015 ) . Various methods, including LookUp-Tables ( LUT ), CORDIC , and PieceWise Linear ( PWL ), can implement these Activation Functions. While some designs are resource-intensive in terms of area and power, the CORDIC design is praised for its area and power efficiency; however, a considerable limitation is its low throughput. Figure 1. Typical demonstration of (a) DNN and (b) Transformers model, depicted intermediate layers such as Conv, Pooling, MHA, and FFNN Prior AI accelerator designs prioritize area and power efficiency and focus on the CORDIC computational algorithm ( Meher et al., 2009 ; Raut et al., 2020 ; Lokhande et al., 2024 ; Kokane et al., 2024a ) . This design comprises fundamental logic components, including a shift register, adder/subtractor circuits, multiplexers, and some memory elements that facilitate a range of arithmetic operations while consuming less power. CORDIC algorithm, introduced by Jack E. Volder in 1959, has the adaptability to conduct several arithmetic operations. Mathematically, it achieves linear convergence with minimal resource use ( Raut et al., 2023b ) . Through shift and add-sub operations, the CORDIC architecture can execute numerous tasks, such as trigonometric, hyperbolic, and logarithmic functions via vector rotation ( Aggarwal et al., 2014 ) . We employ CORDIC in rotation mode to achieve the \tanh and sigmoid functions, akin to computing hyperbolic functions as exponential terms. Moreover, CORDIC can determine square roots and more. The widely used SoftMax function can also be implemented through CORDIC hardware, which is crucial for various classification tasks and is predominantly used in transformer architectures and capsule networks. 1.1. Background on Accelerator Design Techniques Enhancing the efficiency of hardware accelerators involves several techniques to increase throughput while minimizing power usage and latency. These techniques include Quantization, Pruning, Sparsity, Power and Clock Gating. Quantization entails lowering the precision of data from a higher to a lower bit-width, which helps reduce the size of adders and multipliers in both weights and inputs, ultimately decreasing delay and power consumption. This process employs methods such as Truncation and Round-to-earest-even, although such methods can compromise precision, resulting in diminished accuracy on a larger scale. Research on eliminating quantizing errors is available in sources like ( Hanif et al., 2019 ; Sarwar et al., 2018 ) . Pruning entails minimizing computational data according to its significance, a method utilized by NVIDIA in their GPUs to enhance throughput ( Choquette, 2023 ; Park et al., 2023 ; George et al., 2022 ) . Adjusting lower-valued inputs or weights to zero based on the pruning ratio effectively reduces computational requirements. Pruning coordinates with Sparsity, which converts data matrices into sparse formats by removing zeros. Although pruning can affect accuracy, it can be recovered through model fine-tuning, possibly doubling throughput gains. Some of the Latest design also Performs a Hierarchical pruning-sparsity increasing the ratio up to 3:4 reducing the 75% computation ( Wu et al., 2023b ) . Sparsity, while complicating data flow, minimizes redundant calculations. At a more fundamental level, Power and Clock Gating