MANOJAVAM : A Scalable, Unified FPGA Accelerator for Matrix Multiplication and Singular Value Decomposition in Principal Component Analysis
Srivaths Ramasubramanian (Student Member, IEEE), Anjali Devarajan (Student Member, IEEE), Kousthub P Kaivar (Student Member, IEEE), Vibha Shrestta (Student Member, IEEE), Shashank D (Student Member, IEEE), Sowmyarani C.N (Member, IEEE), Govinda Raju M, K.S Geetha (Senior Member, IEEE) · 2026
Read MANOJAVAM : A Scalable, Unified FPGA Accelerator for Matrix Multiplication and Singular Value Decomposition in Principal Component Analysis by Srivaths Ramasubramanian (Student Member, IEEE), Anjali Devarajan (Student Member, IEEE), Kousthub P Kaivar (Student Member, IEEE), Vibha Shrestta (Student Member, IEEE), Shashank D (Student Member, IEEE), Sowmyarani C.N (Member, IEEE), Govinda Raju M, K.S Geetha (Senior Member, IEEE) (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01514.txt.
Introduction
Srivaths Ramasubramanian and seven co-authors built MANOJAVAM, a chip design that runs principal component analysis end to end on an FPGA. The method, a workhorse for shrinking data in fields from imaging to genomics, spends most of its cost on matrix multiplication and the singular value step.
Earlier chips cover only one of those stages, lean on high-level synthesis that limits tuning, or use fixed-point math that caps size. MANOJAVAM unifies both stages. A grid of systolic arrays streams matrix blocks for the multiply. A parallel Jacobi unit with pipelined rotation hardware handles the singular values, fed by a two-tier cache that adapts to each stage's access pattern. Built on two Xilinx boards, the large build cuts singular value time by over twentyfold against a high-end graphics card. It also slashes total energy, making the design fit both data centers and edge boxes.
Catalog record
| CREATOR | Srivaths Ramasubramanian (Student Member, IEEE), Anjali Devarajan (Student Member, IEEE), Kousthub P Kaivar (Student Member, IEEE), Vibha Shrestta (Student Member, IEEE), Shashank D (Student Member, IEEE), Sowmyarani C.N (Member, IEEE), Govinda Raju M, K.S Geetha (Senior Member, IEEE) |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.01514
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MANOJAVAM : A Scalable, Unified FPGA Accelerator for Matrix Multiplication and Singular Value Decomposition in Principal Component Analysis Srivaths Ramasubramanian (Student Member, IEEE), Anjali Devarajan (Student Member, IEEE), Kousthub P Kaivar (Student Member, IEEE), Vibha Shrestta (Student Member, IEEE), Shashank D (Student Member, IEEE), Sowmyarani C.N (Member, IEEE), Govinda Raju M, K.S Geetha (Senior Member, IEEE) Abstract Principal Component Analysis (PCA) is widely used for dimensionality reduction in hyperspectral imaging, genomics, and neurosciences. However, it suffers from computational bottlenecks in matrix multiplication and singular value decomposition (SVD). Prior PCA hardware accelerators either target only one of these stages, rely on High Level Synthesis (HLS) that limits microarchitectural optimizations or use fixed point datapaths with limited dataset scalability. There is a need for a unified PCA accelerator that is suitable for datasets of any input dimension. Hence, the proposed work presents MANOJAVAM, a scalable PCA accelerator fabric, unifying matrix multiplication and SVD in a single architecture. MANOJAVAM(T,S) comprises an S number of TxT TPU-style systolic arrays employing block streaming for high-throughput matrix multiplication. It further integrates a highly parallel Jacobian unit implementing the Jacobi method for SVD with pipelined CORDIC based rotations. A two tier cache hierarchy and mode-aware memory policies adapts to the distinct memory access patterns of covariance matrix and rotation computation. For demonstration, MANOJAVAM(4,8) is realized on a Xilinx Artix-7 FPGA, achieving a frequency of 200 MHz at 1.271W. MANOJAVAM(16,32) is realized on Xilinx Virtex-Ultrascale+ FPGA, achieving a frequency of 434 MHz at 16.957W. Benchmarking on real-world datasets reveals that MANOJAVAM(16,32) achieves up to a 22.75x speedup in SVD latency and a 42.14x reduction in total energy consumption compared to a high-performance NVIDIA A6000 GPU. The architecture offers a unified, scalable, and energy-efficient platform for large-scale data analytics in both high-performance and edge-computing environments. I Introduction The end of Dennard scaling [ 16 ] and the slowing of Moore’s law [ 33 ] have made it difficult to meet the growing demands of modern day computational workloads. Modern day CPUs, though extremely fast in operation, are infeasible solutions to accelerate compute-intensive tasks due to their sequential nature. A major challenge in general purpose processors is that they are power hungry, as they offer support for multiple operations, have excessive precision support and a higher frequency of operations [ 14 ] . On the other hand, acceleration on Graphic Processing Units (GPUs) is largely constrained by very high power consumption and memory bottlenecks [ 21 ] , thus limiting their full utilization of compute cores [ 51 ] . Thus, there is a need to accelerate such workloads with domain specific architectures [ 20 ] . As a result, hardware acceleration has emerged as a promising solution to speed-up massively parallel tasks and extract very high performance [ 39 , 51 ] . Field Programmable Gate Arrays (FPGAs) have emerged as a primary platform for such tasks, offering gate-level reconfigurability and a high degree of parallelism. This enables rapid prototyping and the ability to implement highly optimized, domain-specific datapaths that are not constrained by the fixed instruction sets of general-purpose processors. Consequently, workloads accelerated on FPGAs show superior performance and energy efficiency compared to their general-purpose counterparts. Principal Component Analysis (PCA), is an important data mining technique used in several real world applications, such as image compression [ 18 ] , image classification [ 48 ] , facial detection [ 6 ] , neurosciences [ 44 ] and genomics [ 1 , 54 ] . PCA reduces the dimensionality of an input dataset by mapping it to a lower dimensional subspace. It involves the transformation of the dataset’s original features into a set of Principal Components, that maximally contain the variance of the input dataset while reducing the number of attributes [ 24 , 50 , 10 ] . The algorithm suffers from two bottlenecks: the computation of the Covariance matrix and Singular Value Decomposition (SVD). While software-based PCA implementations suffice for offline data analysis, they introduce non-deterministic latencies that are prohibitive for high-speed edge applications, such as autonomous drone navigation and real-time medical imaging. Existing general-purpose accelerators, such as mobile-GPUs, offer high peak throughput but often suffer from significant power overhead and memory bottlenecks during the iterative stages of eigendecomposition. Numerous attempts have been made to accelerate Principal Component Analysis [ 28 , 22 , 34 , 15 , 49 , 58 , 31 , 46 , 19 , 52 , 2 ] , employing different methods to expedite the computation of covariance matrix and singular value decomposition. Prior work however, have suffered high resource consumption and operate on fixed input matrix dimensions. In this work, we present a parametric architecture where accelerator performance can be tuned by adjusting parallelism ( S ) and tile size ( T ). While power dissipation naturally scales with these parameters, our baseline configuration of T=4 and S=8 achieves an low power profile of 1.271W on an Artix-7 FPGA, representing the lowest power consumption among the state of the art. The proposed work presents MANOJAVAM , a scalable and unified accelerator that integrates both matrix multiplication and SVD computation within a single architecture. The contributions of this work are as follows: • Unified Datapath: An accelerator that reuses its T\times T systolic array cores for covariance matrix computation and Jacobi rotations, reducing resource utilization on FPGAs • Integrated Jacobi Unit with DLE: The Jacobi unit features a Data Lookup Engine (DLE) which directly interfaces with the outputs of the covariance matrix to obtain the pivot elements in a single scan once the accumulation is complete. This removes the need for round trips to BRAM to extract these elements. The DLE also implements tile-aware filtering to ensure it looks up at valid output tiles in the search of the pivot elements. • Numerical Robustness and Deterministic Convergence: A systematic Frobenius-norm-based evaluation across diverse datasets to establish a deterministic 50-sweep iteration schedule. This provides a significant safety margin for ill-conditioned datasets while eliminating the hardware overhead of complex on-chip convergence monitoring logic. • Mode-Aware Memory Subsystem: A specialized two-tier cache hierarchy featuring two different cache write-miss policies to accommodate for distinct data patterns observed in covariance matrix computations and Jacobi rotations. • Multi-Platform FPGA Validation and Benchmarking: A comprehensive evaluation across the Artix-7 and the Virtex UltraScale+ FPGAs. Compared to a workstation-grade NVIDIA A6000 GPU, MANOJAVAM achieves up to a 28.2 \times speedup and over six orders of magnitude ( 1.3\times 10^{6}\times ) higher energy efficiency, while eliminating the non-deterministic software orchestration latencies native to GPU-based acceleration. II Literature Survey Principal Component Analysis (PCA) remains a computational bottleneck in real-time and resource-constrained environments due to the high arithmetic and memory demands of covariance computation and singular value decomposition (SVD). A wide body of research has focused on accelerating portions of this pipeline using FPGAs, yet most designs treat the covariance and decomposition stages in isolation. This section traces the evolution of PCA hardware acceleration by progressively analyzing the architectural approaches to (A) covariance matrix computation, (B) SVD and eigendecomposition, and (C) unified designs that attempt to integrate both stages. We also survey (D) algorithmic strategies that impact hardware parallelism and convergence, leading to (E) the motivation for MANOJAVAM . II-A Covariance Matrix Acceleration The