LIMCA: L LM for Automating Analog I n- M emory C omputing A rchitecture Design Exploration

Deepak Vungarala, Md Hasibul Amin · 2025

Read LIMCA: L LM for Automating Analog I n- M emory C omputing A rchitecture Design Exploration by Deepak Vungarala, Md Hasibul Amin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-13301.txt.

Introduction

Deepak Vungarala and co-authors let a language model design memory-computing chips in a 2025 paper. Analog in-memory computing runs neural math inside resistive crossbar arrays, promising speed and low power. Design is manual and expert-bound, and good circuit files are scarce. Their framework, LIMCA, needs no fine-tuning and no human in the loop.

The model writes circuit netlists, the wiring recipes simulators eat. An automated pipeline validates them for SPICE simulation. A structured data set steers the search across the design space. On a standard digit task, generated designs topped ninety-six percent accuracy while drawing at most three watts. The authors claim the first such language-model-driven exploration for this chip class. They pitch it as scalable, hardware-aware, and respectful of user-set trade-offs. Design time falls while quality holds.

Catalog record

CREATORDeepak Vungarala, Md Hasibul Amin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-13301

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LIMCA: L LM for Automating Analog I n- M emory C omputing A rchitecture Design Exploration Thanks: This work is supported in part by Synopsys Research Gift and the National Science Foundation (NSF) under grant no. 2228028, 2409697, and 2504839. Thanks: D. Vungarala, A. Ghosh, and S. Angizi are with the Department of Electrical and Computer Engineering, New Jersey Institute of Technology, NJ, USA. E-mail: {dv336,shaahin.angizi}@njit.edu. P. Mercati is with the Intel Corporation, Hillsboro, OR, USA. E-mail: [email protected]. M. H. Amin and R. Zand are with the Department of Computer Science and Engineering, University of South Carolina, SC, USA. E-mail: [email protected]. A. Roohi is with the Department of Electrical and Computer Engineering, University of Illinois Chicago, IL, USA. E-mail: [email protected]. D. Z. Pan is with the Department of Electrical and Computer Engineering, University of Texas at Austin, TX, USA. E-mail: [email protected]. Deepak Vungarala, Md Hasibul Amin Abstract In this paper, we introduce LIMCA , a novel fine-tuning-free Large Language Model (LLM)-driven framework for automating the design and evaluation of In-Memory Computing (IMC) crossbar architectures. Unlike traditional approaches, where the manual, knowledge-intensive design process and the lack of high-quality circuit netlists have significantly constrained Design Space Exploration (DSE) and optimization to behavioral system-level tools, LIMCA employs a No-Human-In-Loop (NHIL) automated pipeline to generate and validate circuit netlists for SPICE simulations, eliminating manual intervention. LIMCA systematically explores the IMC design space by leveraging a structured dataset and LLM-based performance evaluation. Our experimental results on MNIST classification demonstrate that LIMCA successfully generates crossbar designs achieving ≥ \geq 96% accuracy while maintaining a power consumption ≤ \leq 3W , making this the first work in LLM-assisted IMC DSE. Compared to existing frameworks, LIMCA provides an automated, scalable, and hardware-aware solution, reducing design exploration time while ensuring user-constrained performance trade-offs. Artifacts are open-sourced at https://github.com/ACADLab/LIMCA I Introduction The increasing complexity and computational demands of Deep Neural Networks (DNNs) have highlighted the limitations of traditional von Neumann architectures, particularly the memory wall bottlenecks in data movement between processing and memory units. To address this, Analog In-Memory Computing (IMC) crossbar architectures have emerged as a promising solution, offering the ability to perform computations directly within memory arrays, thereby significantly reducing data movement and energy consumption [ 1 ] . These architectures leverage the physical properties of resistive devices to store DNN weight parameters and perform matrix operations in the analog domain, enabling massive parallelization of DNN computations [ 2 ] . However, designing analog IMC systems presents unique challenges such as deep expertise in analog circuit design, an understanding of device physics, and careful consideration of various non-idealities such as parasitic effects, device variations, and noise [ 3 ] . Traditional analog IMC design approaches [ 1 , 4 ] rely on manual optimization and iterative refinement, making it difficult to explore the vast design space of possible implementations as shown in Table I . Furthermore, the lack of standardized tools and methodologies for IMC design has hindered rapid prototyping and evaluation of novel architectures. Recently, Large Language Models (LLMs) have shown success in digital design automation and hardware code generation [ 5 , 6 , 7 ] . The capability of LLMs in generating von Neumann architecture-based Artificial Intelligence (AI) accelerators has been recently explored [ 8 , 9 ] . Nevertheless, their potential to generate promising non-von Neumann architectures, such as resistive IMC crossbar systems that allow for parallel and efficient vector-matrix multiplication, has remained unexplored. This gap stems from the knowledge intensive hardware design process and the scarcity of high-quality datasets and circuit catalogs due to proprietary data [ 8 , 6 ] . TABLE I: State-of-the-art analog IMC simulation frameworks. Frameworks Type Design Space Exploration Support for PAA ∗ cons. Language Inference Accuracy NeuroSim [ 1 ] System Manual No C++ estimate MNSIM [ 2 ] System Manual No Python estimate AIHWKIT [ 4 ] System Manual No Python estimate CCCS [ 10 ] Circuit Manual No MATLAB-SPICE exact IMAC-Sim [ 11 ] Circuit Manual No Python-SPICE exact DPE [ 12 ] Circuit Manual No MATLAB estimate LIMCA Circuit Automated Yes Python-SPICE SPICE-char. ∗ Power-Area-Accuracy optimization. This work introduces the first LLM-driven automated design exploration framework for IMC crossbar architectures dubbed LIMCA to generate design under user defined Power, Area, and Accuracy (PAA) constraints as highlighted in Table I . The inherent challenges of IMC design including the need for precise circuit specifications, the consideration of complex analog behaviors, and the trade-offs among multiple competing objectives present both unique opportunities and challenges for LLM-based automation. Therefore, the core questions we seek to answer are the following– (RQ-1) Can we automate IMC design to address the growing shortage of specialized hardware in the semiconductor industry? (RQ-2) How can we deploy LLMs without cost-intensive fine-tuning? and can we effectively perform and evaluate Design Space Exploration (DSE)? (RQ-3) Can the major time consuming validation pipeline be fully automated? To answer these questions, this work presents the following contributions. (1) A DSE framework, LIMCA with Automatic Design Generation that leverages LLMs to map domain knowledge and introduces a fine-tuning-free approach for generating user-constrained designs from the space and generating the design of their choice. (2) LIMCA implements an automated validation strategy, eliminating human intervention, a No-Human-In-Loop (NHIL) approach ensuring efficient and scalable design evaluation. (3) An extensive open-source IMC dataset containing detailed variations of designs, along with PAA metrics for analog IMC. Beyond these contributions, LIMCA provides four unique capabilities that distinguish it from existing tools: (i) Natural Language DSE Interface users specify constraints in plain English rather than explicit parameter values; (ii) Autonomous Design Navigation unlike lookup-based approaches, LIMCA proposes design solutions for configurations not in the dataset by learning patterns from existing data points through In-Context Learning (ICL), then autonomously refining toward valid solutions via NHIL; (iii) Constraint Relaxation Negotiation when user constraints cannot be satisfied, LIMCA proposes alternative configurations with explicit trade-off explanations; and (iv) Self-Correcting Pipeline hold-out validation experiments demonstrate that LIMCA proposes solutions for 100% of queries on unseen configurations. II Background, Challenges, and Motivations LLM-Driven Hardware Design. LLMs have shown strong potential in automating Hardware Description Language (HDL) and High-Level Synthesis (HLS) code generation. Early works such as VeriGen [ 7 ] and ChatEDA [ 13 ] improve RTL-to-GDSII flows. ChipGPT [ 5 ] and Autochip [ 14 ] integrate LLMs for design generation and optimization, with Autochip refining Verilog through feedback. Dataset-driven frameworks have further advanced this direction. SA-DS [ 9 ] introduced an HLS dataset for DNN accelerators. Interactive approaches, such as Chip-Chat [ 15 ] , extend LLM applicability to DSE. Meanwhile, RTLLM [ 16 ] , GPT4AIGChip [ 8 ] , and VerilogReader [ 17 ] highlight efficiency improvements in design and coverage-driven code analysis. Domain-specific accelerator generation is addressed by only a few efforts. GPT4AIGChip [ 8 ] targets HLS flows. On the analog domain, AnalogCoder [ 18 ] , AnalogCoder-pro [ 19 ] , SPICEPilot [ 6 ] , and Masala-CHAI [ 20 ] pioneer SPICE-level netlist generation through ICL and agentic frameworks. Despite these advances, challenges remain. Most frameworks lack optimized prompting, tailored datasets, and model fine-tuning, while hallucination remains a persistent issue [ 13 , 9 ] . Addressing these limitations is key

Read the complete text