Are LLMs Good For Quantum Software, Architecture, and System Design?

Sourish Wawdhane, Poulami Das · 2026

Read Are LLMs Good For Quantum Software, Architecture, and System Design? by Sourish Wawdhane, Poulami Das (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26904.txt.

Introduction

Wawdhane and Das ask whether large language models can help design quantum computing systems. Quantum hardware still lacks mature software, architecture, and systems tools. That gap slows progress toward useful machines and demands rare expertise. The authors test nine frontier language models on quantum system reasoning problems. They compare the models' scores with those of graduate students at UT Austin. The case study ends with directions for research and engineering. The aim is faster, large-scale quantum system design.

Catalog record

CREATORSourish Wawdhane, Poulami Das
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE9775
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26904

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Are LLMs Good For Quantum Software, Architecture, and System Design? Sourish Wawdhane, Poulami Das Abstract 1 Introduction Quantum computers promise massive computational speedup for problems in many critical domains, such as physics, chemistry, cryptanalysis, healthcare, etc [ 5 , 6 , 10 ] . However, despite decades of research, they remain far from entering an era of utility . The lack of mature software, architecture, and systems solutions capable of translating quantum-mechanical properties of algorithms into physical state transformations on qubit devices remains a key factor underlying the slow pace of technological progress. Algorithmic research at the top, such as designing efficient algorithms to map applications or building quantum error correction (QEC) protocols to tolerate device errors, are largely limited to theoretical studies. In contrast, device level research at the bottom is either driven by industry that focus on a single qubit modality or academic labs that over-optimize qubit devices at a small scale; however, these optimizations are often fragile and tend to break down as system sizes increase. The problem worsens due to significant reliance on domain-specific expertise, especially for software developers, computer architects, and systems engineers. To address these limitations and accelerate large-scale high-performance quantum system design, we ask: Can large language models (LLMs) help with solving quantum software, architecture, and systems problems? 2 Background: A Case Study To answer this question, we perform a preliminary case study. We are the instructors (primary instructor and teaching assistant) for the "Introduction to Quantum Computing Systems" course at UT Austin [ 4 ] . This course: (1) introduces quantum computing basics to ECE/CS students, (2) familiarizes them with on-going research in the field (with particular emphasis on programming, compiler optimizations, architectural and systems models, based on recently published research papers at premier IEEE and ACM conferences, such as ISCA, MICRO, ASPLOS, HPCA, QCE), and (3) trains them to optimize quantum software and architecture. A critical component of the course focuses on in-class exams in which the students use their existing knowledge to solve quantum system design problems. The exam duration is one hour and thirty minutes and students are allowed to bring in calculators and a cheat-sheet written by themselves (although the students generally claim that cheat sheets are not so helpful for them to attempt the questions). For our case study, we take one of these exams and study the performance of different LLMs from OpenAI, Google, and Anthropic. Table 1 offers a detailed summary of these model families and versions. Table 1: Summary of LLMs used. For each provider and model family, we use two variants- a lightweight version for producing fast outputs and an advanced version with reasoning abilities. Provider Model Family Lightweight Reasoning OpenAI GPT [ 8 ] 5.3 5.4-Thinking Google Gemini [ 11 ] 3 Fast 3.1-Pro Anthropic Claude [ 2 ] Sonnet 4.6 Opus 4.6 The exam covered topics related fault-tolerant quantum systems, including trade-offs in QEC codes, decoder designs [ 1 , 3 ] , synchronizing QEC cycles [ 7 ] , and designing flag-proxy networks [ 12 ] . To compare the performance against human experts , we show the test scores of four student participants. Note that these students willingly participated in the study and FERPA laws are not violated. The performance of the models and students were both manually graded by the instructors. To measure performance, we use the exam score out of a total of 100 points. The exam, rubric, solutions, and exam scores are available at https://tinyurl.com/arellmsgoodatquantum . Figure 1: Performance of different large language model families for quantum reasoning tasks, especially related to software, architecture, and system design. Overall, all the model families perform well on the exam, especially the reasoning variants of each model. The performance also increases when assisted by a human expert. 3 Preliminary Results Figure 1 shows the performance (exam score) for different model configurations and compares against the performance of the students. We make the following observations. 1. All six LLMs used performed well with an average score of 57.33 . The minimum is 28 using the Gemini-3 Fast model while the maximum is 71 using the GPT-5.4 Thinking model. 2. Reasoning models outperform lightweight variants with an average score of 66 compared to 48.67 . Reasoning models increase scores by 1.3\times and 2.1\times respectively for the GPT and Gemini models, compared to only 1.1\times for the Claude models. GPT 5.4 Thinking used the largest reasoning traces (1m 57s without papers and 4m 18s with papers). Gemini Pro used 56s without papers and 1m 23 seconds with papers. In contrast, Claude reasoning models chose not to reason. 3. Assisting the reasoning LLMs to use relevant research papers [ 1 , 7 , 12 ] increases the average score further to 72.33 . The improvements are much more pronounced for the GPT and Claude models than the Gemini model. 4. The GPT models outperform the other two LLM families for each configuration and attains the overall highest score of 83 , outperforming the students by a significant margin. 5. LLMs performed poorly on a question requiring test-takers to map QEC codes to hardware. LLMs struggled to discover optimal mappings and reason about error masking. 4 Future: Quantum Systems Aided by AI Based on this preliminary case-study, we think research at the quantum and AI frontier is a promising and critical direction. A Promising Outlook: The overall performance of LLMs on the exam (which the instructors as well as the students consider to be significantly difficult) is promising and highlights the possibility of using LLMs to accelerate quantum software, architecture, and systems development. A fundamental research question on this front remains: how do we build agentic workflows specifically for quantum system design? Creating Quantum Specific LLMs: Modern day LLMs are primarily designed for coding tasks, content creation, summarization, Q&A settings. However, we lack LLMs specifically trained for quantum reasoning tasks. Creating dedicated models or fine-tuning existing LLMs have the potential to improve performance even further. We should spend research and engineering efforts into this stream to effectively use LLMs for quantum reasoning tasks. In particular, all the models used in our study show excellent performance in error decoder design questions in the context of QEC and surface codes. Accurate, fast, and scalable decoders are critical to enable QEC at scale. Using quantum-specific LLMs have the potential to further assist in their development. Need for Training Datasets: We understand that the current case-study is done in a very limited setting and requires more involved expert participation to refine the scope and assess the headroom for improvement. It also requires advanced training recipes to steer the model to generate more accurate and nuanced outputs. For example, a similar study designed and led by researchers from Harvard University along with participants from various top-ranked computer engineering programs [ 9 ] show that using curated datasets for computer architecture problems improve the reasoning capability of traditional LLMs. We anticipate a similar methodology to remain effective even for quantum reasoning tasks. We recommend concerted efforts in this space to expand the capabilities of LLMs for quantum tasks. Role of Human Experts Remain Critical: The performance of all three model families used in our case study improves when the reasoning

Read the complete text