Leveraging AI for Productive and Trustworthy HPC Software: Challenges and Research Directions
Keita Teranishi, Harshitha Menon, William F. Godoy✉, Prasanna Balaprakash, David Bau, Tal Ben-Nun, Abhinav Bhatele, Franz Franchetti, Michael Franusich, Todd Gamblin, Giorgis Georgakoudis, Tom Goldstein, Arjun Guha, Steven E. Hahn, Costin Iancu, Zheming Jin, Terry Jones, Tze-Meng Low, Het Mankad, Na · 2025
Read Leveraging AI for Productive and Trustworthy HPC Software: Challenges and Research Directions by Keita Teranishi, Harshitha Menon, William F. Godoy✉, Prasanna Balaprakash, David Bau, Tal Ben-Nun, Abhinav Bhatele, Franz Franchetti, Michael Franusich, Todd Gamblin, Giorgis Georgakoudis, Tom Goldstein, Arjun Guha, Steven E. Hahn, Costin Iancu, Zheming Jin, Terry Jones, Tze-Meng Low, Het Mankad, Na (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08135.txt.
Introduction
Keita Teranishi and co-authors chart how artificial intelligence could reshape the writing of supercomputer software, in a 2025 paper. High-performance computing code is a niche craft: it must squeeze huge machines hard without breaking trust in the results. Language models have already changed everyday coding, yet this field's codes are rare, long, and steeped in physics and math.
The authors list where AI help snags on such code: scarce training stock, hard correctness bars, and hardware quirks no generic model knows. They then lay out research paths to make AI a productive and trustworthy partner here. Two United States energy department projects, Ellora and Durban, carry the work. The paper doubles as a field map, marking open problems for others. Its wager is that AI can speed expert coders rather than replace them.
Catalog record
| CREATOR | Keita Teranishi, Harshitha Menon, William F. Godoy✉, Prasanna Balaprakash, David Bau, Tal Ben-Nun, Abhinav Bhatele, Franz Franchetti, Michael Franusich, Todd Gamblin, Giorgis Georgakoudis, Tom Goldstein, Arjun Guha, Steven E. Hahn, Costin Iancu, Zheming Jin, Terry Jones, Tze-Meng Low, Het Mankad, Na |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08135
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Leveraging AI for Productive and Trustworthy HPC Software: Challenges and Research Directions Keita Teranishi, Harshitha Menon, William F. Godoy✉, Prasanna Balaprakash, David Bau, Tal Ben-Nun, Abhinav Bhatele, Franz Franchetti, Michael Franusich, Todd Gamblin, Giorgis Georgakoudis, Tom Goldstein, Arjun Guha, Steven E. Hahn, Costin Iancu, Zheming Jin, Terry Jones, Tze-Meng Low, Het Mankad, Narasinga Rao Miniskar, Mohammad Alaul Haque Monil, Daniel Nichols, Konstantinos Parasyris, Swaroop Pophale, Pedro Valero-Lara, Jeffrey S. Vetter, Samuel Williams, Aaron Young Abstract We discuss the challenges and propose research directions for using AI to revolutionize the development of high-performance computing (HPC) software. AI technologies, in particular large language models, have transformed every aspect of software development. For its part, HPC software is recognized as a highly specialized scientific field of its own. We discuss the challenges associated with leveraging state-of-the-art AI technologies to develop such a unique and niche class of software and outline our research directions in the two US Department of Energy–funded projects for advancing HPC Software via AI: Ellora and Durban. 1 Introduction As a key government investment, high-performance computing (HPC) has enabled unprecedented advances in science and engineering in recent decades. However, the future of HPC in the post-Moore era faces new challenges, including record-breaking costs in semiconductor manufacturing, an unprecedented number of AI workloads, tighter energy requirements and ever-increasing operational costs [ 10 , 35 ] . To fully leverage the capabilities of the latest generation of exascale systems, the US Department of Energy (DOE) made significant investments in a large, interoperable, and performance-portable HPC software ecosystem as part of the Exascale Computing Project (ECP, 2016–2023) [ 26 ] . These efforts included the Extreme-Scale Scientific Software Stack (E4S), 1 1 1 https://e4s.io/ which is now being supported by the DOE’s Advanced Scientific Computing Research (ASCR) program as it continues the development of the exascale software ecosystem. Nevertheless, programming, developing, and deploying robust, trustworthy, and verifiable HPC software has become a complex endeavor, with ever-increasing advancement costs required to meet the science-application needs on new heterogeneous systems and architectures [ 42 ] . AI technologies, in particular state-of-the-art large language models (LLMs), have shown incredible potential in a variety of software tasks [ 11 , 6 , 31 , 36 ] and can significantly improve programmer productivity [ 2 , 30 , 13 , 27 ] . For example, Meta reports that 99% of their developers use an internal LLM to discover APIs, accelerate their work, and generate 9%–17% of all code that they write [ 13 ] . However, advancements in state-of-the-art foundational LLMs, such as the Generative Pre-trained Transformer (GPT-3/4) [ 3 ] , Claude 3 [ 8 ] , and Llama-3 [ 1 ] , are driven mainly by industry needs. As a result, despite the popularity of general-purpose LLMs for writing code, our team’s pioneering research in this area showed that LLMs are far less effective at HPC programming tasks [ 33 , 34 , 32 , 15 , 41 , 17 ] because the data used to train the LLMs contains far fewer HPC-specific codes (i.e., there are simply fewer HPC codes vs. general software from which the LLMs can learn) [ 23 , 5 ] . This means that other runtime dimensions (e.g., parallel performance, portability, reproducibility of scientific results) are also not reflected in code/text sources or other AI training corpora. Integrating AI into HPC software development presents a transformative opportunity to enhance the efficiency, performance, and productivity of the entire software development life cycle. Fortunately, DOE’s ASCR program has recognized the need to explore the use of AI in advancing the next generation of HPC codes and launched the Advancements in Artificial Intelligence for Science program in 2024 by awarding $68 million to proposed research projects that leverage AI for scientific innovation. One key area is the “AI Innovations for Scientific Knowledge Synthesis and Software Development.” In this paper, we provide an overview of the characteristics of HPC software (Section 2 ), describe the challenges at the intersection of AI and coding for HPC (Section 3 ), and propose research directions for an impactful application of AI in the HPC software ecosystem (Section 4 ). We mainly focus on two important areas in which AI can revolutionize HPC software: productivity and performance portability. 2 Background on HPC Software HPC software has been the cornerstone of scientific discovery at scale for decades [ 12 ] . This history is built upon a rich legacy of advances in algorithms, math libraries, programming languages, and systems and standards that enable the actual utility provided by the fastest supercomputers in the world. In fact, given their niche nature, HPC codes are closer to scientific instruments than they are to general-purpose software, with their clear goals of advancing the state of the art in computational and computer sciences. Characteristics: Below are some of the unique characteristics of HPC software that must be understood before anyone can replicate—for HPC—the impact that AI has had in other software domains: • Massively parallel and scalable up to the largest supercomputers in the world • Vendor neutral/portable to new architectures • The vast majority is written in C, C ++ , and Fortran with ecosystem components in high-level languages (e.g., Python, R, Julia, Matlab) • Deep reliance on vendor software stacks such as CUDA and HIP for accelerator platforms • Low developers-to-users ratio (i.e., few developers, many users) • Complex and diverse ecosystem that includes algorithms, programming systems, runtime systems, compilers, tools, applications, libraries, workflows, network, I/O, packaging, and more • Requires knowledge of hardware specifications to balance compute, communication, memory, I/O • Correctness includes runtime characteristics such as performance, portability, scalability, reliability, and scientific accuracy • Driven by impact on scientific discovery, thus not necessarily prioritizing resources for general software use (e.g., documentation, training) • Developed by highly specialized individuals with multidisciplinary scientific backgrounds • Cutting-edge HPC software evolves significantly with every supercomputing architecture (e.g., distributed, many-core, GPU/hybrid) • HPC software has benefited from advancements in open-source technologies, although much of the mission-critical software is still classified or not publicly available • The vast majority is government funded (e.g., DOE) and does not have for-profit goals Requirements for modern software: HPC software relies on the broader software landscape (e.g., programming languages, vendor tools, runtimes). Hence, the HPC stack must evolve accordingly and alongside the broader software ecosystem to meet the post-Moore era’s requirements—including trustworthiness (e.g., memory-safety, robustness) [ 20 ] , reproducibility, maintainability, and energy-efficiency—and to align with national interests. Not meeting these requirements puts the field at risk in mission-critical scenarios, and the clearest example of vulnerability is the overwhelming reliance on Fortran [ 37 , 25 ] in legacy HPC codes. 3 AI Challenges for HPC Software State-of-the-art AI advancements present numerous opportunities to enhance HPC software. However, bridging HPC and AI requires a concerted effort from the community because it faces several well-documented challenges in scientific computing [ 4 ] . This section explores key challenges in leveraging AI across various aspects of HPC software. Code generation, translation, and optimization: State-of-the-art foundational LLMs are not trained to generate, translate, and optimize HPC code. The low-level features and software characteristics of even the most widely used libraries (e.g., math kernels,