HPC-AI Coupling Methodology for Scientific Applications
Yutong Lu, Dan Huang and Pin Chen · 2025
Read HPC-AI Coupling Methodology for Scientific Applications by Yutong Lu, Dan Huang and Pin Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01025.txt.
Introduction
Yutong Lu, Dan Huang, and Pin Chen organize the marriage of supercomputing and artificial intelligence into three coupling patterns. Traditional high-performance computing runs numerical simulations that are accurate but hungry; AI offers data-driven speed. Writing in twenty twenty-five, the authors sort joint applications by how the two halves interact. Surrogate, where a learned model stands in for expensive physics; directive, where AI steers the computation; and coordinate, where the two proceed in tandem and exchange information. Each pattern carries its own prerequisites and typical pairings.
Case studies from materials science show each pattern in action, with implementation details and measured improvements. The authors also catalog the technical frictions, from data movement to validation. Although the examples are materials-focused, they argue the patterns transfer to other sciences and can guide teams designing future hybrid discovery pipelines.
Catalog record
| CREATOR | Yutong Lu, Dan Huang and Pin Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-01025
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
HPC-AI Coupling Methodology for Scientific Applications Yutong Lu, Dan Huang and Pin Chen Abstract Artificial intelligence (AI) technologies have fundamentally transformed numerical-based high-performance computing (HPC) applications with data-driven approaches and endeavored to address existing challenges, e.g. high computational intensity, in various scientific domains. In this study, we explore the scenarios of coupling HPC and AI (HPC-AI) in the context of emerging scientific applications, presenting a novel methodology that incorporates three patterns of coupling: surrogate, directive, and coordinate. Each pattern exemplifies a distinct coupling strategy, AI-driven prerequisite, and typical HPC-AI ensembles. Through case studies in materials science, we demonstrate the application and effectiveness of these patterns. The study highlights technical challenges, performance improvements, and implementation details, providing insight into promising perspectives of HPC-AI coupling. The proposed coupling patterns are applicable not only to materials science but also to other scientific domains, offering valuable guidance for future HPC-AI ensembles in scientific discovery. keywords High performance computing, Artificial intelligence, Coupling methodology, Materials science application † † runninghead: Lu etc., † † affiliation: National Supercomputer Center in Guangzhou, School of Computer Science and Engineering, Sun Yat-sen University † † corresponding: Yutong Lu, Pin Chen 1 Introduction High-performance scientific and engineering computing has become an indispensable pillar that underpins scientific discovery, technology innovation, and large-scale engineering undertakings, positioning it as a critical element of national strategic capabilities [ 3 ] . Against this backdrop, recent successes of artificial intelligence (AI) in computer vision [ 28 ] and natural language processing [ 2 ] have catalyzed a growing convergence of AI methodologies with advanced computational frameworks. The trend of convergence has begun to reshape scientific and engineering computing paradigms: AI-driven approaches are increasingly deployed to accelerate large-scale simulations, optimize complex scientific workflows, and uncover intricate patterns within high-dimensional datasets [ 22 , 1 ] . Taken together, these developments signal a powerful trend towards the integration of AI with high performance computing (HPC) systems, fostering a new era in which data-intensive, intelligent computational strategies drive both transformative scientific insights and the accelerated design of innovative engineering solutions. As inquiries into multidisciplinary scientific and engineering problems are significantly growing in the aspects of complexity and scale, even reaching to extreme conditions, the technical challenges they present are escalating [ 14 ] . Conventional HPC strategies, while effective in traditional simulation paradigms, increasingly confront formidable hurdles, including the soaring computational costs of high-fidelity numerical methods for enhancing spatiotemporal resolution and significantly low efficiency of scaling simulations on next-generation supercomputing architectures [ 34 ] . As an alternative, AI approaches, which have demonstrated remarkable efficiency and flexibility, remain constrained by limited training data availability, insufficient generalization capability, and challenges related to accuracy and interpretability [ 39 ] . By bridging the two methodologies, the predictive rigor of HPC-based physics-driven simulations with the adaptive and data-intensive AI models, it offers a promising pathway towards a new computational research paradigm. By holistically combining HPC’s robust numerical foundations with AI‘s heuristic efficiency, researchers can overcome the respective shortcomings of each approach. Then, a sophisticated HPC-AI methodology stands poised to become essential in tackling the complex and imperative scientific and engineering challenges. This aims to facilitate scalable, high-dimensional simulations, accelerate the solution of intricate physical models, and eventually build novel systems for more efficient scientific discovery. Figure 1: Illustrating the three patterns of HPC-AI coupling. (1) Surrogate pattern: AI models are used to replace part of entire simulations. (2) Directive pattern: AI provides real-time guidance to HPC simulations, optimizing parameters or providing intermediate feedback. (3) Coordinate pattern: HPC and AI operate interactively, exchanging data and feedback to solve complex problems in tandem. In this study, we investigate the coupling of HPC and AI in order to overcome scientific discovery and engineering problems, proposing a methodology that encompasses three distinct coupling patterns: surrogate, directive and coordinate . Each pattern represents a distinctive coupling strategy, e.g. AI-driven approximations that serve as surrogates for complex applications with HPC-AI ensembles that coordinate computing resources and tasks. Through comprehensive case studies in materials science, we develop patterns that exemplify each interaction pattern, highlight specific implementation strategies, and address the associated challenges. Our results demonstrate significant performance improvements and provide insights into the promising potentials of HPC-AI coupling. The proposed patterns not only advance materials science research but also are broadly applicable to other scientific domains, offering valuable guidance for future HPC-AI ensemble applications in the pursuit of scientific discovery. The main contributions of this work are as follows: 1). To achieve more efficient and effective integration of HPC and AI, we propose a novel methodology comprising three distinct coupling patterns: surrogate, directive, and coordinate. 2). We develop and enhance HPC-AI ensemble applications by exemplifying each interaction pattern in the comprehensive case studies, highlighting implementation strategies and addressing the technical challenges (e.g. limitations in accuracy and scalability). 3). We demonstrate significant performance improvements in materials science applications, providing insights into the potential for future HPC-AI ensembles and offering applicable guidance for conducting HPC-AI driven researches across various scientific domains. 2 HPC-AI coupling Pattern In this section, we establish a fundamental methodology that characterizes the variety of HPC-AI coupling patterns: surrogate, directive, and coordinate . We also provide a rigorous mathematical framework to facilitate their understanding and application. Although HPC and AI have independently spurred significant advances in various domains, their integration method remains obscure and ad hoc, lacking well-defined patterns for guiding HPC-AI ensemble research and development. By scrutinizing the key operational principles, data handling protocols, and computational workflows, we distill these diverse HPC-AI coupling practices into three overarching patterns, each of which represents a distinct form of convergence between HPC’s computational rigor and AI’s adaptive, learning-driven models as shown in Fig. 1 . Specifically, in the surrogate pattern, AI models supplant portions or the entirety of traditional HPC numerical simulations, thereby reducing computational overhead while expediting predictive workflows. In the directive pattern, AI provides real-time guidance to HPC processes, offering parameter optimization and intermediate feedback to steer simulations toward high-value solutions. Finally, the coordinate pattern establishes an interactive collaboration between HPC and AI, where both systems continuously exchange data and insights to address intricate scientific challenges in concert. In the subsequent sections, we will present precise mathematical formulations to rigorously define these patterns and clarify the relationships among them. This structured approach lays the groundwork for a new generation of HPC-AI solutions that are with theoretical soundness and practical impact. 2.1 Surrogate Pattern In the surrogate pattern, AI models are trained on existing simulation data to replace compute-intensive components of the simulation. By learning an approximate mapping from input parameters to target outputs, AI-driven models serve as efficient alternatives to complex physics-based simulations used in HPC, significantly reducing compute time. Definition: • Let x\in X represent the input parameters of the simulation, and y\in Y denote the target outputs obtained from the HPC simulation. • f_{\text{HPC}}:X\rightarrow Y is the high-fidelity function employed in HPC simulations, typically computationally expensive. • f_{\text{AI}}:X\rightarrow Y is a data-driven surrogate model trained to approximate f_{\text{HPC}} by minimizing the discrepancy between their outputs. The objective is to find f_{\text{AI}} that best approximates f_{\text{HPC}} by minimizing a suitable discrepancy metric over the input distribution p(x) . For example, using the L2 norm, the optimization can