SMC-AI: Scaling Monte Carlo Simulation to Four Trillion Atoms with AI Accelerators

Xianglin Liu ∗†, Kai Yang ∗, Fanli Zhou, Yongxiang Liu, Hao Chen, Yijia Zhang, Dengdong Fan, Wenbo Li, Bingqiang Wang, Shixun Zhang, Pengxiang Xu †, Yonghong Tian · 2026

Read SMC-AI: Scaling Monte Carlo Simulation to Four Trillion Atoms with AI Accelerators by Xianglin Liu ∗†, Kai Yang ∗, Fanli Zhou, Yongxiang Liu, Hao Chen, Yijia Zhang, Dengdong Fan, Wenbo Li, Bingqiang Wang, Shixun Zhang, Pengxiang Xu †, Yonghong Tian (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08250.txt.

Introduction

Liu and 11 colleagues present SMC-AI, a framework extending SMC-X for efficient Monte Carlo runs on AI accelerators, including GPUs and NPUs, without losing scalability. Rapid deep learning progress reshapes hardware design toward AI tasks, challenging HPC workloads like atomistic simulation. SMC-AI on an NPU cluster achieves Monte Carlo simulation of 4 trillion atoms on 4096 dies. This is the largest ML-accelerated atomistic simulation, delivering 32 times the system size and 1.3 times the throughput of previous records, on a small budget.

Catalog record

CREATORXianglin Liu ∗†, Kai Yang ∗, Fanli Zhou, Yongxiang Liu, Hao Chen, Yijia Zhang, Dengdong Fan, Wenbo Li, Bingqiang Wang, Shixun Zhang, Pengxiang Xu †, Yonghong Tian
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47529
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.08250

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SMC-AI: Scaling Monte Carlo Simulation to Four Trillion Atoms with AI Accelerators Xianglin Liu ∗†, Kai Yang ∗, Fanli Zhou, Yongxiang Liu, Hao Chen, Yijia Zhang, Dengdong Fan, Wenbo Li, Bingqiang Wang, Shixun Zhang, Pengxiang Xu †, Yonghong Tian Abstract The rapid advancement of deep learning is reshaping the hardware design landscape toward AI tasks, posing fundamental challenges for HPC workloads such as atomistic simulation. Here we present SMC-AI, a general algorithmic framework that extends the SMC-X method for efficient canonical Monte Carlo simulation on AI accelerators, including GPUs and NPUs, while maintaining extreme scalability. The implementation of SMC-AI on an NPU cluster reaches unprecedented performance, achieving MC simulation of 4 trillion atoms on 4096 NPU dies. This represents the largest ML-accelerated atomistic simulation reported, delivering 32× system size and 1.3× throughput than previous records, with a relatively small computational budget. Excellent strong and weak scaling efficiency are reached for both the NPU and GPU implementation. By decoupling ML models from simulation, SMC-AI creates an abstraction that facilitates integration and porting of diverse ML models, laying a foundation for the future development of scalable scientific software. I Introduction The rapid advancement of deep learning has driven hardware design to prioritize AI workloads. A wide range of AI-specific accelerators has emerged, including Google TPU [ 23 ] , Huawei Ascend NPU [ 46 ] , Cerebras Wafer-Scale Engine [ 30 ] , and AWS Trainium [ 8 ] . At the same time, general-purpose processors, such as CPUs [ 31 ] and GPUs [ 2 ] increasingly incorporate AI-oriented features, including a larger number of tensor cores, low-precision arithmetic units, and bandwidth-optimized memory hierarchies. These designs favor high FLOPS and energy efficiency and provide opportunities for the reuse of highly optimized AI compute and interconnect infrastructure for high-performance computing (HPC) workloads. Together with the rapidly increasing cost of building flagship computing systems, it seems increasingly attractive, and sometimes inevitable, for scientific applications to run on hardware primarily designed for AI workloads. However, the architectural choices of AI accelerators often diverge from the needs of HPC applications, which generally have significantly different arithmetic intensity and memory access patterns [ 3 ] . Exploring strategies to overcome these challenges is, therefore, critical to enabling the next generation of HPC applications in the current age of AI. Among various HPC applications, a particularly important subfield is the use of ML surrogates to replace, and dramatically accelerate, the evaluation of quantum mechanics in atomistic simulation. A most well-known example is machine-learning interatomic potentials (MLIPs) [ 42 ] to accelerate first principles molecular dynamics. This method of ML-accelerated atomistic simulation has revolutionized molecular and material modeling [ 12 ] by combining high computational efficiency with near first-principles accuracy, offering performance comparable to classical empirical models while approaching the precision of first-principles methods such as density functional theory (DFT) [ 43 ] . This capability enables atomistic simulation to serve as a “computational microscope” [ 14 , 4 , 44 ] , allowing scientists to probe mesoscale phenomena at atomic resolution. Representative examples include virus capsid assembly [ 13 ] , plastic deformation in alloys [ 41 ] , and thermal transport in materials [ 45 ] . Currently, ML surrogates are typically integrated into atomistic simulations via heterogeneous computation: ML model inference runs on GPUs to harness high FLOPS, while the simulation runs on CPUs for atomistic position storage, updating, and input feature calculation. Some softwares adopt relatively coarse-grained coupling between CPU and GPU executions, which is a strategy to favor modular design, and makes the incorporation of MLIPs straightforward, as exemplified by the LAMMPS package’s porting of SNAP [ 22 ] , DeePMD [ 11 ] , and Allegro [ 13 ] models. However, such a benefit typically comes at the price of computational efficiency. For molecular dynamics (MD), there are recently developed software, such as GPUMD [ 7 ] , that adopts a more aggressive optimization strategy of offloading most work to GPUs to achieve higher speed, as shown in Tab. I . Similarly, for Monte Carlo (MC), the recently proposed SMC-X method [ 17 , 19 ] attains orders-of-magnitude speedup over CPU implementations [ 29 ] , due to both algorithmic innovations and fully executing ML inference and MC simulation on GPUs. Nevertheless, the original SMC-X algorithm is designed for general-purpose chips such as CPUs and GPUs, and thus faces fundamental challenges when ported to AI-specific chips. Moreover, the tight coupling design in SMC-X, while rendering it extremely efficient, makes it cumbersome to integrate with rapidly evolving ML models, which are becoming increasingly complex due to various physics-embedding schemes [ 1 ] . The main contributions are the following. First, we introduce the SMC-AI algorithm to address the above challenges. As a variant of the SMC-X algorithm, SMC-AI is designed to take advantage of the computational capability of AI-centric hardware architecture while retaining the excellent performance of SMC-X as much as possible. Second, through algorithm redesign, as well as a series of tailored optimization techniques, we demonstrate that SMC-AI scales efficiently on a large-scale NPU cluster, achieving a record-breaking simulation of 4 trillion atoms across 4,096 NPU dies. This yields a 32× increase in spatial scale and a 1.3× improvement in throughput over previous state-of-the-art ML-accelerated atomistic simulations, all with a much smaller computational budget, as shown in Tab. I . We further evaluate both strong and weak scaling of SMC-AI on NPUs and GPUs, and provide a performance analysis of the hotspot kernel, focusing on arithmetic intensity. Finally, using the proposed MLPNet as a representative example, we show that SMC-AI introduces a clean abstraction between ML models and the Monte Carlo core, providing a flexible foundation for integrating diverse models in future developments. TABLE I: Comparison of the performance of atomistic simulations (MC and MD) achieving DFT-level accuracy (10 meV/atom). Application Potential System Chips Machine Atoms Throughput (TP) (billion) (billion atom \cdot step/s) WL-LSMS [ 5 ] DFT Fe 36,866 Opteron Jaguar 0.000001 1.23\times 10^{-6} SNAP ML-IAP [ 22 ] SNAP C 27,900 V100 Summit 20 {28.9} DeePMD-kit [ 10 ] DeepPotential Cu 27,360 V100 Summit 3.4 9.09 DeePMD-kit [ 10 ] DeepPotential Cu 9,936 A64FX Fugaku 1.1 1.49 DeePMD-kit [ 10 ] DeepPotential H 2 O 27,360 V100 Summit 3.9 11.2 DeePMD-kit [ 10 ] DeepPotential H 2 O 9,936 A64FX Fugaku (part) 1.5 2.17 Allegro [ 13 ] Allegro HIV 5,120 A100 Perlmutter 0.1 12.7 DeePMD-kit [ 35 ] DeepPotential Cu 90,000 SW26010 New Sunway 13 6.67 DeePMD-kit [ 35 ] DeepPotential H 2 O 90,000 SW26010 New Sunway 29 {11.4} TensorMD [ 25 ] TensorMD W 16,000 AMD GPU ORISE 4 {11.6} TensorMD [ 25 ] TensorMD W 32,000 SW26010 New Sunway 51.8 {13.0} GPUMD [ 33 ] UNEP-v1 Cu 8 A100 cluster 0.1 {0.15} SMC-X [ 19 ] qSRO HEA 32 H800 cluster 128 1.17 SMC-AI (This work) MLPNet HEA 32 A100 cluster 32 {0.17} SMC-AI (This work) qSRO HEA 32 A100 cluster 32 {0.35} SMC-AI (This work) qSRO HEA 2,048 NPU cluster 4096 {\color[rgb]{1,0,0}37.7} II Background II-A SMC-X Monte Carlo (MC) and molecular dynamics (MD) are the twin pillars of atomistic simulation, each with unique advantages in simulating equilibrium and non-equilibrium system, respectively. While MD naturally fits

Read the complete text