Scaling Machine Learning Interatomic Potentials with Mixtures of Experts

Yuzhi Liu, Duo Zhang, Anyang Peng, Weinan E, Linfeng Zhang, Han Wang · 2026

Read Scaling Machine Learning Interatomic Potentials with Mixtures of Experts by Yuzhi Liu, Duo Zhang, Anyang Peng, Weinan E, Linfeng Zhang, Han Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-07977.txt.

Description

Liu and colleagues scale machine learning interatomic potentials by testing Mixture-of-Experts and Mixture-of-Linear-Experts designs inside the DPA3 framework. They probe routing strategies and expert designs. Sparse activation combined with shared experts brings substantial gains, and nonlinear expert formulations beat linear ones when shared experts are present. Element-wise routing consistently beats configuration-level routing, while global routing often turns numerically unstable. The resulting element-wise model beats all DPA3-based baselines across the OMol25, OMat24, and OC20M benchmarks.

Catalog record

CREATORYuzhi Liu, Duo Zhang, Anyang Peng, Weinan E, Linfeng Zhang, Han Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37843
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.07977

Browse the full library · About the Tower of Babel