Scaling Machine Learning Interatomic Potentials with Mixtures of Experts
Yuzhi Liu, Duo Zhang, Anyang Peng, Weinan E, Linfeng Zhang, Han Wang · 2026
Read Scaling Machine Learning Interatomic Potentials with Mixtures of Experts by Yuzhi Liu, Duo Zhang, Anyang Peng, Weinan E, Linfeng Zhang, Han Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-07977.txt.
Description
Liu and colleagues scale machine learning interatomic potentials by testing Mixture-of-Experts and Mixture-of-Linear-Experts designs inside the DPA3 framework. They probe routing strategies and expert designs. Sparse activation combined with shared experts brings substantial gains, and nonlinear expert formulations beat linear ones when shared experts are present. Element-wise routing consistently beats configuration-level routing, while global routing often turns numerically unstable. The resulting element-wise model beats all DPA3-based baselines across the OMol25, OMat24, and OC20M benchmarks.
Catalog record
| CREATOR | Yuzhi Liu, Duo Zhang, Anyang Peng, Weinan E, Linfeng Zhang, Han Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37843 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.07977