Towards Fast, Specialized Machine Learning Force Fields: Distilling Foundation Models via Energy Hessians
Ishan Amin, Sanjeev Raja ∗, and Aditi S. Krishnapriyan · 2025
Read Towards Fast, Specialized Machine Learning Force Fields: Distilling Foundation Models via Energy Hessians by Ishan Amin, Sanjeev Raja ∗, and Aditi S. Krishnapriyan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-09009.txt.
Description
Ishan Amin, Sanjeev Raja, and Aditi Krishnapriyan find a way to shrink large machine learning force fields into fast, narrow tools. Such fields predict the forces between atoms, and the new large foundation models do this well across many substances. Yet most users study only a small set of systems, and the big models run slow.
Their method trains a small student model to match the curves of the energy output from a big teacher model. The small models ran up to twenty times faster and kept, or even beat, the teacher's scores. One swap also kept energy steady in motion tests, a trait real lab work needs.
Catalog record
| CREATOR | Ishan Amin, Sanjeev Raja ∗, and Aditi S. Krishnapriyan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-09009