Improvise, Adapt, Overcome: An On-The-Fly Multifidelity Algorithm for Efficient Machine Learning
Vivin Vinod, Peter Zaspel · 2026
Read Improvise, Adapt, Overcome: An On-The-Fly Multifidelity Algorithm for Efficient Machine Learning by Vivin Vinod, Peter Zaspel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02662.txt.
Introduction
Vinod and Zaspel let a multifidelity learning scheme choose its own data mix as it trains. Machine learning has sped up quantum chemistry. Training data at high fidelity still costs too much to make. Multifidelity methods blend cheap low-grade data with a small set of high-grade data. Standard schemes fix the mix ratios in advance. That rigidity breeds waste. The new scheme asks for samples at each level as training unfolds.
The scheme first squeezes all it can from the cheap levels. Only when accuracy there saturates does it pay for costly reference runs. Tests span diverse chemical traits, including coupled cluster energies, a gold standard. Excitation energies pose a harder test. Data costs fall by up to a factor of 30 against single-level runs. Standard multifidelity baselines are beaten by up to a factor of 5. Cutting redundant data opens a low-cost path to high accuracy.
Catalog record
| CREATOR | Vivin Vinod, Peter Zaspel |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.02662
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improvise, Adapt, Overcome: An On-The-Fly Multifidelity Algorithm for Efficient Machine Learning Vivin Vinod, Peter Zaspel Abstract Machine learning has accelerated quantum chemistry but is hindered by the prohibitive cost of generating high fidelity training data. Multifidelity machine learning (MFML) mitigates this overhead by systematically combining abundant low fidelity data with sparse high fidelity data. In spite of its success, standard MFML schemes rely on pre-defined scaling factors to determine sparse data ratio across fidelities, often generating redundant multifidelity data resulting in a loss of efficiency. Here, we introduce an adaptive on-the-fly multifidelity framework for machine learning that autonomously determines training dataset composition. By dynamically querying training samples at each fidelity, the algorithm saturates model accuracy at lower fidelities before moving up to more expensive reference calculations. We benchmark the novel adaptive-MFML across diverse chemical properties including the computational chemistry gold standard coupled cluster energies, and the more chemically challenging excitation energies. In our numerical experiments we show that our adaptive algorithm reduces data generation costs by up to a factor of 30 compared to single fidelity methods and improves upon standard MFML by up to a factor of 5. The mitigation of data redundancy establishes a high-accuracy low-cost pathway for sustainable cost-aware machine learning in quantum chemistry. 1 Introduction In computational simulations, increasing the cost-budget typically yields higher accuracy, introducing the concept of fidelities relative to a ground truth 10 ; 9 . The cost-accuracy tradeoff is central in multifidelity methods where the aim is to achieve high-accuracy low-cost models by strategically combining outputs across fidelities. These methods often utilize data-driven surrogates, such as machine learning (ML) models, to comprehensively correct a low fidelity (computationally cheap) model to match the accuracy of the higher fidelity model at a much lower cost than running the higher fidelity model. Multifidelity methods have seen a wide range of applications ranging from geological sciences to fluid simulations 7 . The use of ML has significantly accelerated research in quantum chemistry (QC), replacing costly calculations with accurate predictions 6 ; 30 . However, these surrogate models require substantial training data and are usually restricted to the fidelity of the training data. This caveat has been of some discussion only in the recent past, with increasing notice being paid to this computational bottleneck. High accuracy reference data, such as the gold standard of Coupled Cluster with Singles, Doubles, and Perturbative Triples (CCSD(T)), scales prohibitively with system size as \mathcal{O}(N^{7}) 3 severely limiting the ML-QC workflow for high fidelity QC properties. Multifidelity machine learning (MFML) has emerged as a prominent solution to the training data cost bottleneck. Following the ansatz of standard multifidelity methods 10 ; 9 , the comprehensive correction of low fidelity ML models towards high fidelity QC predictions has been used successfully to predict properties ranging from ground state energies to excitation energies and bandgaps of solids showing significant reduction in the time-cost of the ML-QC pipeline 16 ; 13 ; 32 ; 23 ; 17 ; 22 . With increasing interest in sustainable chemical discovery and reducing computation footprint of ML in QC 18 , MFML methods have increasingly become popular not only for their prediction accuracy but also for their ability to reduce the computation cost incurred 4 ; 23 ; 26 . While the MFML methods are well established for small, isolated molecules 4 ; 27 , they also show great promise for scalability in extended molecular systems. Recent applications highlight this capability, ranging from simulating exciton energy transfer in a collection of 85-atom porphyrins on a clay surface for synthetic light-harvesting 11 to over 3.5 million point predictions of high fidelity excitation energies in a light harvesting complex of photosynthetic bacteria 12 . In spite of their success, standard MFML methods address data sparsity with increasing fidelity by relying on a fixed scaling factor to determine the ratio of training samples between two fidelities. Conventionally, the scaling factor is set to 2 32 ; 23 derived from legacy of sparse grid combination techniques 2 . Other fixed values of the scaling factor have been explored indicating that larger values improve the cost-benefit effectiveness of the MFML models 27 ; 11 . An alternate approach for the use of multifidelity methods in ML-QC introduced an ad-hoc heuristic to dictate training data set sizes across fidelities omitting the fixed scaling factor 4 . The scheme, hierarchical ML, uses several \Delta -ML models 16 and assumes a constant ratio of predictions between two \Delta -ML models for subsequent fidelities remains approximately constant. This scheme was shown to be effective in reducing training data costs for a specific isolated small molecule by a factor of 100. In such a setup, a noted constraint is that the constant ratio assumption breaks down for small training set sizes and requires a post-hoc optimization. Further, since the error is estimated, an a-posteriori calibration of the final trained model could be required. Ultimately, both fixed scaling factor MFML and ad-hoc estimated training dataset sizes fail to dynamically capture the true cost-benefit contribution of each fidelity during training the MFML model. Inevitably, this leads to an increased risk of redundancy of costly training data generation requiring manual post-hoc intervention. With cost-aware ML gaining traction in QC, there is a pressing need to develop robust adaptive schemes for the dynamic selection of optimal number of training samples per fidelity. Such an algorithm would not only minimize expensive training data generation but also relies on an on-the-fly computation of reference QC properties. Unlike conventional MFML approaches that require a-priori datasets across all fidelities, a truly adaptive sampling scheme queries QC reference calculations strictly on a need-to-know basis eliminating redundancy in the ML-QC pipeline by generating only the data necessary to improve the model. This work introduces a novel adaptive-MFML scheme that performs on-the-fly sampling of training data at each fidelity to minimize the empirical error of the resulting MFML model. Recursively adding training samples at each fidelity, the algorithm ensures the error reduction meets a user-defined threshold. We demonstrate in the following section that this new adaptive algorithm reduces the computation cost of ML-QC methods by several orders of magnitude compared to single fidelity methods, and improves on basic MFML baselines by a factor of 5 in some cases. The algorithm is shown to be robust and reduce redundancy. The broad applicability of the proposed adaptive-MFML framework across diverse QC properties is demonstrated by predicting properties ranging from ab initio potential energy surfaces (PES) to more complex excitation energies. 2 Results Figure 1: The conceptual workflow of adaptively selecting training samples at each fidelity. The local loop performs on-the-fly computations of QC properties for a given fidelity. Tolerance checks at each fidelity and at the global level, that is once all fidelities have been accessed once, ensure prevention of redundant training data generation. The conceptual workflow of the adaptive sampling framework for MFML models is depicted in Fig. 1 . The multifidelity training dataset is initialized using a few randomly sampled geometries with corresponding QC properties computed at varying fidelities. Across all experiments presented herein, we define four discrete fidelities, f\in\{1,2,3,4\} , with the initial dataset size N_{\rm train}=[32,16,8,4] , that is, 32 training samples at fidelity 1, 16 at fidelity