When Active Learning Fails, Uncalibrated Out of Distribution Uncertainty Quantification Might Be the Problem
Ashley S. Dale, Kangming Li, Brian DeCost, Hao Wan, Yuchen Han, Yao Fehlis, Jason Hattrick-Simpers · 2025
Read When Active Learning Fails, Uncalibrated Out of Distribution Uncertainty Quantification Might Be the Problem by Ashley S. Dale, Kangming Li, Brian DeCost, Hao Wan, Yuchen Han, Yao Fehlis, Jason Hattrick-Simpers (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17760.txt.
Introduction
Ashley S Dale, Kangming Li, Brian DeCost, Hao Wan, Yuchen Han, Yao Fehlis, and Jason Hattrick-Simpers ask why active learning sometimes fails in materials discovery. In active learning, a model flags the samples it is most unsure about, and those get tested next, on the theory that they carry the most new information. If the uncertainty scores are badly calibrated, though, the campaign can chase the wrong samples.
The team compares uncertainty methods across ensembles of several model types on tasks such as solubility, band gap, and formation energy prediction. Calibration tricks that work on familiar data carry over unevenly to new kinds of material. Their finding is pointed: when a campaign stalls, poor uncertainty far from the training data may be the cause, not the search plan itself.
Catalog record
| CREATOR | Ashley S. Dale, Kangming Li, Brian DeCost, Hao Wan, Yuchen Han, Yao Fehlis, Jason Hattrick-Simpers |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-17760
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
When Active Learning Fails, Uncalibrated Out of Distribution Uncertainty Quantification Might Be the Problem Ashley S. Dale, Kangming Li, Brian DeCost, Hao Wan, Yuchen Han, Yao Fehlis, Jason Hattrick-Simpers Abstract Efficiently and meaningfully estimating prediction uncertainty is important for exploration in active learning campaigns in materials discovery, where samples with high uncertainty are interpreted as containing information missing from the model. In this work, the effect of different uncertainty estimation and calibration methods are evaluated for active learning when using ensembles of ALIGNN, eXtreme Gradient Boost, Random Forest, and Neural Network model architectures. We compare uncertainty estimates from ALIGNN deep ensembles to loss landscape uncertainty estimates obtained for solubility, bandgap, and formation energy prediction tasks. We then evaluate how the quality of the uncertainty estimate impacts an active learning campaign that seeks model generalization to out-of-distribution data. Uncertainty calibration methods were found to variably generalize from in-domain data to out-of-domain data. Furthermore, calibrated uncertainties were generally unsuccessful in reducing the amount of data required by a model to improve during an active learning campaign on out-of-distribution data when compared to random sampling and uncalibrated uncertainties. The impact of poor-quality uncertainty persists for random forest and eXtreme Gradient Boosting models trained on the same data for the same tasks, indicating that this is at least partially intrinsic to the data and not due to model capacity alone. Analysis of the target, in-distribution uncertainty, out-of-distribution uncertainty, and training residual distributions suggest that future work focus on understanding empirical uncertainties in the feature input space for cases where ensemble prediction variances do not accurately capture the missing information required for the model to generalize. Introduction Modern materials discovery [ 51 , 35 , 7 , 8 , 39 , 30 ] and drug discovery [ 20 , 16 ] commonly leverage uncertainty estimates in methods such as active learning [ 46 ] . In an active learning campaign, a model is trained using a small initial dataset, then data is iteratively added using a pre-defined acquisition policy. A common choice of acquisition policy chooses samples with high-uncertainty predictions to add to the training dataset; this approach to active learning is known as “exploration” [ 46 ] . In sparse-data regimes, e.g. an experiment where only a small number of samples can be created and characterized, a robust uncertainty estimate may differentiate between a model that is predictive and generalizable and one that is not [ 10 ] . In many cases, the uncertainty distribution used for active learning is presumed to be reliable based on previous knowledge of the model/data or mathematical modeling, and explicit calibration of the uncertainty is omitted. For example, random forest (RF) models have been evaluated and shown to have intrinsically calibrated uncertainty estimates [ 40 ] . Bayesian neural networks are designed a priori to have calibrated uncertainty estimates [ 28 ] . A successful active discovery campaign that leverages exploration is empirical evidence that the uncertainty estimates are meaningful [ 23 , 22 ] , especially when exploration is more successful than random selection. However, in the absence of explicit calibration validating the uncertainty estimates, there is a missed opportunity to understand and quantify subtle differences between the true data distribution and the uncertainty distribution learned by the model. Although some uncertainty estimates are useful in an uncalibrated state, other models suffer from miscalibration [ 52 , 44 ] , where the predicted uncertainty distribution is not consistent with the model accuracy and error distribution on testing set data. There is disagreement as to whether a particular method produces a reliable uncertainty estimate or not. For example, [ 40 ] report that calibrating the uncertainty of random forests may be unnecessary or detrimental, while [ 13 ] report that calibration is necessary. Deep ensemble approaches requires careful calibration to achieve a reliable uncertainty estimate, so that the quality of the uncertainty estimate may depend on the order that calibration method steps are applied [ 36 , 49 ] . A held-out test dataset is used in these cases to validate the uncertainty estimates after calibration, just as a held-out test dataset is used to validate model accuracy on unseen data. When the unseen data is in-distribution (ID) with respect to the training data, this is a reasonable approach. However, when the unseen data is out-of-distribution (OOD) and the researcher is pursuing generalization, we find that this approach may be invalid. Addressing potential miscalibration between ID and OOD data is therefore important to active learning methodologies, where the effect of acquiring non-optimal data may prevent the model from generalizing to unseen data or incur additional training costs. A good understanding of OOD uncertainty estimation is also relevant to a broader understanding of model generalizability and interpretability beyond active learning tasks. High predictive uncertainty on the training data suggests the model is underconfident and the predicted uncertainty is larger than the actual errors, while uncertainty estimates for test data that are smaller than the training data indicate overconfidence [ 43 ] . When underconfident or overconfident uncertainty estimates are reported as confidence intervals or error bars for predictions [ 43 ] , this can confuse interpretation of the final result. Reliably quantifying the uncertainty, even if it will not be further leveraged in an active learning campaign, is therefore a useful method of evaluating model performance beyond accuracy. The main contribution of this work is a study of uncertainty sources, calibration methods and the impact on the quality of information represented by the calibrated uncertainty estimate for three different tasks. To generate uncertainty estimates from a single pre-trained model, we sample the loss landscape to generate an ensemble of models and demonstrate that such methods behave comparably to uncertainty estimates from ensembles created by retraining the model using different random seeds. The uncertainty estimates are then calibrated using two different methods, including a novel approach using a neural network. We find that an initial, uncalibrated uncertainty estimate better captures the true uncertainty of OOD data, and that the use of uncertainty calibration models optimized for ID uncertainty distributions can degrade OOD uncertainty estimates. If the model has overfit to the training distribution, using ID data to perform uncertainty calibration decreases the generalizability of the model’s uncertainty estimates. We extend the analysis from neural networks to random forest and XGBoost models trained for the same task, and observe similar trends for OOD uncertainty. As a result, we consider the increased miscalibration of OOD data a property of the dataset and how the model is trained, rather than a property of any one model architecture. Finally, we show that the impact of uncertainty calibration is subtle, and cannot be understood by analyzing the prediction space alone. To summarize, we observe that for OOD data, inaccurate predictions correlate with uncalibrated uncertainties and common uncertainty calibration methods may worsen the situation. Figure 1 : Example use of a loss landscape to generate uncertainty predictions. After training, a model’s weights \theta are perturbed along orthogonal directions \alpha,\beta in the weight space. The perturbed model’s performance is quantified using the model loss, forming the loss landscape. Models with similar performance in the loss landscape are reserved. The average \mu_{\theta} and standard deviation \sigma_{\theta} of each