Stochastic Encodings for Active Feature Acquisition
Alexander Norcliffe, Changhee Lee, Fergus Imrie, Mihaela van der Schaar, Pietro Liò · 2025
Read Stochastic Encodings for Active Feature Acquisition by Alexander Norcliffe, Changhee Lee, Fergus Imrie, Mihaela van der Schaar, Pietro Liò (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01957.txt.
Introduction
Alexander Norcliffe and co-authors improve, in a 2025 paper, active feature acquisition: the task of choosing, case by case, which measurement to buy next when each test costs something. Common methods either learn by trial and error, which trains poorly, or greedily grab the most informative next test, which can be shortsighted.
Their model reasons in a hidden space of chance. For each new case, it imagines many possible values for unmeasured features and picks the test that pays off across those futures. Trained directly with labels, the method beat a wide range of rivals on synthetic and real data sets, from medical style tasks to general prediction problems.
Catalog record
| CREATOR | Alexander Norcliffe, Changhee Lee, Fergus Imrie, Mihaela van der Schaar, Pietro Liò |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 101 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-01957
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Stochastic Encodings for Active Feature Acquisition Alexander Norcliffe, Changhee Lee, Fergus Imrie, Mihaela van der Schaar, Pietro Liò Abstract Active Feature Acquisition is an instance-wise, sequential decision making problem. The aim is to dynamically select which feature to measure based on current observations, independently for each test instance. Common approaches either use Reinforcement Learning, which experiences training difficulties, or greedily maximize the conditional mutual information of the label and unobserved features, which makes myopic acquisitions. To address these shortcomings, we introduce a latent variable model, trained in a supervised manner. Acquisitions are made by reasoning about the features across many possible unobserved realizations in a stochastic latent space. Extensive evaluation on a large range of synthetic and real datasets demonstrates that our approach reliably outperforms a diverse set of baselines. 1 Introduction The standard supervised learning paradigm is to learn a predictive model using a training dataset of features and labels, such that the model can make accurate predictions on unseen test inputs. A fundamental assumption is that, at test time, all features are jointly available. However, this assumption does not always hold. Consider the example of a doctor diagnosing a patient ( Kachuee et al. 2019b ; Kachuee et al. 2019a ) . Initially, there is little to no information available and, while there are many tests that could be conducted, the doctor will choose which ones to carry out based on their current understanding of the specific patient’s condition. For instance, if a patient has pain in their leg, and the doctor suspects a fracture, a leg X-ray might be prioritized. Active Feature Acquisition (AFA) 1 1 1 This problem has also been referred to as Dynamic Feature Selection (DFS). is an inference time task, where the features are not assumed to be all available at once. Instead, on an instance-wise basis, a model sequentially acquires features based on the existing observations to best aid long-term prediction. A common approach is to use Reinforcement Learning (RL) ( Rückstieß et al. 2013 ; Shim et al. 2018 ) , since this is a natural solution to a sequential decision making problem. However, RL suffers from training difficulties such as sparse reward, exploration vs exploitation, and the deadly-triad ( Henderson et al. 2018 ; Erion et al. 2022 ; Van Hasselt et al. 2018 ) . An alternative approach is to select features that greedily maximize the conditional mutual information (CMI) ( Chen et al. 2015a ; Chen et al. 2015b ) . This has a significant drawback: CMI does not capture the effects of unobserved features that can be acquired at a later stage. This results in myopic decision making that favors immediate predictive power over sets of jointly informative features, or features that are highly informative of which feature to acquire next. Additionally, we argue that CMI is not even guaranteed to be the best short-term objective from the perspective of the 0-1 Loss (making a single decisive prediction). Since maximizing CMI is equivalent to minimizing entropy, and this can be achieved by making unlikely classes even more unlikely, rather than distinguishing between more probable outcomes. We further explore the drawbacks of CMI in Section 4 . Motivated by the shortcomings of RL and CMI maximization, we introduce a novel AFA approach, which we call S tochastic E ncodings for F eature A cquisition ( SEFA ), that departs from existing methods in several key ways. First, we shift the acquisition problem from reasoning in a complex feature space to a latent space. We use an information bottleneck-inspired term ( Tishby et al. 1999 ) to regularize the latent space such that decisions are made using label-relevant information only and not noise associated with the features. Second, we use stochastic encoders, allowing us to acquire features by considering their effect across a diverse range of possible latent realizations. This allows us to capture the effects of features that are yet to be observed, resulting in acquisitions that are non-greedy by design. Third, our acquisition objective places more focus on labels with higher predicted likelihood, leading to acquisitions that help to disambiguate between the most likely classes. Finally, to avoid the difficulties posed by RL, we do not train our model to make acquisitions directly. Instead, we train with a predictive loss and make acquisitions by maximizing a custom objective in a suitably regularized latent space. Our contributions are as follows: (1) We re-examine the CMI acquisition objective and provide theoretical reasoning and concrete examples of its sub-optimality. (2) We introduce SEFA, our novel AFA approach motivated by the limitations of RL and CMI maximization. (3) We evaluate SEFA on multiple synthetic and real-world datasets, including cancer classification tasks. Comparing against various state-of-the-art AFA baselines, we see that SEFA consistently outperforms these methods. Extensive ablations further demonstrate each novel design choice is required for the best performance. 2 Related Work Reinforcement Learning. The most common AFA approach is to frame the problem as a Markov Decision Process and train a policy network with RL to decide which feature to acquire next ( Dulac-Arnold et al. 2011 ; Rückstieß et al. 2013 ; Shim et al. 2018 ; Janisch et al. 2019 ; Mnih et al. 2014 ; Kachuee et al. 2019a ) . The RL approach readily extends to a temporal setting where features and labels can change over time ( Kossen et al. 2023 ; Yin et al. 2020 ) . Whilst a natural solution to AFA, RL suffers from training difficulties, and various advances in the RL field have been applied to account for this. For example, using generative models to augment datasets ( Zannone et al. 2019 ) , providing mutual information as additional input to the policy ( Li & Oliva 2021 ) , using gradient information in the training process ( Ghosh & Lan 2023 ) , and reward shaping ( Peng et al. 2018 ) . Conditional Mutual Information Maximization. Conditional mutual information tells us how much we can learn about one variable by measuring a second, whilst already knowing a third. Greedy CMI maximization is a common AFA approach, due to its grounding in information theory. However, as we demonstrate in Section 4 , it inherently makes short-term acquisitions and is prone to making acquisitions that do not distinguish between likely labels. Among existing approaches, networks can be trained to directly predict CMI ( Gadgil et al. 2024 ) , or policy networks can be specially trained to maximize CMI without ever calculating it ( Chattopadhyay et al. 2023 ; Covert et al. 2023 ) . Generative models are a second way to estimate CMI by taking Monte Carlo estimates over conditional distributions, ( Ma et al. 2019 ; Chattopadhyay et al. 2022 ; Rangrej & Clark 2021 ; Early et al. 2016 ) . This approach suffers from associated generative modeling challenges, producing poor estimates of CMI, thus adding to the limitations. Improved performance can be achieved with advances in generative modeling ( Peis et al. 2022 ; He et al. 2022 ; Li et al. 2020 ; Li & Oliva 2020 ) . Alternative Solutions. Sensitivity-based solutions make selections based on how sensitive the label is to a given feature