Tree of Concepts: Interpretable Continual Learners in Non-Stationary Clinical Domains
Dongkyu Cho, Xiyue Li, Samrachana Adhikari, Rumi Chunara · 2026
Read Tree of Concepts: Interpretable Continual Learners in Non-Stationary Clinical Domains by Dongkyu Cho, Xiyue Li, Samrachana Adhikari, Rumi Chunara (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17089.txt.
Introduction
Cho and three colleagues build Tree of Concepts, an interpretable continual-learning framework for shifting clinical data. A shallow decision tree defines a fixed rule-based concept interface, while a concept bottleneck model predicts those concepts from raw features. Updates touch only the concept extractor and label head, so concept meanings and explanations stay steady over time, beating replay-enhanced baselines on tabular healthcare benchmarks.
Catalog record
| CREATOR | Dongkyu Cho, Xiyue Li, Samrachana Adhikari, Rumi Chunara |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36301 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17089
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Tree of Concepts: Interpretable Continual Learners in Non-Stationary Clinical Domains Dongkyu Cho, Xiyue Li, Samrachana Adhikari, Rumi Chunara Abstract Continual learning aims to update models under distribution shift without forgetting, yet many high-stakes deployments, such as healthcare, also require interpretability. In practice, models that adapt well (e.g., deep networks) are often opaque, while models that are interpretable (e.g., decision trees) are brittle under shift, making it difficult to achieve both properties simultaneously. In response, we propose Tree of Concepts, an interpretable continual learning framework that uses a shallow decision tree to define a fixed, rule-based concept interface and trains a concept bottleneck model to predict these concepts from raw features. Continual updates act on the concept extractor and label head while keeping concept semantics stable over time, yielding explanations that do not drift across sequential updates. On multiple tabular healthcare benchmarks under continual learning protocols, our method achieves a stronger stability-plasticity trade-off than existing baselines, including replay-enhanced variants. Our results suggest that structured concept interfaces can support continual adaptation while preserving a consistent audit interface in non-stationary, high-stakes domains. 1 Introduction Machine learning systems deployed in practice operate under distributional change. Data distributions evolve across time, deployment sites, and user populations in ways that cannot be fully anticipated during training. Continual learning has emerged as a central paradigm to address this, aiming to adapt models to new data (plasticity) while preserving previously acquired knowledge (stability) ( 12 ) . Most successful continual-learning approaches rely on deep models that adapt effectively through fine-tuning or online updates. At the same time, many deployment settings impose a second requirement: interpretability ( 24 ) . In high-stakes domains such as healthcare, finance, and public policy, models must not only perform well but also expose reasoning that can be understood and audited by humans ( 25 ; 5 ) . In clinical use, this requirement is especially important because predictions can influence high-consequence decisions. These requirements are often in tension. Interpretable models are typically brittle under distribution shift and difficult to update continually. Decision trees, for example, can be sensitive to changes in feature distributions and often require retraining when new data arrives. Deeper models, conversely, learn robust representations that support adaptation, but do so through latent variables that are difficult to interpret. This tension is especially apparent in clinical settings, where shifts are common and safety requirements are strict ( 7 ) . Existing approaches usually optimize one side of this trade-off: continual adaptation without interpretability, or interpretability with weaker robustness under shift. In this work, we argue that the trade-off is not fundamental. We introduce Tree of Concepts , a framework that reconciles continual learning and interpretability by decoupling representation learning from decision logic. The core idea is to treat decision-tree leaves as a fixed, rule-defined concept vocabulary ( 13 ; 29 ) , and train a concept extractor to predict these concepts from raw features. Predictions are produced by a trainable concept-to-label head attached to this fixed concept interface. Because the concept vocabulary is fixed, explanation semantics remain stable across updates even as trainable components adapt to new slices. We evaluate on UCI Heart Disease ( 9 ) , CDC Diabetes Health Indicators ( 27 ) , and MIMIC-III ( 10 ) under continual-learning protocols. Across datasets, Tree of Concepts improves the stability–plasticity trade-off over strong baselines, including replay-enhanced variants ( 23 ) . Generalizable Insights about Machine Learning in the Context of Healthcare The results of this work highlight a general lesson for clinical machine learning. Clinical datasets routinely exhibit distribution shift and cohort heterogeneity, and these effects often intensify under sequential model updates. In this regime, optimizing plasticity with high-capacity latent representations can conflict with interpretability and repeatable auditing. Our findings suggest that keeping the explanation interface fixed while adapting internal predictive mappings is a practical way to balance adaptation and transparency in non-stationary, safety-critical settings. 2 Related Works Continual learning. Continual learning studies how to update models on sequential tasks or drifting streams while limiting catastrophic forgetting ( 12 ) . Representative families include regularization methods that protect parameters important for past tasks ( 12 ; 1 ; 11 ) , rehearsal methods that retain and replay exemplars ( 22 ) , and expansion-based approaches that add capacity to trade off stability and plasticity ( 28 ; 26 ) . Rehearsal is a standard strong baseline, but performance depends on buffer size and replay design ( 22 ; 31 ) , and replay-based training can dominate compute relative to raw storage in some regimes ( 19 ; 3 ; 8 ; 4 ) . Much of the literature targets deep architectures in vision and language, whereas tabular continual learning is comparatively less developed even though structured covariates are ubiquitous in operational systems. Recent studies examine continual learning for tabular data and show that mixed feature types, sparse interactions, and strong tree-based baseline can yield a different stability–plasticity profile than in perceptual domains ( 15 ; 6 ) . The gap matters for clinical risk modeling under temporal, demographic, and site shift. We highlight medicine as an underdeveloped but high-impact area for continual learning, and hospital-cohort studies show that replay plus regularization can improve retention for risk models ( 2 ) ; however, most clinical continual learning still emphasizes deep tabular predictors ( 14 ) or imaging ( 20 ) , with little focus on interpretable learners for non-stationary clinical tabular data. Concept bottleneck models. Concept bottleneck models (CBMs) were introduced as a framework that predicts human-interpretable concepts before predicting the final label, enabling concept-level explanations and test-time interventions while retaining competitive task performance ( 13 ) . Since then, a central issue in the CBM literature has been the concept labeling bottleneck: standard CBMs typically assume a predefined concept vocabulary together with dense concept annotations, which are expensive to obtain and difficult to scale. Several subsequent works address this limitation from different angles. Post-hoc CBMs show that a pretrained black-box model can be converted into a concept-based predictor after training, greatly reducing the performance penalty usually associated with concept supervision ( 30 ) . Label-free CBMs go further by removing the need for labeled concept data and automatically aligning model representations with interpretable concepts ( 17 ) , while Discover-then-Name relaxes the need to even specify the concept set in advance by automatically discovering and naming concepts learned by the model ( 21 ) . More recent work has continued to extend CBMs toward practical settings, including clinical knowledge-guided variants in medicine and continual-learning variants that aim to preserve semantic consistency of concepts across tasks ( 18 ; 24 ; 29 ) . However, these approaches are largely developed in visual or class-incremental settings, and they often rely on manually curated or externally aligned concepts. In contrast, our setting is non-stationary clinical tabular learning, where we derive the bottleneck from shallow decision-tree rules over structured features, yielding a fixed and human-auditable concept vocabulary that remains semantically stable across continual updates. 3 Problem Formulation In this section, we define the core problem addressed in this paper: interpretable continual learning under distribution shift. Specifically, we study supervised learning over a non-stationary stream of data slices D_{1},\dots,D_{T} , where each slice D_{t}=\{(x_{i}^{(t)},y_{i}^{(t)})\}_{i=1}^{n_{t}}