Agentic-imodels : Evolving agentic interpretability tools via autoresearch
Chandan Singh, Yan Shuo Tan, Weijia Xu, Zelalem Gero, Weiwei Yang, Michel Galley, Jianfeng Gao · 2026
Read Agentic-imodels : Evolving agentic interpretability tools via autoresearch by Chandan Singh, Yan Shuo Tan, Weijia Xu, Zelalem Gero, Weiwei Yang, Michel Galley, Jianfeng Gao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03808.txt.
Introduction
Chandan Singh and six co-authors introduce Agentic-imodels, an automated research loop that evolves data-science tools to be interpretable by artificial intelligence agents rather than by humans. Agentic data science systems increasingly analyze and fit data autonomously, yet they still use statistical tools designed for human readers. The loop develops a library of scikit-learn-compatible regressors for tabular data.
The evolved models are optimized for predictive performance and for a new interpretability metric graded by language models. The metric tests whether a model's string representation can be simulated by a model reader. The reader answers questions about the model's behavior. The evolved regressors improved both scores, generalized to new datasets and tests, and raised downstream performance of several agent systems on the BLADE benchmark.
Catalog record
| CREATOR | Chandan Singh, Yan Shuo Tan, Weijia Xu, Zelalem Gero, Weiwei Yang, Michel Galley, Jianfeng Gao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.03808
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Agentic-imodels : Evolving agentic interpretability tools via autoresearch Chandan Singh, Yan Shuo Tan, Weijia Xu, Zelalem Gero, Weiwei Yang, Michel Galley, Jianfeng Gao Abstract Agentic data science (ADS) systems are rapidly improving their capability to autonomously analyze, fit, and interpret data, potentially moving towards a future where agents conduct the vast majority of data-science work. However, current ADS systems use statistical tools designed to be interpretable by humans, rather than interpretable by agents. To address this, we introduce Agentic-imodels , an agentic autoresearch loop that evolves data-science tools designed to be interpretable by agents. Specifically, it develops a library of scikit-learn -compatible regressors for tabular data that are optimized for both predictive performance and a novel LLM-based interpretability metric. The metric measures a suite of LLM-graded tests that probe whether a fitted model’s string representation is ‘‘simulatable’’ by an LLM, i.e. whether the LLM can answer questions about the model’s behavior by reading its string output alone. We find that the evolved models jointly improve predictive performance and agent-facing interpretability, generalizing to new datasets and new interpretability tests. Furthermore, these evolved models improve downstream end-to-end ADS, increasing performance for Copilot CLI, Claude Code, and Codex on the BLADE benchmark by up to 73%. 1 1 1 All code for reproducing and adapting Agentic-imodels is made available at github.com/csinva/agentic-imodels . We additionally release the final library of Agentic-imodels we develop as a Python package / agent skill for easy integration into ADS workflows. 1 Introduction The data-science lifecycle has historically been a human-centered process end-to-end: a human defines the question, carries out the analysis using interpretable tools, and communicates the findings. As agentic data science (ADS) systems grow more capable, intermediate analytical steps are increasingly delegated to agents, e.g. selecting models, interpreting coefficients, and drawing conclusions [ 20 , 46 , 12 ] . This improvement in capabilities may be critical in accelerating scientific discovery [ 72 , 37 ] , and in tackling emerging issues such as scalable oversight of AI systems [ 8 , 21 ] . However, the performance of ADS systems is limited by their tools for working with and interpreting data: existing interpretability tools/models and their accompanying implementations produce outputs designed to be read by humans, often containing visualizations or intervenable components that may be difficult for agents to parse [ 55 , 43 , 9 , 69 , 63 , 47 ] . This mismatch can derail ADS systems, leading to unreliable analysis [ 3 , 52 ] and obscured analytical choices [ 38 , 64 ] . This emerging problem leads us to rethink interpretability in the modern era: rather than designing data-science tools to be interpretable by humans, we aim to design tools that are interpretable by agents . Doing this requires adapting the rich literature on human-centered interpretable machine learning [ 28 , 26 , 14 ] , which has yielded interpretable models such as decision trees, generalized additive models, and rule lists [ 55 ] . This field has traditionally quantified interpretability in terms of concepts such as simulatability, sparsity, and modularity [ 35 , 55 , 43 ] , ideally followed by quantitative evaluation with human experiments [ 29 , 14 ] . In our setting, we replace these human experiments with tests that measure whether an LLM can accurately simulate the model’s behavior in terms of predictions, feature effects, and counterfactuals solely by reading its string representation. These LLM-based tests provide a key practical advantage: they enable computing an agent interpretability score for any model without the need for human experiments. We use this agent interpretability score to guide the automated design of new interpretable models. To do so, we propose Agentic-imodels , an autoresearch loop that prompts a coding agent (e.g. Claude Code) to iteratively modify a Python class so it simultaneously achieves a high interpretability score and strong predictive performance ( Fig. 1 a). The loop consists of the coding agent generating candidate model modifications, which are then evaluated using the interpretability score and predictive performance metrics across a large suite of tabular datasets. The coding agent uses these metrics to refine the model, generating new candidate modifications and repeating the evaluation process until the model achieves a user-specified balance of predictive performance and interpretability. a b Figure 1 : (a) Overview of the Agentic-imodels autoresearch loop, which optimizes a Python class for predictive performance and agent interpretability (evaluated through LLM-based simulatability tests). (b) The discovered Agentic-imodels (blue points) improve the Pareto frontier of predictive performance and interpretability over baselines from the literature. See evaluation details in Section 4.2 . In our experiments, we use Agentic-imodels to build scikit-learn -compatible regressors for tabular data. We run the loop on a suite of 65 tabular datasets with both Claude Code and Codex, and find that it discovers new model classes that push the interpretability-performance frontier beyond a wide range of existing baselines ( Fig. 1 b), even for held-out datasets and new interpretability tests ( Section 4.2 ). They are also useful downstream: equipping four different ADS agents with the evolved models improves their performance on the BLADE end-to-end benchmark [ 19 ] by 8%–73% over standard interpretability tools ( Section 4.3 ). Qualitatively, we find that the evolved Agentic-imodels combine existing algorithms in novel ways and present themselves in forms amenable to agent interpretation ( Section 4.4 ). 2 Related work Interpretable machine learning. Interpretable models, those whose reasoning can be directly understood by humans, have long been advocated as preferable to post-hoc explanations of black-box models [ 55 , 54 , 43 ] . Prominent model families include decision trees [ 9 , 51 ] , rule lists [ 32 ] , generalized additive models (GAMs) [ 24 , 36 , 11 ] , and sparse linear models [ 71 ] , implemented in popular packages such as imodels [ 63 ] and interpretML [ 47 ] . More recent approaches use LLMs to build interpretable models, e.g. Aug-imodels hand-designs methods to build an interpretable model from an LLM [ 60 ] , and alternative works train transformers to directly produce an interpretable model, e.g. [ 41 , 82 ] . Our work extends this ecosystem by using agents to discover new agent-interpretable model classes. Agentic data science (ADS). A rapidly growing literature studies how well coding and reasoning agents can conduct end-to-end data analysis, primarily by measuring agent capability on new benchmarks [ 46 , 12 , 33 , 65 , 34 , 20 ] , and by documenting ADS failure modes such as LLM-assisted p -hacking [ 3 ] , missing sanity checks [ 52 , 64 , 44 ] , and unreliable LLM-driven annotation of data and findings [ 6 , 70 , 38 ] . A parallel thread design methods that use agents to directly describe data [ 79 , 4 , 81 , 40 ] or describes features of a pre-trained foundation model [ 7 , 61 , 22 , 58 ] . In both threads the agent relies upon human-designed interpretability methods. In contrast, we treat the coding agent as a designer of those methods, by having it directly optimize a model for LLM-graded interpretability. Automated model discovery and autoresearch.