AblateCell: A Reproduce-then-Ablate Agent for Virtual Cell Repositories

Xue Xia, Chengkai Yao, Mingyu Tsoi, Xinjie Mao, Wenxuan Huang, Jiaqi Wei, Hao Wu, Cheng Tan, Lang Yu, Yuejin Yang, Mengdi Liu, Siqi Sun, Zhangyang Gao · 2026

Read AblateCell: A Reproduce-then-Ablate Agent for Virtual Cell Repositories by Xue Xia, Chengkai Yao, Mingyu Tsoi, Xinjie Mao, Wenxuan Huang, Jiaqi Wei, Hao Wu, Cheng Tan, Lang Yu, Yuejin Yang, Mengdi Liu, Siqi Sun, Zhangyang Gao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19606.txt.

Introduction

Xia and colleagues introduce AblateCell, a reproduce-then-ablate agent for virtual cell repositories. Ablations are essential for tracing gains in AI Virtual Cells. Yet they are rarely done, because cell stores are under-standard and tightly coupled to domain data and formats. Recent coding agents translate ideas into code but stop there, lacking a checker that reproduces strong benchmarks and tests which parts truly matter. It first reruns published baselines end-to-end, setting up workspaces on its own and redoing official tests with open records.

Catalog record

CREATORXue Xia, Chengkai Yao, Mingyu Tsoi, Xinjie Mao, Wenxuan Huang, Jiaqi Wei, Hao Wu, Cheng Tan, Lang Yu, Yuejin Yang, Mengdi Liu, Siqi Sun, Zhangyang Gao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77792
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19606

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AblateCell: A Reproduce-then-Ablate Agent for Virtual Cell Repositories Xue Xia, Chengkai Yao, Mingyu Tsoi, Xinjie Mao, Wenxuan Huang, Jiaqi Wei, Hao Wu, Cheng Tan, Lang Yu, Yuejin Yang, Mengdi Liu, Siqi Sun, Zhangyang Gao Abstract Systematic ablations are essential to attribute performance gains in AI Virtual Cells, yet they are rarely performed because biological repositories are under-standardized and tightly coupled to domain-specific data and formats. While recent coding agents can translate ideas into implementations, they typically stop at producing code and lack a verifier that can reproduce strong baselines and rigorously test which components truly matter. We introduce AblateCell, a reproduce-then-ablate agent for virtual cell repositories that closes this verification gap. AblateCell first reproduces reported baselines end-to-end by auto-configuring environments, resolving dependency and data issues, and rerunning official evaluations while emitting verifiable artifacts. It then conducts closed-loop ablation by generating a graph of isolated repository mutations and adaptively selecting experiments under a reward that trades off performance impact and execution cost. Evaluated on three single-cell perturbation prediction repositories (CPA, GEARS, BioLORD), AblateCell achieves 88.9% (+29.9% to human expert) end-to-end workflow success and 93.3% (+53.3% to heuristic) accuracy in recovering ground-truth critical components. These results enable scalable, repository-grounded verification and attribution directly on biological codebases. 1 Introduction Recently, the advent of large language models (LLMs) ( 32 ; 3 ; 8 ) has demonstrated remarkable capabilities in natural language understanding, reasoning, and code generation. Building upon these advances, researchers have developed LLM-based autonomous agents by incorporating planning, tool use, and memory, enabling them to address increasingly complex real-world tasks ( 51 ; 13 ; 17 ) . These agents have demonstrated success across diverse domains, with recent advances enabling autonomous scientific discovery ( 44 ; 18 ) . In particular, multi-agent systems have focused on automating paper comprehension and code implementation, with representative works aiming to translate research ideas or method descriptions into executable programs ( 25 ; 39 ; 49 ) . However, as generated research ideas and codes become increasingly complex, reliably reproducing, isolating and evaluating their effective components remains an open and fundamental challenge in specialized scientific domains ( 15 ; 40 ; 57 ; 48 ) . Figure 1 : Motivation for AblateCell. Existing AI Agents scale idea synthesis but not idea attribution. Automated ablation bridges this gap by systematically verify which components truly matter. Moving from idea synthesis to idea attribution in scientific domains is non-trivial: the full reproduce-ablate-analyze pipeline frequently breaks at multiple stages , including reproduction, controlled repository edits, and domain-grounded reasoning. Firstly, the workflows may fail before reproduction, as MLR-Bench ( 7 ) reports that roughly 80% of automated experiments become invalid due to configuration and environment errors. Secondly, controlled ablation requires making precise, executable repository edits, while ResearchCodeBench ( 19 ) shows that even top LLMs succeed in implementing paper-level method changes in fewer than 40% of cases. Thirdly, designing informative ablations and interpreting their outcomes requires substantial domain knowledge (e.g., mapping scientific hypotheses to code modules and metrics), which general-purpose coding agents are not optimized for. Consequently, scientific ablation is still largely manual ( 10 ) and frequently omitted in practice ( 20 ) . Considering these challenges, we re-scope the problem to a setting that matches realistic agent capabilities : starting from a runnable baseline repository, we focus agents on controlled, isolated ablations–rather than end-to-end paper-to-executable re-implementation as in Paper2Agent ( 29 ) –to offload the code-learning burden from humans and enable scalable attribution. In this paper, we introduce AblateCell, an end-to-end reproduce-then-ablate agent that turns scientific ablation from a brittle manual process into a verifiable closed loop for AIVC repositories. AblateCell unifies paper grounding, baseline reproduction, and systematic ablation as a graph-based multi-agent execution process with explicit end-to-end coordination. It first establishes a verified baseline by auto-configuring environments, resolving dependency and data issues, and rerunning the official training and inference pipeline while emitting reproducible artifacts. It then performs closed-loop ablation via dynamic graph execution with adaptive sampling under a reward that trades off performance impact and execution cost, using isolated code mutation to prevent interference. We additionally construct a domain knowledge base by parsing AIVC papers and the original codebases, which grounds the ablation hypothesis proposal and supports agentic reasoning for evidence-based interpretation of ablation outcomes. Comprehensive evaluation on CPA, GEARS, and BioLORD shows that AblateCell autonomously completes reproduce-then-ablation studies with 88.9% success rate while identifying performance-critical components with 93.3% accuracy. Specifically, AblateCell attains 96.3% reproduction TSR (+26.9% vs. RepoMaster, +24.0% vs. human experts), 92.0% ablation TSR (+12.0% vs. human experts, +46.2% vs. Mini-SWE-Agent), and 88.9% end-to-end TSR (+29.9% vs. human experts). Our contributions are: • AblateCell : an end-to-end agentic verifier for AIVC single-cell perturbation repositories, achieving 96.3% reproduction TSR and producing verifiable artifacts. • A graph-based autonomous ablation engine with adaptive bandit sampling, isolated repo mutations, and domain-knowledge retrieval. • Comprehensive experiments show that AblateCell significantly outperforms existing agent baselines, achieving 88.9% end-to-end task success rate. 2 Related Work Figure 2 : Overview of the AblateCell reproduce-then-ablate framework. The system (i) reproduces baselines via planner-executor agents in Docker container, then (ii) conducts autonomous ablation by selecting hypotheses with bandit sampling and executing via graph-based workflow in isolated worktrees, guided by domain knowledge throughout. 2.1 Code Generation for Scientific Workflows Large language models (LLMs) have shown strong capabilities in automated code generation ( 53 ; 54 ; 35 ) and have been adapted to scientific workflows ( 39 ; 30 ) . Code-execution agents like SWE-agent and OpenHands incorporate repository interaction ( 50 ; 43 ) , but they are not tailored for scientific reproduction and ablation, particularly in handling domain-specific data formats and experimental workflows ( 21 ) . Additionally, emerging benchmarks have been proposed for reproduction verification ( 37 ; 16 ) and ablation planning ( 55 ; 1 ) , yet research-extension benchmarks report low end-to-end success rates ( 9 ) . 2.2 Autonomous Research Agents Autonomous research agents combine reasoning, tool use, and iterative execution to automate scientific workflows and produce verifiable research outputs ( 56 ; 12 ; 45 ) . Recent advancements range from knowledge-graph-driven multi-agent reasoning ( 11 ) to end-to-end research automation ( 49 ; 4 ) . In single-cell biology, recent work has explored LLM agents for annotation ( 28 ) , image segmentation ( 52 ) , and perturbation prediction ( 38 ) . Existing agents focus on forward research pipelines and lack systematic ablation capabilities ( 36 ) , motivating our reproduce-then-ablate framework that covers reproduction, hypothesis generation, and execution. 2.3 Virtual Cell Models Virtual cell models learn mappings from unperturbed molecular profiles to perturbed outcomes ( 6 ) . Existing perturbation predictors broadly fall into: (i) latent generative models (e.g., VAE-based) that encode cell state and perturbation effects for out-of-distribution generalization, often with disentangled factors for compositional inference ( 24 ; 5 ; 41 ; 23 ; 33 ) ; (ii) GNN-based methods that inject gene-regulatory or interaction priors for mechanistic prediction ( 34 ) ; and (iii) diffusion and transformer approaches that model complex state transitions or distributional shifts with large-scale pretraining ( 26 ; 14 ; 22 ; 2 ) . Accurate virtual cell models can reduce reliance on costly wet-lab experimentation and support

Read the complete text