AssayBench: An Assay-Level Virtual Cell Benchmark for LLMs and Agents
Edward De Brouwer, Carl Edwards, Alexander Wu, Jenna Collier, Graham Heimberg, Xiner Li, Meena Subramaniam, Ehsan Hajiramezanali, David Richmond, Jan-Christian Hütter, Sara Mostafavi, Gabriele Scalia, Genentech · 2026
Read AssayBench: An Assay-Level Virtual Cell Benchmark for LLMs and Agents by Edward De Brouwer, Carl Edwards, Alexander Wu, Jenna Collier, Graham Heimberg, Xiner Li, Meena Subramaniam, Ehsan Hajiramezanali, David Richmond, Jan-Christian Hütter, Sara Mostafavi, Gabriele Scalia, Genentech (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10876.txt.
Description
Edward De Brouwer and eleven colleagues introduce AssayBench, a benchmark for the virtual-cell dream of predicting cell responses without running the lab experiment. The test asks models to predict phenotypic screens, the visible outcomes of gene perturbations, from mixed text and assay inputs.
AssayBench builds on 1,920 public CRISPR screens across five broad phenotype classes. Each screen becomes a gene-ranking task, scored with an adjusted ranking metric that stays comparable across unlike assays. Extensive trials show where language models and agents stand today on this drug-discovery-relevant task. Builders of virtual cells get a standard, phenotype-first yardstick where none existed.
Catalog record
| CREATOR | Edward De Brouwer, Carl Edwards, Alexander Wu, Jenna Collier, Graham Heimberg, Xiner Li, Meena Subramaniam, Ehsan Hajiramezanali, David Richmond, Jan-Christian Hütter, Sara Mostafavi, Gabriele Scalia, Genentech |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58434 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10876