BioDSA -1K: Benchmarking Data Science Agents for Biomedical Research
Zifeng Wang, Benjamin Danek *, Jimeng Sun · 2025
Read BioDSA -1K: Benchmarking Data Science Agents for Biomedical Research by Zifeng Wang, Benjamin Danek *, Jimeng Sun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16100.txt.
Description
Zifeng Wang, Benjamin Danek, and Jimeng Sun build a benchmark for biomedical data agents in 2025. Checking a scientific claim takes real data work, and AI agents still struggle with messy evidence. A fair test needs tasks drawn from genuine research, not toy problems.
Their set holds just over a thousand tasks drawn from more than three hundred published studies. Each task pairs a claim with an analysis plan and supporting data tables. Scoring covers the verdict, the evidence fit, the reasoning, and whether the agent's code runs. Some claims are deliberately unverifiable from the given data, mirroring real science.
Catalog record
| CREATOR | Zifeng Wang, Benjamin Danek *, Jimeng Sun |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-16100