PhenoBench: A Comprehensive Benchmark for Cell Phenotyping

Fabian H. Reith *,1,2,4,5, Claudia Winklmayr *,4,5, Jérôme Lüscher *,4,5, Nora Koreuber *,1,4,5, Jannik Franzen *,1,3,4,5, Elias Baumann 6, Christian M. Schürch 7,8,9, Dagmar Kainmüller †,3,4,5, Josef Lorenz Rumberger †,2,4,5,🖂 · 2025

Read PhenoBench: A Comprehensive Benchmark for Cell Phenotyping by Fabian H. Reith *,1,2,4,5, Claudia Winklmayr *,4,5, Jérôme Lüscher *,4,5, Nora Koreuber *,1,4,5, Jannik Franzen *,1,3,4,5, Elias Baumann 6, Christian M. Schürch 7,8,9, Dagmar Kainmüller †,3,4,5, Josef Lorenz Rumberger †,2,4,5,🖂 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03532.txt.

Description

Claudia Winklmayr and co-authors set, in 2025 work, a bench for tools that name cell types in tissue slides. Big base models now read such slides, yet no one had graded their cell naming in one fair frame. Their bench pairs a new slide set, whose fourteen cell types were tagged by a second, richer scan kind, with ready code.

Top base models were run across shifts of two kinds: bench craft and true case mix. On old sets they scored high. On the new set, scores sank as low as a fifth of that — proof the old benches were too soft. The new set and code are free, posed as the field's next hard mark.

Catalog record

CREATORFabian H. Reith *,1,2,4,5, Claudia Winklmayr *,4,5, Jérôme Lüscher *,4,5, Nora Koreuber *,1,4,5, Jannik Franzen *,1,3,4,5, Elias Baumann 6, Christian M. Schürch 7,8,9, Dagmar Kainmüller †,3,4,5, Josef Lorenz Rumberger †,2,4,5,🖂
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-03532

Browse the full library · About the Tower of Babel