Frontier LLM-based agents can overcome the ontology curation bottleneck for natural phenotypes

James P. Balhoff, Hilmar Lapp · 2026

Read Frontier LLM-based agents can overcome the ontology curation bottleneck for natural phenotypes by James P. Balhoff, Hilmar Lapp (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28965.txt.

Description

James Balhoff and Hilmar Lapp test whether frontier language-model agents can take over phenotype annotation, the labor-heavy job of linking free-text trait descriptions to ontology terms. Given source papers, the annotation guide, four project ontologies, and a validation script, five agents from Anthropic and OpenAI repeat a 2018 benchmark. Every agent lands within the range of variation among three human curators, though the best agents fall just short of the best human. All five beat the older Semantic CharaParser tool on every metric.

Catalog record

CREATORJames P. Balhoff, Hilmar Lapp
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18718
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28965

Browse the full library · About the Tower of Babel