BRIDGE: Predicting Human Task Completion Time From Model Performance

Fengyuan Liu Jay Gala Nilaksh Dzmitry Bahdanau Siva Reddy Hugo Larochelle · 2026

Read BRIDGE: Predicting Human Task Completion Time From Model Performance by Fengyuan Liu Jay Gala Nilaksh Dzmitry Bahdanau Siva Reddy Hugo Larochelle (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07267.txt.

Description

Benchmark scores are hard to translate into human terms: what does a model score mean in hours a person would need? Fengyuan Liu and five co-authors build BRIDGE, a psychometric method that learns a latent difficulty scale from model responses and anchors it to human task completion time.

A two-setting item response model jointly figures task difficulty and model capability, and difficulty turns out to vary linearly with the logarithm of human completion time. That lets the method predict human time for new benchmarks from model results alone and forecast frontier capabilities in human terms. Evaluators get a bridge, as the name promises, between leaderboard numbers and real effort.

Catalog record

CREATORFengyuan Liu Jay Gala Nilaksh Dzmitry Bahdanau Siva Reddy Hugo Larochelle
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07267

Browse the full library · About the Tower of Babel