Video-Based Reward Modeling for Computer-Use Agents

Linxin Song, Jieyu Zhang, Huanxin Sheng, Taiwei Shi, Gupta Rahul, Yang Liu, Ranjay Krishna, Jian Kang, Jieyu Zhao · 2026

Read Video-Based Reward Modeling for Computer-Use Agents by Linxin Song, Jieyu Zhang, Huanxin Sheng, Taiwei Shi, Gupta Rahul, Yang Liu, Ranjay Krishna, Jian Kang, Jieyu Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10178.txt.

Description

Linxin Song and coauthors judge computer use agents by watching execution videos instead of reading their internal steps. Scaling such checks is hard, since screens repeat heavily and success often hinges on tiny local cues. They build a large data set of video, task and reward triples, with adversarial instruction variants as negatives. Spatiotemporal token pruning strips redundant regions, and their fine tuned reward model beats strong proprietary rivals.

Catalog record

CREATORLinxin Song, Jieyu Zhang, Huanxin Sheng, Taiwei Shi, Gupta Rahul, Yang Liu, Ranjay Krishna, Jian Kang, Jieyu Zhao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58509
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.10178

Browse the full library · About the Tower of Babel