Pixelis: Reasoning in Pixels, from Seeing to Acting

Yunpeng Zhou · 2026

Read Pixelis: Reasoning in Pixels, from Seeing to Acting by Yunpeng Zhou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25091.txt.

Description

Zhou presents Pixelis, an agent that reasons by acting on pixels, not just by describing them. It works on images and video with a small tool set: zoom, crop, segment, track, read text, and find moments in time. Training runs in three stages. First it learns a tool grammar from worked traces. Then a curiosity and coherence reward shapes short, clean tool chains. At test time it adapts with no labels by voting over full action paths. Across six benchmarks it gains about four percent over its base model.

Catalog record

CREATORYunpeng Zhou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE96708
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25091

Browse the full library · About the Tower of Babel