Enhancing Geometric Perception in VLMs via Translator-Guided Reinforcement Learning

Hao Yu Shuning Jia Guanghao Li Wenhao Jiang Chun Yuan, [.6em] Tsinghua University · 2026

Read Enhancing Geometric Perception in VLMs via Translator-Guided Reinforcement Learning by Hao Yu Shuning Jia Guanghao Li Wenhao Jiang Chun Yuan, [.6em] Tsinghua University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22703.txt.

Description

Hao Yu and four co-authors sharpen geometric perception in vision-language models, a known weak spot. These models often misread basic diagram parts, yet past fixes blurred perception and reasoning together. The team splits them apart with GeoPerceive, a benchmark pairing diagram cases with domain-specific language descriptions plus an automatic data pipeline.

GeoDPO, their translator-guided reinforcement learning method, trains a natural-language-to-DSL translator on synthetic pairs from the same data engine. Fine-grained DSL-level scores from that translator then reward the model during training. Supervised fine-tuning barely helped and sometimes hurt out-of-domain results, while GeoDPO gained about twenty-seven percent in-domain, eight percent out-of-domain, and thirty-nine percent on downstream reasoning tasks.

Catalog record

CREATORHao Yu Shuning Jia Guanghao Li Wenhao Jiang Chun Yuan, [.6em] Tsinghua University
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-22703

Browse the full library · About the Tower of Babel