Enhancing Geometric Perception in VLMs via Translator-Guided Reinforcement Learning
Hao Yu Shuning Jia Guanghao Li Wenhao Jiang Chun Yuan, [.6em] Tsinghua University · 2026
Read Enhancing Geometric Perception in VLMs via Translator-Guided Reinforcement Learning by Hao Yu Shuning Jia Guanghao Li Wenhao Jiang Chun Yuan, [.6em] Tsinghua University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22703.txt.
Description
Hao Yu and four co-authors sharpen geometric perception in vision-language models, a known weak spot. These models often misread basic diagram parts, yet past fixes blurred perception and reasoning together. The team splits them apart with GeoPerceive, a benchmark pairing diagram cases with domain-specific language descriptions plus an automatic data pipeline.
GeoDPO, their translator-guided reinforcement learning method, trains a natural-language-to-DSL translator on synthetic pairs from the same data engine. Fine-grained DSL-level scores from that translator then reward the model during training. Supervised fine-tuning barely helped and sometimes hurt out-of-domain results, while GeoDPO gained about twenty-seven percent in-domain, eight percent out-of-domain, and thirty-nine percent on downstream reasoning tasks.
Catalog record
| CREATOR | Hao Yu Shuning Jia Guanghao Li Wenhao Jiang Chun Yuan, [.6em] Tsinghua University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-22703