Identifying and Mitigating Position Bias of Multi-image Vision-Language Models
Xinyu Tian, Shu Zou, Zhaoyuan Yang, Jing Zhang · 2025
Read Identifying and Mitigating Position Bias of Multi-image Vision-Language Models by Xinyu Tian, Shu Zou, Zhaoyuan Yang, Jing Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-13792.txt.
Description
Xinyu Tian, Shu Zou, Zhaoyuan Yang, and Jing Zhang expose position bias in multi image models, in work from 2025. Vision language models now reason over many images in one prompt at once. Tests show that moving the same image to a new slot can swing the answer a lot.
A new task scores reasoning skill for each image slot in a fixed order. Open models did best with late images and worst with early or middle ones. Closed models did best at the edges and worst in the middle slots. A soft attention tweak blends one way and two way attention with no retraining. Bias fell and reasoning scores rose across tested models after the tweak.
Catalog record
| CREATOR | Xinyu Tian, Shu Zou, Zhaoyuan Yang, Jing Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-13792