ReasonEdit: Editing Vision–Language Models using Human Reasoning

Jiaxing Qiu, Kaihua Hou, Roxana Daneshjou, Ahmed Alaa, Thomas Hartvigsen · 2026

Read ReasonEdit: Editing Vision–Language Models using Human Reasoning by Jiaxing Qiu, Kaihua Hou, Roxana Daneshjou, Ahmed Alaa, Thomas Hartvigsen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02408.txt.

Description

Jiaxing Qiu and 4 co-authors let people explain their reasoning when fixing a vision-language model, in a 2026 arXiv paper. Model editing corrects errors in a pretrained model without disturbing unrelated behavior. Earlier editors handled simple facts, not tasks where a person must reason about an image.

Their editor, ReasonEdit, stores human explanations in a codebook of facts. At inference time it retrieves only the relevant entries, using a new embedding method that balances connections across image and text, inspired by network science. Across four vision-language models and several question-answering datasets built on rationales, ReasonEdit reached the best editing performance reported. Edits generalized better when reasoning was included. The work suggests explanations are not just documentation; they are usable repair material.

Catalog record

CREATORJiaxing Qiu, Kaihua Hou, Roxana Daneshjou, Ahmed Alaa, Thomas Hartvigsen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02408

Browse the full library · About the Tower of Babel