Understanding Degradation with Vision Language Model

Guanzhou Lan, Chenyi Liao, Yuqi Yang, Qianli Ma, Zhigang Wang, Dong Wang, Bin Zhao, Xuelong Li · 2026

Read Understanding Degradation with Vision Language Model by Guanzhou Lan, Chenyi Liao, Yuqi Yang, Qianli Ma, Zhigang Wang, Dong Wang, Bin Zhao, Xuelong Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04565.txt.

Description

Blur, noise, and low light each damage images in measurable physical ways. Guanzhou Lan and 7 co-authors argue in a 2026 paper that vision-language models describe such damage well in words but poorly in numbers.

The team reframes degradation understanding as predicting the damage type, its parameter names, and their continuous values together. They prove these parts fit one prediction scheme. Their model, DU-VLM, trains with fine-tuning and reinforcement learning on structured rewards. A new dataset pairs clean and degraded images with physical annotations. The model beat general baselines and could also steer an image generator to restore pictures without retraining it.

Catalog record

CREATORGuanzhou Lan, Chenyi Liao, Yuqi Yang, Qianli Ma, Zhigang Wang, Dong Wang, Bin Zhao, Xuelong Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04565

Browse the full library · About the Tower of Babel