VPNeXt : Rethinking Dense Decoding for Plain Vision Transformer

Xikai Tang, Ye Huang, Guangqiang Yin, Lixin Duan · 2025

Read VPNeXt : Rethinking Dense Decoding for Plain Vision Transformer by Xikai Tang, Ye Huang, Guangqiang Yin, Lixin Duan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-16654.txt.

Description

Xikai Tang, Ye Huang, Guangqiang Yin, and Lixin Duan published a paper in 2025 rethinking how plain vision transformers label every pixel of an image. Tasks like street-scene parsing need a label per pixel, and the standard add-ons for this are heavy decoders and fake feature pyramids. The authors question whether either crutch is truly needed.

They replace the heavy decoder with a lighter replay of visual context that captures the same benefit. For enlarging features, they use the real pyramid the plain transformer quietly builds, something earlier work overlooked. Tests show the simpler model reaching top scores, and on a classic benchmark it cleared a long-standing accuracy wall by the widest margin since twenty fifteen. Simple, they argue, was being underestimated.

Catalog record

CREATORXikai Tang, Ye Huang, Guangqiang Yin, Lixin Duan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-16654

Browse the full library · About the Tower of Babel