Stop the Flip-Flop: Context-Preserving Verification for Fast Revocable Diffusion Decoding

Yanzheng Xiang, Lan Wei, Yizhen Yao, Qinglin Zhu, Hanqi Yan, Chen Jin, Philip Alexander Teare, Dandan Zhang, Lin Gui, Amrutha Saseendran, Yulan He · 2026

Read Stop the Flip-Flop: Context-Preserving Verification for Fast Revocable Diffusion Decoding by Yanzheng Xiang, Lan Wei, Yizhen Yao, Qinglin Zhu, Hanqi Yan, Chen Jin, Philip Alexander Teare, Dandan Zhang, Lin Gui, Amrutha Saseendran, Yulan He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06161.txt.

Description

Diffusion language models can reveal many words at once, which speeds up writing, but haste hurts quality. Yanzheng Xiang and 10 co-authors tackle a wasteful pattern in the checking step. Tokens get hidden again for review, then restored unchanged, flip-flopping without progress.

Their method, COVER, checks selected tokens while keeping their stored context active for all other positions. A correction term stops a token from leaking its own answer into its check. Tokens are picked by a score mixing doubt, influence on later words, and drift from stored context. The number checked adapts each step. Benchmarks showed far fewer wasted revisions and faster decoding at the same quality.

Catalog record

CREATORYanzheng Xiang, Lan Wei, Yizhen Yao, Qinglin Zhu, Hanqi Yan, Chen Jin, Philip Alexander Teare, Dandan Zhang, Lin Gui, Amrutha Saseendran, Yulan He
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-06161

Browse the full library · About the Tower of Babel