FastOCR: Dynamic Visual Fixation via KV Cache Pruning for Efficient Document Parsing

Zihan Tang Leqi Shen Hui Chen Ao Wang Ben Wan Yan Feng Ke Zhang Sicheng Zhao Tongxuan Liu Guiguang Ding Tsinghua University JD.com · 2026

Read FastOCR: Dynamic Visual Fixation via KV Cache Pruning for Efficient Document Parsing by Zihan Tang Leqi Shen Hui Chen Ao Wang Ben Wan Yan Feng Ke Zhang Sicheng Zhao Tongxuan Liu Guiguang Ding Tsinghua University JD.com (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17447.txt.

Description

Zihan Tang and colleagues present FastOCR, a training-free accelerator for document parsing with vision-language models that never permanently discards visual tokens. It exploits dynamic visual fixation: attention at each decoding step concentrates on a small shifting region, like a reader's gaze. Focal-guided pruning picks task-relevant tokens from focal layers per step, while cross-step reuse warm-starts each step from the last. On Qwen2.5-VL it keeps 98 percent accuracy while attending to only 5 percent of tokens per step.

Catalog record

CREATORZihan Tang Leqi Shen Hui Chen Ao Wang Ben Wan Yan Feng Ke Zhang Sicheng Zhao Tongxuan Liu Guiguang Ding Tsinghua University JD.com
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49620
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17447

Browse the full library · About the Tower of Babel