FastOCR: Dynamic Visual Fixation via KV Cache Pruning for Efficient Document Parsing
Zihan Tang Leqi Shen Hui Chen Ao Wang Ben Wan Yan Feng Ke Zhang Sicheng Zhao Tongxuan Liu Guiguang Ding Tsinghua University JD.com · 2026
Read FastOCR: Dynamic Visual Fixation via KV Cache Pruning for Efficient Document Parsing by Zihan Tang Leqi Shen Hui Chen Ao Wang Ben Wan Yan Feng Ke Zhang Sicheng Zhao Tongxuan Liu Guiguang Ding Tsinghua University JD.com (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17447.txt.
Description
Zihan Tang and colleagues present FastOCR, a training-free accelerator for document parsing with vision-language models that never permanently discards visual tokens. It exploits dynamic visual fixation: attention at each decoding step concentrates on a small shifting region, like a reader's gaze. Focal-guided pruning picks task-relevant tokens from focal layers per step, while cross-step reuse warm-starts each step from the last. On Qwen2.5-VL it keeps 98 percent accuracy while attending to only 5 percent of tokens per step.
Catalog record
| CREATOR | Zihan Tang Leqi Shen Hui Chen Ao Wang Ben Wan Yan Feng Ke Zhang Sicheng Zhao Tongxuan Liu Guiguang Ding Tsinghua University JD.com |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49620 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17447