Where to Attend: A Principled Vision-Centric Position Encoding with Parabolas
Christoffer Koo Øhrstrøm, Rafael I. Cabral Muchacho, Yifei Dong, Filippos Moumtzidellis, Ronja Güldenring, Florian T. Pokorny, Lazaros Nalpantidis · 2026
Read Where to Attend: A Principled Vision-Centric Position Encoding with Parabolas by Christoffer Koo Øhrstrøm, Rafael I. Cabral Muchacho, Yifei Dong, Filippos Moumtzidellis, Ronja Güldenring, Florian T. Pokorny, Lazaros Nalpantidis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01418.txt.
Description
Christoffer Koo Øhrstrøm and co-authors propose PaPE, a parabola-based position encoding for tokens. Tokens from videos, event streams, images, or clouds get positions from PaPE with vision traits in mind. Earlier work mostly stretched language encodings onto vision structures, capturing traits only partly. PaPE follows rules: translation invariance, rotation invariance, distance decay, directionality, and context awareness. ImageNet-1K tests show PaPE beating the next-best encoding by up to 10.5% in absolute terms. Broader tests across 8 datasets and 4 modalities find PaPE matching the best on 5, topping all on 2.
Catalog record
| CREATOR | Christoffer Koo Øhrstrøm, Rafael I. Cabral Muchacho, Yifei Dong, Filippos Moumtzidellis, Ronja Güldenring, Florian T. Pokorny, Lazaros Nalpantidis |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56936 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.01418